Senior Data Engineer - Terminal.exe

All Your BIRotterdamRemoteFull-time9 Sept 2026

Terminal.exe, All Your BI's AI-native data platform for container terminal operators, is seeking a Senior Data Engineer to build and own the core data pipelines and data model. The role involves designing ELT pipelines from terminal systems into an Azure-based platform, with a focus on near-real-time and batch processing. Requires 5+ years of data engineering experience, strong SQL and Python skills, and experience with Azure, streaming, and operational source systems.

What you'll do

Design and build ELT pipelines from on-premises terminal databases into Azure-based platform
Implement near-real-time refresh (3-minute microbatch) for operational reporting and daily batch for analytics
Extraction using watermark-based incremental queries over Kafka (Azure Event Hubs) to PostgreSQL staging
Develop multi-tenant data architecture on Azure PostgreSQL with database-per-tenant isolation
Implement standardized STG → ODS → DataMart layer structure driven by internal declarative transformation framework (dewi)
Develop and extend internal connector tooling written in Go
Implement data quality monitoring: gap detection, freshness alerting, and reconciliation
Map source data from different TOS versions and configurations onto shared definitions of moves, calls, and equipment events
Work directly with terminal operations staff

What you need

Must-have

SQLPythonSQL ServerPostgreSQLELT pipelinesApache KafkaAzure Event HubsAzure

Nice-to-have

GoAKSAzure DevOpsCI/CDGitOpsArgo CDOpenTelemetryNavis N4

Soft skills

CuriosityArchitectural ownershipComfortable decidingCollaborationCommunication

Data EngineeringSeniorAzureELTKafkaPostgreSQLSQL ServerPythonGoContainer Terminal

/What you'll do

/What you need

Must-have

Nice-to-have

Soft skills

What you'll do

What you need