Posted today · be early
Senior Data Engineer - Terminal.exe
All Your BI
WorldwideremotePosted today
Skill Required
Data-EngineerData-EngineeringPipeline-EngineeringData-ArchitectureCloud-Data-EngineeringSenior-Data-EngineeringSenior-Data-Pipeline-EngineerSenior-Data-Engineer-JobsSenior-Data-Engineer-PositionsData Engineerdata engineeringObservabilityAzureSQL ServerEngineeringPostgreSQLanalyticssecuritybuildingwrittenPythondesignDevOpsArgoCDKafkaCI/CDCloudDesign PatternsRustSQLandETLGoCICDFulltime
Key highlights
- Salary: €85,000–€99,000 per year (inclusive of holiday allowance), based on experience
- 5+ years of data engineering experience required, with end-to-end ownership of production platforms
- €5,000 annual personal growth budget with autonomous spending
- Fully remote within Europe, with EU-wide benefit applicability
- Build pipelines and data model powering a live SaaS platform for container terminals worldwide
- Go experience is a significant plus (core connector/consumer codebase is written in Go)
Role overview
This is a Senior Data Engineer role at Terminal.exe, All Your BI's AI-native SaaS platform for container terminal operators. You will design and build the core pipelines and data model that transform fragmented, hard-to-trust terminal data into a governed, standardized dataset that operators worldwide run their day on. The platform is growing fast and needs someone comfortable with architectural ownership to scale multi-tenant data architecture, near-real-time streaming pipelines, and a standardized data model across terminals.
Responsibilities
- Design and build pipelines that move data from terminal operating systems (such as Navis N4) into the platform
- Build the transformation layer that turns raw operational data into curated, documented datasets
- Work on ELT pipelines from on-premises terminal databases into the Azure-based platform, with near-real-time refresh (3-minute microbatch) for operational reporting and daily batch for analytics
- Implement watermark-based incremental queries over Kafka (Azure Event Hubs) to PostgreSQL staging for data extraction
- Design and build a multi-tenant data architecture on Azure PostgreSQL with database-per-tenant isolation and a standardized STG → ODS → DataMart layer structure driven by the internal declarative transformation framework (dewi)
- Help develop and extend internal connector tooling written in Go
- Implement data quality monitoring: gap detection, freshness alerting, and reconciliation
- Map source data from different TOS versions and configurations onto shared definitions of moves, calls, and equipment events as part of the standardized terminal data model
- Work directly with terminal operations staff, without intermediate layers
Requirements
- Curiosity and a genuine appetite for architectural ownership
- 5+ years of data engineering experience, including end-to-end ownership of production data platforms
- Comfortable making decisions independently, not just executing (product under active development)
- Strong SQL and Python
- Solid experience with SQL Server as a source system and PostgreSQL as a target store
- Experience building and operating ELT pipelines against operational source systems, including watermark/incremental or CDC/replica-based extraction
- Experience with event-driven or streaming architectures; familiarity with Azure Event Hubs with a Kafka-compatible endpoint
Nice to have
- Go experience (connector and consumer codebase is written in Go)
- Cloud data platform experience on Azure, familiarity with AKS, Azure DevOps CI/CD, and GitOps (Argo CD)
- Strong focus on data correctness and instrumentation; familiarity with OpenTelemetry
- Knowledge of the container terminal or port logistics industry
- Direct experience with Navis N4 or another TOS
- Multi-tenant SaaS data architecture experience
- Familiarity with declarative, YAML-driven transformation frameworks
- Industry knowledge is a strong plus, not a hard requirement — the company will teach the terminal domain
Benefits
- Salary between €85,000–€99,000 per year inclusive of holiday allowance, based on experience
- €5,000 a year for personal growth, with real say in how you spend it
- 25 vacation days plus the option to buy up to 10 more, local public holidays, and the option of a sabbatical up to 4 months
- Two trips abroad a year with the whole team plus occasional drinks and team outings
- €500 home-office budget and a great laptop
- Fully remote, within Europe
- Benefits across the EU: perks apply to everyone everywhere; statutory benefits (pension, health, social security, leave, sick pay, notice) follow the hire's country via local contract or EOR
- Well-earned recognition ('Hey, well done Buddy!') now and then
Additional details
- Terminal.exe is All Your BI's SaaS platform for container terminals that unifies fragmented data — TOS, maintenance, gate, sensors — into one governed model so every site works from the same numbers instead of rebuilding its own reporting from scratch
- All Your BI is a remote-first data agency based in Rotterdam; since 2019 they've grown from a boutique consultancy into an international data team of more than 60 data heroes spread across Europe
- They deliver managed BI services for logistics and industrial companies, helping reduce data waste and move businesses forward
- They live for the WOW moment — that sparkle in users' eyes when they gain new insights and discover opportunities
- They work according to Holacracy: little hierarchy, lots of ownership
- The platform is growing fast; you'll help shape engineering foundations that need to scale next: multi-tenant data architecture, near-real-time pipelines from 24/7 operations, and a standardized data model across terminals worldwide
- Originally posted on Himalayas
- They hire to widen the mix of perspectives, not narrow it; what matters is what you can do and the perspective you bring, not age, gender, ethnicity, orientation, disability, background, or where you studied
