Posted today · be early
Data Engineer (Databricks)
Addepto
WorldwideremotePosted 1 day ago
Skill Required
Data-EngineeringBig-DataData-Platform-EngineeringCloud-Data-EngineeringDatabricksData-Pipeline-EngineeringDatabricks-Data-EngineerDatabricks-EngineerData-Engineering-(Databricks)Data-EngineerDatabricks-EngineeringGCP-Databricks-EngineerData EngineerMachine Learningdata engineeringAirflowrelated fieldEngineeringR ProgrammingdevelopingObservabilityPower BIdesigningbuildingSparkAzurePythondesignCI/CDCloudRustGenerative AIdbtandDesign PatternsCICDFulltime
Key highlights
- Minimum 3+ years of commercial Big Data experience required.
- Flexible remote or office‑based work arrangements.
- Partnerships with Databricks and Anthropic provide access to premium training and certifications.
- Work on high‑impact projects for leading enterprises such as Rolls Royce, Continental, Porsche, ABB, and WGU.
- Comprehensive health, sports, and well‑being benefits including psychotherapy and coaching.
- Opportunities to represent the company at conferences and publish in the blog.
Role overview
Addepto is a leading AI consulting and data engineering firm that builds scalable, ROI‑focused AI solutions for large enterprises and pioneering startups. As a Data Engineer you will join a team of technology experts working on challenging projects across various industries, leveraging cutting‑edge technologies to design, build, and operate data platforms.
Responsibilities
- Design scalable data processing pipelines for streaming and batch processing using Big Data technologies like Databricks, Airflow and/or Dagster.
- Contribute to the development of CI/CD and MLOps processes.
- Develop applications to aggregate, process, and analyze data from diverse sources.
- Collaborate with the Data Science team on Machine Learning projects, including text/image analysis and predictive model building.
- Develop and organize data transformations using Databricks/DBT and Apache Airflow.
- Translate business requirements into technical solutions and ensure optimal performance and quality.
Requirements
- At least 3+ years of commercial experience implementing, developing, or maintaining Big Data systems.
- Strong programming skills in Python: writing clean code, OOP design.
- Experience in designing and implementing data governance and data management processes.
- Familiarity with Big Data technologies like Airflow or Dagster, Databricks, Spark and DBT.
- Experience implementing and deploying solutions in cloud environments (with a preference for Azure).
- Knowledge of how to build and deploy Power BI reports and dashboards for data visualization.
- Excellent understanding of dimensional data and data modeling techniques.
- Excellent communication skills and consulting experience with direct interaction with clients.
- Ability to work independently and take ownership of project deliverables.
- Bachelor’s or Master's degree in Computer Science, Data Science, Mathematics, Physics, or a related field.
Benefits
- Work in a supportive team of passionate AI & Big Data enthusiasts.
- Engage with top‑tier global enterprises and cutting‑edge startups on international projects.
- Flexible work arrangements: remote, modern offices, or coworking spaces.
- Career development paths, knowledge‑sharing initiatives, language classes, and sponsored training and conferences.
- Access to industry‑leading training materials and certification programs through partnerships with Databricks and Anthropic.
- Team‑building events and an integration budget.
- Celebrations for work anniversaries, birthdays, and milestones.
- Medical and sports packages, eye care, and well‑being support services, including psychotherapy and coaching.
- Full work equipment including laptop and necessary devices.
- Opportunities to boost personal brand by speaking at conferences, writing for the blog, or participating in meetups.
- Smooth onboarding with a dedicated buddy in a friendly, supportive, and autonomous culture.
Additional details
- Addepto focuses exclusively on Artificial Intelligence and Big Data, helping organizations unlock the full potential of their data for measurable business impact and long‑term growth.
- The company has developed its own product, ContextClue, and contributes open‑source solutions to the AI community.
- Recognized by Forbes as one of the top 10 AI consulting companies worldwide.
- Part of KMS Technology, a US‑based global technology group, combining deep AI specialization with enterprise‑scale delivery capabilities.
- Project examples: design and development of a universal data platform for global aerospace companies using Azure and Databricks; data platform transformation for an energy management association using Databricks, Apache Spark/PySpark, and Delta Live Table tests; design of data transformation and data‑ops pipelines for a global car manufacturer, handling real‑time streaming, batch data, and exploring LLMs for chatbots and data analysis.
