Data Engineer – Oil & Gas
ITMates
WorldwideremotePosted 8 days ago
Skill Required
Data-EngineerPipeline-EngineerCloud-Data-EngineerOffshore-Data-EngineerIndustrial-Data-EngineerLead-Data-EngineerData Engineerdata engineeringEngineeringDatabricksSnowflakeanalyticsAirflowPythonSparkKafkaAzureClouddbtSQLAWSandContract
Key highlights
- Senior level role requiring 5+ years of data engineering experience
- Remote position with Houston business hours
- Requires strong SQL, Python, and Spark skills in production environments
- Experience with Azure or AWS data stacks
- Must have advanced English proficiency
- Preferred knowledge of oil and gas domain standards (WITSML, PPDM, OSDU)
Role overview
Responsibilities
- Ingest time-series data from SCADA and historians (OSIsoft PI, OPC UA) alongside ERP and production accounting sources
- Build batch and streaming pipelines on Databricks or Snowflake with Spark, Kafka and Airflow
- Model data in a medallion architecture for production, drilling and maintenance analytics
- Enforce data quality, lineage and access controls
- Work with reservoir and production engineers to turn their questions into datasets
- Optimize pipeline cost and performance
Requirements
- 5+ years in data engineering
- Strong SQL and Python, plus Spark in production
- Experience on Azure or AWS data stacks
- Orchestration with Airflow or similar, and dbt for transformations
- Experience with high-volume time-series or IoT data
- Advanced English
Nice to have
- Oil and gas domain knowledge (WITSML, PPDM, OSDU)
- PI System integration experience
- Spanish or Portuguese for work with LATAM operations
Additional details
- Client: oil and gas company (upstream operator, Houston HQ)
- Location: remote, LATAM, Houston business hours
- Level: senior
- Engagement: full-time contractor
- Originally posted on Himalayas