Technical Data Engineer (Databricks)
ShyftLabs
Coimbatore, Tamil Nadu, IndiaPosted 26 days ago
Skill Required
IT JobsData EngineerTechnical LeadDatabricksEngineeringRESTbuildingSparkPythonSQLAWSFulltime
Key highlights
- Role: Data Engineer
- Platform: Databricks Lakehouse
- Company: ShyftLabs (founded early 2020)
- Clients: Primarily Fortune 500 companies
Role overview
We are looking for a Data Engineer with hands-on experience in building scalable data pipelines and data engineering solutions on the Databricks Lakehouse Platform. The ideal candidate should have strong expertise in Python, PySpark, SQL, Databricks, AWS, and REST API integrations for data ingestion, managing large volumes of data, and data export. ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies.
Responsibilities
- Building scalable data pipelines
- Building data engineering solutions on the Databricks Lakehouse Platform
- Data ingestion via REST API integrations
- Managing large volumes of data
- Data export
Requirements
- Hands-on experience in building scalable data pipelines
- Hands-on experience in building data engineering solutions on the Databricks Lakehouse Platform
- Strong expertise in Python
- Strong expertise in PySpark
- Strong expertise in SQL
- Strong expertise in Databricks
- Strong expertise in AWS
- Strong expertise in REST API integrations
This is a condensed summary from the original listing. Click Apply to view the complete job description and all details.