Senior Solutions Consultant

Unison Group

IndiaremotePosted 7 days ago

Skill Required

Solutions-ConsultantData-EngineerDatabricks-ConsultantData-Platform-ConsultantSenior-Solutions-ConsultantSenior-Solutions-SpecialistSenior-Solutions-EngineerSenior-Federal-Solutions-ConsultantSolution-Consultantdata engineeringAzureAirflowCD pipelinesGCPEngineeringDatabricksanalyticaldevelopingdesigninganalyticsbuildingSparkTestNGPythonMLflowdesignDevOpsCI/CDUnityAgileCloudETLSQLAWSFulltime

Key highlights

6+ years of overall IT experience.
3+ years of hands‑on Databricks experience.
Proficiency in Python, SQL, and Apache Spark (PySpark).
Experience implementing Medallion Architecture (Bronze, Silver, Gold) Lakehouse solutions.
Strong analytical and problem‑solving skills.
Customer‑focused approach translating business requirements into technical solutions.

Role overview

We are seeking a skilled Senior Consultant – Databricks to design, develop, and implement modern data engineering solutions using the Databricks platform. The ideal candidate will work closely with customers and internal teams to understand business requirements, build scalable data pipelines, and deliver high‑quality data solutions leveraging cloud‑based Lakehouse architecture.

Responsibilities

Collaborate with customers and business stakeholders to understand data and analytics requirements.
Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
Build and optimize ETL/ELT workflows for batch and near real‑time data processing.
Implement Data Lakehouse solutions following the Medallion Architecture (Bronze, Silver, Gold).
Develop data transformation logic using Python, PySpark, and SQL.
Ensure data quality, reliability, and performance through testing and optimization.
Troubleshoot and resolve data processing and performance issues.
Work closely with Solution Architects, Data Engineers, and DevOps teams to deliver end‑to‑end solutions.
Participate in code reviews and follow development best practices.
Create technical documentation and provide support during deployment and production activities.

Requirements

6+ years of overall experience in Information Technology.
3+ years of hands‑on experience with Databricks.
Strong hands‑on experience with Databricks.
Proficiency in Python, SQL, and Apache Spark (PySpark).
Good understanding of Data Lake and Lakehouse architecture.
Experience implementing Bronze, Silver, and Gold data layers.
Experience designing and developing ETL/ELT pipelines.
Knowledge of Delta Lake and Spark performance optimization.
Understanding of data modeling and data integration concepts.
Experience working with structured and semi‑structured data.
Strong analytical and problem‑solving skills.
Good communication and customer interaction skills.
Ability to gather and analyze business requirements.
Strong collaboration and teamwork skills.
Ability to manage multiple tasks and deliver within project timelines.
Willingness to learn new technologies and adapt to evolving project requirements.
Hands‑on expertise in Databricks and modern data engineering practices.
A customer‑focused approach with the ability to translate business requirements into technical solutions.
A passion for building scalable, reliable, and high‑performance data platforms.
The ability to work independently as well as collaboratively in cross‑functional teams.

Nice to have

Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
Familiarity with Delta Live Tables, Unity Catalog, Databricks Workflows, and MLflow.
Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar.
Knowledge of Git, CI/CD pipelines, and Agile development methodologies.
Databricks or cloud platform certifications are an added advantage.