Sr. Big Data Engineer
Databricks
IndiaremotePosted 2 days ago
Skill Required
Big-Data-EngineeringData-EngineeringSolutions-EngineeringData-Platform-EngineeringProfessional-ServicesTechnical-ConsultingCloud-ComputingForward-Deployed-EngineeringBig-Data-EngineerSenior-Data-EngineeringSenior-Data-Engineer-JobsData Engineersoftware engineeringdata engineeringEngineeringJavaScriptTypeScriptDatabricksBootstrapdesigninganalyticsbuildingPythondesignScalaSparkAzureCI/CDUnityCloudMachine LearningAPIsAWSGCPandCICDFulltime
Key highlights
- Databricks is the Data and AI company serving more than 20,000 organizations worldwide, including 70% of the Fortune 500
- The role is billable and requires customer-facing delivery with 20% travel to customer sites
- 6+ years of experience in data engineering, data platforms & analytics required
- Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals required
- Databricks Certification required
- Key benefit: Comprehensive benefits and perks (specific details by region available)
Role overview
As a Forward Deployed Engineer (FDE), you will work with customers to build and productionize solutions to their Data & AI challenges using the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning Data Engineering, AI, and application development. This is a hands-on, customer-facing role for builders who thrive at the intersection of technology and business impact. The ideal candidate combines data engineering expertise with adaptability, curiosity, and a passion for working with customers and teammates to solve complex problems that drive measurable outcomes. FDEs are billable and know how to complete projects according to specifications with exceptional customer empathy.
Responsibilities
- Lead impactful customer technical projects by delivering production-grade systems, designing and building reference architectures, custom data applications and data ingestion and ML/AI model integration
- Guide strategic customers as they implement transformational big data projects including end-to-end design, build and deployment of industry-leading Big Data and AI applications
- Work with engagement managers to scope technical delivery work with input from the customer
- Guide customers on architecture and design; bootstrap or implement customer projects which leads to a customers' successful understanding, evaluation and adoption of Databricks
- Lead architecture and design decisions, ensuring solutions are secure, scalable, and aligned with both customer needs and Databricks best practices
- Work with the Databricks technical team, Project Manager, Architect and Customer team to ensure the technical components of the engagement are delivered to meet customer's needs
- Work with Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement-specific product and support issues
- Embed with customer teams, engaging with stakeholders from technical ICs to executives to deeply understand challenges and deliver impact
- Contribute accelerators, frameworks, and best practices that scale impact across accounts and influence the Databricks product roadmap
- Design and deployment of performant production end-to-end data architectures and applications that combine data pipelines, ML/AI models, and user-facing interfaces
- Experience with technical project delivery - managing scope, timelines and measurable outcomes, translating complex concepts into actionable solutions
- Travel to customers 20% of the time
Requirements
- 6+ years of experience in data engineering, data platforms & analytics, (additional software engineering experience is a nice-to-have)
- Comfortable writing code in either Python, Scala, JavaScript/TypeScript, and modern frameworks
- Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals
- Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
- Familiarity with CI/CD for production deployments
- Working knowledge of MLOps, ML/AI models and AI APIs
- Documentation and white-boarding skills
- Experience working with enterprise clients and managing conflicts across a broad stakeholder range
- Databricks Certification
Nice to have
- additional software engineering experience
- Build skills in technical areas, and demonstrate curiosity, adaptability, and eagerness to explore new technologies which support the deployment and integration of Databricks-based solutions to complete customer projects
Benefits
- Comprehensive benefits and perks that meet the needs of all of our employees
Additional details
- For specific details on the benefits offered in your region click here
- At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics
- If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone