Senior Staff Software Engineer- Search Quality
Databricks
Bengaluru, IndiahybridPosted 3 months ago
Skill Required
Engineering - PipelineSoftware EngineerSoftware DeveloperElasticsearchDatabricksData StructuresbuildingUnityGenerative AIRAGSQLAI
Key highlights
- Salary not specified
- Required experience level not specified
- Key benefit: Front-row seat to the Agentic revolution
- Notable requirement: Expertise in Lucene/Elasticsearch, embeddings, and ranking algorithms
Role overview
As a Search Quality Engineer at Databricks, you will play a pivotal role in democratizing Data and AI for enterprise users. Your mission is to build the contextual backbone for both AI agents and human users, ensuring instant, accurate, and actionable insights. This involves optimizing hybrid retrieval systems, fine-tuning ranking models, and ensuring high-stakes accuracy in a data-heterogeneous environment.
Responsibilities
- Own the quality of search results for both AI agents and human users.
- Optimize the retrieval layer for LLMs to ensure accurate, high-stakes business actions.
- Improve the traditional search experience for employees through intuitive, high-recall interfaces.
- Balance hybrid retrieval methods: keyword-based search and semantic vector search.
- Fine-tune ranking models to satisfy both human readability and LLM-ready context.
- Build guardrails and relevance scoring to prevent AI hallucinations.
- Connect structured SQL tables, unstructured docs, and real-time business metrics.
Requirements
- Expertise in Information Retrieval (IR) with knowledge of Lucene/Elasticsearch, embeddings, and ranking algorithms.
- Strong focus on quality and metrics, including building evaluation frameworks (human-in-the-loop and LLM-based).
- Obsession with relevance metrics such as nDCG, MRR, and Precision@K.
- Ability to apply traditional IR wisdom to Retrieval-Augmented Generation (RAG).
Benefits
- Front-row seat to the Agentic revolution, solving hard problems in data discovery.
- Opportunity to power the decision-making of thousands of people across 20,000+ organizations worldwide.
- Comprehensive benefits and perks tailored to your region.
Additional details
- Databricks is the Data and AI company, serving 20,000+ organizations globally, including 70% of the Fortune 500.
- Headquartered in San Francisco with 30+ offices worldwide.
- Offers a unified platform including Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog.
- Committed to fostering a diverse and inclusive culture with inclusive hiring practices.
- Compliance with export-controlled technology regulations may affect job duties and hiring decisions.