Quality Engineer (Remote, KA, IN)
NTT DATA
Skill Required
Key highlights
- Remote position based in Karnātaka (IN-KA), India
- Role involves AI/ML testing including RAG pipelines, LLM inference endpoints, and human-in-the-loop workflows
- Leadership responsibilities including mentoring QE teams and conducting interviews/reviews
- $30 billion global technology services leader serving 75% of Fortune Global 100
- Global Top Employer with 50+ country presence and $3B+ annual R&D investment
- NTT DATA is part of NTT Group
Role overview
NTT DATA is seeking a Quality Engineer to join their team in Remote, Karnātaka (IN-KA), India. The role focuses on leading discovery and documentation efforts to produce five key deliverables: Enterprise Testing Strategy, QE Handbook, Automation Handbook, Perf Engineering Handbook, and Test Enablers. The position involves evaluating and maintaining testing strategies, tools and frameworks, designing and developing test automation frameworks and suites, providing regular quality and status reports, and participating in project-wide reviews of requirements, system architecture and detailed design documents. The Quality Engineer will serve as a key point of contact for other Quality Engineers across multiple teams, identify and resolve integration issues, mentor and guide other QE professionals, and conduct performance reviews and interviews. This role specifically involves developing testing strategies for AI-generated outputs, designing test harnesses for non-deterministic LLM outputs, building integration test suites for RAG pipelines, authoring contract tests for external integration adapters, designing and executing performance tests against LLM inference endpoints, and developing test cases for human-in-the-loop workflow paths.
Responsibilities
- Lead the discovery (Current state) and Documentation that will produce 5 deliverables: Enterprise Testing Strategy, QE Handbook, Automation Handbook, Perf Engineering Handbook, Test Enablers
- Evaluate and maintain the testing strategies, approaches, tools and frameworks used by the teams
- Design, develop and execute test automation frameworks and test automation suites
- Provide regular quality and status reports
- Participate in project-wide reviews of requirements, system architecture and detailed design documents
- Act as key point of contact for other Quality Engineers across multiple teams
- Identify and resolve issues that arise when integrating the application software with other software components
- Mentor and guide other Quality Engineers on the QA Process, the testing strategy, tools and frameworks being used and assist them in growing their careers
- Conduct regular performance reviews and conduct interviews
- Develop testing strategies for AI-generated outputs: structured extraction accuracy measurement, confidence score calibration validation, and regression testing across model or prompt changes
- Design test harnesses for non-deterministic LLM outputs — define acceptable output schemas, boundary conditions, and automated assertion patterns that account for natural response variation
- Build integration test suites for the RAG pipeline: retrieval precision/recall measurement, embedding drift detection, and few-shot example quality validation
- Author contract tests for all external integration adapters to detect upstream API changes before they reach production
- Design and execute performance tests against LLM inference endpoints to validate throughput, latency SLAs, and GPU utilization under concurrent engineer load
- Develop test cases for human-in-the-loop workflow paths: review queue routing logic, SME correction capture, override persistence, and RAG index update verification
Nice to have
- Experience with consumer-driven contract testing patterns (e.g., Pact)
- Experience testing event-driven or workflow-orchestrated systems (Temporal.io, Azure Durable Functions)
- Experience using agentic AI tools for test generation (co-pilot-assisted test authoring, AI-generated test data) in daily QE workflows
Additional details
- Req ID: 379569
- Position location: Remote, Karnātaka (IN-KA), India (IN)
- NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100
- Commitment to accelerating client success and positively impacting society through responsible innovation
- One of the world's leading AI and digital infrastructure providers with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services
- Consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future
- A Global Top Employer with experts in more than 50 countries
- Access to a robust ecosystem of innovation centers as well as established and start-up partners
- Part of NTT Group, which invests over $3 billion each year in R&D
- Hire locally to NTT DATA offices or client sites when possible to provide timely and effective support tailored to each client's needs
- Many positions offer remote or hybrid work options, subject to change based on client requirements
- For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs
- Committed to staying flexible and meeting the evolving needs of both clients and employees
- Recruiters will never ask for payment or banking information and will only use @nttdata.com, @nttdatafed.com and @talent.nttdataservices.com email addresses
- NTT DATA endeavors to make website accessible to any and all users; contact regarding accessibility or application process assistance available
- Contact information for accommodation requests only and cannot be used to inquire about application status
- Equal opportunity employer with consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status
- EEO Policy Statement and Pay Transparency information available
- Originally posted on Himalayas