AI SDET
Hitachi
Kolkata, West Bengal, IndiaPosted 4 months ago
Skill Required
AI EngineerSDETSoftware EngineerSoftware DeveloperAIMachine LearningComputer VisionDeep LearningGenerative AIETLObservabilityLangChainEngineeringTensorFlowKubernetesMLflowsecuritybuildingEmbedded CDockerExpressPyTorchetc.)TestNGPythondesignAzureLinuxAgileFulltime
Key highlights
- Required experience: 7–10+ years in software testing/SDET, with 2+ years focused on AI/ML systems.
- Preferred job location: Kolkata, India.
- Key benefit: Industry‑leading health and wellbeing benefits plus flexible work arrangements.
- Notable requirement: Strong proficiency in Python for test development and AI evaluation tooling.
- Experience with AI/ML frameworks such as PyTorch, TensorFlow, Scikit‑learn, Hugging Face, Azure AI, AWS AI/ML, or Google Vertex AI.
- Certifications (e.g., Microsoft Certified: Azure AI Engineer Associate) are considered a plus.
Role overview
Hitachi Vantara is seeking an AI SDET to join the Global Quality Assurance team, designing and executing test strategies for AI‑driven systems, including LLM‑powered features, machine learning components, and intelligent automation workflows. The role involves close collaboration with product teams, data scientists, ML engineers, and platform teams to validate AI behavior across the full lifecycle, from data ingestion and model inference to system integration and user‑facing functionality.
Responsibilities
- AI System Validation: Test and validate AI/ML features across internal models, embedded AI components, and integrated AI services.
- Model Behavior Evaluation: Assess model inference quality, prompt/response behavior, performance, safety, and robustness across diverse scenarios.
- Data Pipeline & Schema Verification: Validate data contracts, feature schemas, and payload structures used by AI models and downstream systems.
- End-to-End Workflow Testing: Ensure AI-driven workflows function reliably across internal components, orchestration layers, and user-facing applications.
- Tooling & Automation: Build tools to simulate AI behavior, automate evaluation workflows, generate test datasets, and support continuous validation.
- AI Quality & Reliability: Identify edge cases, failure modes, drift indicators, and quality gaps in AI-powered features.
- Security & Responsible AI Checks: Validate compliance with security, privacy, fairness, and responsible AI guidelines.
- Cross‑Functional Collaboration: Work with product, engineering, and data science teams to troubleshoot issues, validate fixes, and improve AI feature readiness.
- Documentation: Produce clear documentation for AI test plans, expected behaviors, evaluation criteria, and validation procedures.
- Continuous Improvement: Propose enhancements to improve AI reliability, observability, and test coverage across the lifecycle.
Requirements
- 7–10+ years of experience in software testing or SDET roles, with 2+ years focused on AI/ML systems.
- Strong proficiency in Python for test development, data validation, and evaluation tooling.
- Strong foundational knowledge of storage technologies, such as block storage, object storage (S3‑compatible systems), NFS, or distributed file systems.
- Experience with AI/ML frameworks or platforms such as PyTorch, TensorFlow, Scikit‑learn, Hugging Face, Azure AI, AWS AI/ML, or Google Vertex AI.
- Understanding of AI/ML concepts including model inference behavior, evaluation metrics, prompt/response quality, drift, bias, and fairness considerations.
- Experience testing LLM‑based systems or ML‑powered features.
- Familiarity with MLOps tools and workflows (MLflow, Kubeflow, SageMaker, Vertex AI, etc.).
- Strong understanding of QA methodologies, SDLC, and agile practices.
- Experience with Linux/UNIX environments and containerized workflows (Docker).
- Excellent communication skills and ability to collaborate across global teams.
Nice to have
- Knowledge of Hitachi products such as VSP 360, Ops Center will be an added advantage.
- Microsoft Certified: Azure AI Engineer Associate
- AWS Certified Machine Learning – Specialty
- Google Professional Machine Learning Engineer
- NVIDIA Deep Learning Institute Certifications (LLMs, generative AI, computer vision)
- TensorFlow Developer Certificate
- Hugging Face NLP/LLM Certifications
- ISTQB Certified Tester – AI Testing
- Certified Kubernetes Administrator (CKA) or CKAD
Benefits
- Industry‑leading benefits, support, and services that look after your holistic health and wellbeing.
- Flexible arrangements that work for you (role and location dependent).
- A sense of belonging, autonomy, freedom, and ownership while working alongside talented people.
- Commitment to an inclusive culture based on mutual respect and merit‑based systems.
- Equal opportunity employer, welcoming all applicants regardless of protected characteristics.
- Provision of reasonable accommodations during the recruitment process.
Additional details
- Function
- Our Company: We’re Hitachi Vantara, the data foundation trusted by the world’s innovators. Our resilient, high‑performance data infrastructure means that customers – from banks to theme parks – can focus on achieving the incredible with data.
- If you’ve seen the Las Vegas Sphere, you’ve seen just one example of how we empower businesses to automate, optimize, innovate – and wow their customers. Right now, we’re laying the foundation for our next wave of growth. We’re looking for people who love being part of a diverse, global team – and who get excited about making a real‑world impact with data.
- About Us: We’re Hitachi Vantara, a global infrastructure business. Our people are the force of meaningful progress. We enable the incredible with data – from taking theme park fans on magical rides, conserving natural resources, protecting rainforests to saving lives. We empower businesses to automate, optimize, and advance innovation. Together, we create a sustainable future for all.
- Role Overview: Hitachi Vantara is seeking an AI SDET to join our Global Quality Assurance team. In this role, you will design and execute test strategies for AI‑driven systems, including LLM‑powered features, machine learning components, and intelligent automation workflows. You will collaborate closely with product teams, data scientists, ML engineers, and platform teams to validate AI behavior across the full lifecycle—from data ingestion and model inference to system integration and user‑facing functionality. This includes evaluating model outputs, ensuring reliability and safety, validating data pipelines, and building tooling that supports predictable, high‑quality AI experiences.
- Experience: 7–10+ Years Job Location: Kolkata, India preferred
- #LI SP7
- Fostering innovation through diverse perspectives: Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.
- We are committed to building an inclusive culture based on mutual respect and merit‑based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.
- We help take care of your today and tomorrow with industry‑leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.
- We’re a global team of innovators. Together, we harness engineering excellence and passion for insight to co‑create meaningful solutions to complex challenges. We turn organizations into data‑driven leaders that can make a positive impact on their industries and society.