OpsXpress is seeking a QA Engineer (Manual Testing) to join the core engineering team at Emmacare, a leading US-based SaaS platform specializing in Chronic Care Management (CCM) and Telehealth.
We are looking for an experienced Manual QA Engineer with 4 to 5 years of experience with deep core QA expertise and specialized experience in evaluating AI features and Prompt Engineering. In this role, half of your focus will be grounded in rigorous, deep-dive manual testing across complex web/mobile platforms. The remainder will focus on stress-testing LLMs, refining prompt structures, and driving standard QA practices across non-deterministic software systems.
Responsibilities
- Manual Quality Assurance (50%) - Perform deep, hands-on Exploratory, Functional, Integration, Regression, and Smoke testing across web and mobile platforms.
- Manual Quality Assurance (50%) - Execute thorough API testing (using Postman, Insomnia, or Curl) to validate backend logic, payload structures, status codes, and edge-case handling.
- Manual Quality Assurance (50%) - Uncover complex system bugs, race conditions, state management issues, and cross-browser/platform UI flaws.
- Manual Quality Assurance (50%) - Author clear, detailed, and reproducible bug reports with log traces, network captures, and clear acceptance criteria.
- Manual Quality Assurance (50%) - Conduct end-to-end user journey validations across multi-system integrated workflows.
- AI & Prompt Testing (30%) - Evaluate LLM and Generative AI outputs for accuracy, hallucinations, bias, tone, and context adherence.
- AI & Prompt Testing (30%) - Perform systematic Prompt Engineering and Prompt Testing to optimize prompt templates, system instructions, and dynamic variables.
- AI & Prompt Testing (30%) - Create and manage test datasets for continuous model evaluation and semantic correctness.
- QA Processes & Metrics (20%) - Establish standardized manual testing processes tailored for non-deterministic AI applications.
- QA Processes & Metrics (20%) - Define and track key evaluation metrics for AI quality (e.g., relevance, faithfulness, coherence, response latency, refusal accuracy).
- QA Processes & Metrics (20%) - Participate in Agile ceremonies (Sprint Planning, Grooming, Retrospectives) representing Quality Assurance.
Requirements
- Core QA Expertise - 4–5 years of hands-on manual QA experience in commercial web and/or mobile applications.
- Core QA Expertise - Strong knowledge of software fundamentals, architectural flow, client-server communication, and web protocols.
- Core QA Expertise - Proficiency in API testing (Postman, REST APIs, JSON/XML payload validation).
- Core QA Expertise - Advanced defect-logging skills and mastery of test management tools (Jira, TestRail, Qase).
- Core QA Expertise - Deep understanding of STLC, exploratory testing strategies, and risk-based testing approaches.
- AI & Prompt Engineering Expertise - Proven experience evaluating AI/LLM-powered features (e.g., OpenAI, Anthropic, Gemini, open-source models).
- AI & Prompt Engineering Expertise - Hands-on experience writing, tuning, and testing structured prompts (few-shot, chain-of-thought, system prompts).
- AI & Prompt Engineering Expertise - Familiarity with common AI vulnerabilities (Prompt Injection, Hallucinations, Data Poisoning, System Instructions Leakage).
Nice to have
- Basic Python scripting knowledge for data manipulation or simple API test scripts.
- Understanding of data privacy and safety considerations in AI systems.
Additional details
- Job Title: QA Engineer – AI & Prompt Engineering
- Location: Remote
- Employment: Full-time, OpsXpress(India)
- Client: Emmacare (USA)
- Experience Level: 4 – 5 Years
- Salary: "No bar" for top-tier talent.
- Job Type: Full-Time
Zobhira
