Posted today · be early

Copy of AI Code Reviewer & Systems Evaluation Engineer 2

Lifted (an Upwork Company)

IndiaremotePosted today

Skill Required

Software-EngineerCode-ReviewerAI-EvaluatorSystems-EngineerQA-EngineerAI-Evaluation-EngineerAI-Systems-EvaluatorCode-Review-AnalystAI-Evaluation-SpecialistAI-Systems-Testing-SpecialistML-Evaluation-EngineerEvaluation-EngineerAI EngineerAIEngineeringR ProgrammingJavaScriptanalyticalautomationdebuggingPythonJavaAPIsSQLandGoContract

Key highlights

2+ years of experience in backend engineering, AI automation, or systems integration
Payment is based on completed tasks only
Fully remote and flexible work schedule
No guaranteed workload

Role overview

An enterprise client is currently seeking experienced software engineers to contribute to improving advanced AI systems through human feedback. This work supports leading AI organizations in training large language models to better understand software development practices, debugging, and code quality. This is part of a cutting-edge initiative focused on enhancing how AI systems write, review, and optimize code in real-world scenarios. This opportunity is ideal for engineers who enjoy analyzing systems, improving code quality, and working on complex technical challenges; you’ll play a key role in shaping how AI models evaluate performance, detect issues, and generate reliable outputs.

Responsibilities

Contribute to AI training projects by evaluating outputs, refining logic, and identifying potential vulnerabilities
Develop objective, verifiable evaluation criteria (rubrics) for system performance
Review system logs and execution paths to improve reliability and code quality
Refactor code and optimize system behavior toward ideal outcomes
Test systems for vulnerabilities, including data exposure and edge-case failures
Provide detailed, high-quality feedback on system performance and outputs

Requirements

2+ years of experience in backend engineering, AI automation, or systems integration
Strong proficiency in at least two programming languages (e.g., Python, JavaScript, Go, Java)
Experience working with SQL databases
Proven ability to build and maintain production-grade systems
Experience working in live (non-mocked) environments with multi-step interactions
Strong analytical skills and attention to detail

Nice to have

Experience with multi-stage system workflows and coordination tasks
Familiarity with integrating tools such as APIs, databases, or external platforms
Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation)
Experience working with AI systems or agent-based workflows
Comfort working with persistent state tracking or similar frameworks