What You'll Do
Review proposed coding tasks and programming environments for realism Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code challenges Suggest improvements to make the test suites more robust
Who Should Apply
Professional software engineer based in South Asia Experience building or reviewing realistic programming tasks Familiarity with coding evaluation harnesses or test automation Comfortable discussing technical workflows in an interview setting
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $40
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the South Asian Software Engineers: Coding Tasks for AI Evaluation in Remote vacancy
- ...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while...SoftwareRemote
Terac
Remote13 days ago - ...Evaluate and refine AI-generated code for efficiency and reliability. About Turing Based in San Francisco, California, Turing is the world’s leading... ...lasting results on the P&L Role Overview As a Software Engineering evaluator, you will create cutting-edge datasets...SoftwareFull-timePart-timeFlexible hours
Turing
Remote13 days ago - ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...Role Title: Research Engineer - Code Generation & Model Evaluation...SoftwarePart-timeRemote
micro1
Remote13 days ago - ...develop systems to enhance frontier AI capabilities. About Turing:... ...researchers who specialize in coding, reasoning, STEM,... ...enterprises. Our environments evaluate and improve AI models on complex... ...Experience. Our work includes: Software engineering environments for...SoftwarePart-time
Turing
Remote13 days ago $150 per hour
...Evaluate security tools for vulnerabilities in GenAI applications.... ...research accelerator for frontier AI labs and a trusted partner for... ...researchers who specialize in coding, reasoning, STEM,... ...looking for experienced security engineers to evaluate how effectively static...SoftwarePart-timeTuring
Remote10 days ago- ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...AI. Role Title: Senior Software Engineer Role Type: Contractor...SoftwarePart-timeRemote
micro1
Remote13 days ago - £62k - £81k per annumEstimated...steps. Our partner is looking for a Product Engineer (AI-Native) based in United Kingdom. Own... ...You’ll work at the forefront of AI-native software development, using AI agents as your primary... ...development partners rather than writing code manually. The role combines senior...SoftwareFull-timeRemote
- ...Required Skills System Design Code Review Debugging Algorithms Data Structures Software Architecture About micro1... ...1 is a data lab that helps AI labs & Enterprises train foundational... ...agents. We provide frontier evaluations and reinforcement learning...SoftwarePart-timeRemote
micro1
Remote3 days ago $140 - $200 per hour
...About the role UK-Based Data Engineering Experts is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should...SoftwareRemoteAuraOne
Remote13 days ago- ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...for frontier AI. Role Title: Software Engineer — Open Source Contributions...SoftwarePart-timeRemote
micro1
Remote14 days ago $65 - $105 per hour
...About the Role We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured...SoftwareHourly payRemoteRemoExperts
Remote13 days ago- ...Engagement type: Contractor, pay per task Payment: $300 per approved task... ...infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent. We are staffing a frontier AI data...SoftwarePart-timeImmediate start
Turing
Remote7 days ago - ...Analyze and improve open-source codebases for AI evaluation projects. About Turing Turing is one of... ...high-quality training data, evaluations, and engineering talent. About the Role We are looking for experienced software engineers with strong technical leadership...Software40 hours/weekPart-time
Turing
Remote13 days ago $50 - $100 per hour
...micro1 is a data lab that helps AI labs & Enterprises train... ...and agents. We provide frontier evaluations and reinforcement learning environments... ...(legal, medical, finance, coding, etc.), where expert-level... ...and velocity. Role Title: Software Engineer (Open Source Contributor...SoftwareLong-term contractPart-timeRemotemicro1
Remote2 days ago- ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ..., interesting and challenging coding tasks for AI to solve involving feature...SoftwarePart-timeRemoteFlexible hours
micro1
Remote14 days ago - ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ...for frontier AI. Full-Stack Software Engineer Location: Global, fully...SoftwarePart-timeImmediate startRemoteFlexible hours
micro1
Remote14 days ago - ...About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute... ...such as finance, healthcare, STEM engineering, and more. micro1 transforms that... ..., interesting and challenging coding tasks for AI to solve involving feature...SoftwarePart-timeRemoteFlexible hours
micro1
Remote10 days ago - ...Build and manage reliable systems for software engineering data programs. About Turing: Based... ...leading research accelerator for frontier AI labs and a trusted partner for global enterprises... ...top AI researchers who specialize in coding, reasoning, STEM, multilinguality,...SoftwareLong-term contractPart-time
Turing
Remote13 days ago $300 per unit
...Design terminal-based engineering tasks for AI training and evaluation. Role Overview: We are staffing a frontier AI initiative that requires strong Engineering experts to develop realistic, terminal-based scientific and technical tasks used to train and evaluate AI agents...Software40 hours/weekPart-timeTuring
Remote7 days ago$300 per unit
...computational workflows for Earth science tasks using diverse datasets.... ...design tasks that require AI agents to inspect scientific... ...Bash, Julia, or domain-specific software. Develop tasks involving... ...to Have: Research software engineering, scientific benchmarking, or automated...Software40 hours/weekPart-timeRemoteTuring
Remote13 days ago- £79k - £103k per annumEstimated...looking for a Senior Automation QA Engineer (Playwright/TypeScript) based... ...a key role in strengthening software quality and reliability across... ...architecture, promote clean code practices, and share expertise... ...performance and identify bottlenecks. - Evaluate performance metrics,...SoftwareFull-timeRemote
- ...Design scientific tasks for AI training in Earth Sciences. About Turing: Turing is one... ...model capabilities in thinking, reasoning, coding, agentic behavior, multimodality,... ...computational tasks for a frontier AI training and evaluation initiative. In this role, you will...Software40 hours/weekPart-timeRemote
Turing
Remote6 days ago - ...Analyze GitHub issues and evaluate LLM performance on real-world code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software...SoftwarePart-timeFreelanceRemote
Turing
Remote13 days ago $60 - $100 per hour
...Hourly, ~20 h/week Field: Other Engineering About the Role Mercor is partnering with a leading AI lab to measure how well frontier... ...realistic, difficult design tasks that expose where AI still falls... ...highly valued. Tasks are built with code-based CAD (build123d, CadQuery,...Hourly payFreelanceImmediate start5 days/weekMercor
Remote10 days ago$40 - $150 per hour
...$40 – $150+ /hour (depends on task difficulty and specialization)... ...The newest models can vibe-code a whole feature in minutes. Someone... ...agentic coding sessions on real engineering tasks, analyze what the models... ...gets on its own. Analyze the AI's work against production standards...SoftwareWeekly payFull-timeRemoteFlexible hoursDataAnnotation
Remote8 days ago$60 per hour
...Pay: up to $60/hour As a PHP Engineer, you will work remotely on an hourly paid basis to review AI-generated PHP code, backend designs, and technical explanations, as well... ...guide AI learning. Optimize AI Performance: Evaluate, rank, and provide feedback on AI responses...SoftwareHourly payImmediate startRemoteSuperAnnotate
Remote10 days ago- ...Our partner is looking for a Senior QA Engineer based in United Kingdom. Join a forward-thinking technology team building AI-powered healthcare software that supports critical clinical... ...security, and performance. Working with AI coding agents and advanced evaluation tools,...SoftwareFull-time
- £104k - £134k per annumEstimated...Principal AI Engineer (AI / . NET Core / React) At Mitratech, we’re a team of engineers passionate... ...driving our adoption of AI across the software development lifecycle. This is a remote-... ...orchestration, retrieval strategy, evaluation, cost and latency management - and translate...SoftwareLong-term contractFull-timeRemote
$60 per hour
...Pay: up to $60/hour As an hourly paid, fully remote JavaScript Engineer for AI Data Training, you will review complex AI-generated code and explanations or generate new ones, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that...SoftwareHourly payImmediate startRemoteSuperAnnotate
Remote10 days ago$55 per hour
...Pay: up to $55/hour As an hourly paid, fully remote Ruby Engineer for AI Data Training, you will review AI-generated Ruby and Rails code or generate your own solutions, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps...SoftwareHourly payImmediate startRemoteSuperAnnotate
Remote10 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to South Asian Software Engineers: Coding Tasks for AI Evaluation. Be the first to apply!
Related searches
- graduate software Remote
- retail software Remote
- graduate account executive travel management software Remote
- software house Remote
- software technical support engineer Remote
- software sales Remote
- sales executive legal software Remote
- software engineer cloud services company Remote
- software product support Remote
- software sales executive Remote