Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

SWE-Bench AI Task Auditor - Freelance AI Trainer Project

$60 per hour
Part-time

Job Application for SWE-Bench AI Task Auditor - Freelance AI Trainer Project at Meridial
Back to jobs
SWE-Bench AI Task Auditor - Freelance AI Trainer Project
World Wide - Remote
Project Overview
We are sourcing experienced technical specialists in Software Engineering (SWE-Bench) to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.
Project Deliverables & Scope
Task Evaluation:
Assess whether software engineering tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
Technical Auditing & Feedback:
Provide clear, actionable feedback on any identified codebase integration issues, test failures, or logic errors within the tasks.
Required Expertise
Demonstrable professional experience and deep technical knowledge in software engineering (including complex codebase navigation, real-world application development, and SWE-Bench standards).
(Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).
Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.
We offer a pay rate of $60 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Employment type:
Freelance Contract
Workplace type:
Remote
Apply for this job
*
indicates a required field
First Name
*
Last Name
*
Email
*
Phone
Country
*
Phone
*
Location (City)
*
Locate me
Resume/CV
*
Attach
Attach
Dropbox
Google Drive
Enter manually
Enter manually
Accepted file types: pdf, doc, docx, txt, rtf
Education
School
Select...
Degree
*
Select...
Discipline
*
Select...
Start date year
*
End date year
*
Add another
What country are you currently a resident of?
*
Select...
If you are currently based in United States, please confirm your current state of residence. If you are based outside of the United States, select "I am not located in the United States".
*
Select...
LinkedIn Profile
*
Please acknowledge that you have read and agree to our Privacy Policy.
*
Yes
By clicking "Submit Application", you agree to Invisible's
Privacy Policy
.
Submit application
Powered by
Greenhouse

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the SWE-Bench AI Task Auditor - Freelance AI Trainer Project in Remote vacancy
  •  ...Build and validate data pipelines for AI performance evaluation projects. About Turing Based in San Francisco, California, Turing is the world...  ...Overview We are looking for experienced Software Engineers (SWE Bench – Data Engineer / Data Science) to contribute to... 
    Freelance
    Project
    Part-time
    Remote

    Turing

    Remote
    a month ago
  • $80 - $150 per hour

     ...Job Application for SWE Infrastructure Specialist (Java) – Freelance AI Trainer Project at Meridial Back to jobs SWE Infrastructure Specialist (Java) – Freelance AI Trainer Project World Wide - Remote Are you a Java-focused software engineer with strong infrastructure... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $25 per hour

     ...of the world’s fastest-growing AI companies accelerating the...  ...repositories and can contribute to this project. This role involves hands-on...  ...agents. Perks of Freelancing With Turing: Work in a fully...  ...Payment : $25 per approved task Location : India, Pakistan... 
    Freelance
    Project
    40 hours/week
    Remote

    Turing

    Remote
    5 days ago
  • $25 per hour

     ...GitHub issues for open-source Java projects. About Turing Turing is...  ..., working with frontier AI labs to accelerate model development...  ...agents. Perks of Freelancing With Turing: Work in a fully...  ...Payment : $25 per approved task Location : LATAM Evaluation... 
    Freelance
    Project
    40 hours/week
    Remote

    Turing

    Remote
    5 days ago
  •  ...research accelerator for frontier AI labs and a trusted partner for global...  ...experienced Data Analysts (MLE Bench) to contribute to benchmark-driven evaluation projects focused on real-world machine...  ...edge cases relevant to benchmark tasks. Write and run Python and SQL... 
    Freelance
    Project
    Part-time
    Remote

    Turing

    Remote
    a month ago
  •  ...Job Application for Language Alignment & Resource Partner (Icelandic) - Freelance AI Trainer Project at Meridial Back to jobs Language Alignment & Resource Partner (Icelandic) - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  •  ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation... 
    Freelance
    Project
    Part-time
    Remote
    Flexible hours

    Mindrift (Toloka)

    Remote
    2 days ago
  •  ...Job Application for Welsh Audio Specialist - Freelance AI Trainer Project at Meridial Back to jobs Welsh Audio Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $8 - $30 per hour

     ...Job Application for LaTeX Specialist - Freelance AI Trainer Project at Meridial Back to jobs LaTeX Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent LaTeX Specialists to provide their expertise for an AI... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  •  ...Job Application for Religion Specialist – Freelance AI Trainer Project at Meridial Back to jobs Religion Specialist – Freelance AI Trainer Project World Wide - Remote Are you knowledgeable about religion or religious studies and eager to shape the future of AI?... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $30 per hour

     ...hour ## About SME Careers As AI systems become more...  ...design realistic, challenging CAD tasks, then record yourself completing...  ...the model produced. - Work to project quality standards: Keep recordings...  ...contract, studio, in-house, or freelance). - Genuine FreeCAD proficiency... 
    Freelance
    Project
    Hourly pay
    Full-time
    Remote
    Flexible hours

    SuperAnnotate

    Remote
    a month ago
  • $35 per hour

     ...~60% Within 3 months ~80% Why this role This Freelance English Writer – AI Trainer role runs entirely remote at $35/hr, so your location stops...  ...experts? Within 30 days of invoice submission after a project closes. That net-30 schedule is standard for enterprise... 
    Freelance
    Project
    Hourly pay
    Remote

    Ethos

    Remote
    a month ago
  •  ...Job Application for Investment Specialist – Freelance AI Trainer Project at Meridial Back to jobs Investment Specialist – Freelance AI Trainer Project World Wide - Remote Are you knowledgeable about investments and eager to shape the future of AI? Large-scale language... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $75 per hour

     ...Engineering specialists what the leading AI labs pay for direct judgment. At $75/hr,...  ...Mechanical Engineer & Python Expert – Freelance AI Trainer role prices in the expertise itself,...  ...Within 30 days of invoice submission after a project closes. That net-30 schedule is standard... 
    Freelance
    Project
    Hourly pay
    Remote

    Ethos

    Remote
    a month ago
  •  ...and Audio Quality. Follow project-specific guidelines to ensure...  ...client platform to complete your tasks. Preferably, meet a daily...  ..., preferably. Must be a freelancer (we are not engaging with companies...  ...use artificial intelligence (AI) tools to support parts of the... 
    Freelance
    Project
    Temporary
    Part-time
    Immediate start
    Remote

    RWS

    Remote
    2 days ago
  •  ...evaluating, benchmarking, or improving AI systems. Strong practical...  ..., systems, or technical projects Technical publications, benchmarks...  ...creating AI-training tasks, reference solutions, tests, graders...  ...Experience reviewing other AI trainers’ technical submissions. Codeforces... 
    Project
    Part-time
    Immediate start

    micro1

    Remote
    6 days ago
  •  ...Job Application for Arabic (Emirati) Language Specialist - Freelance AI Trainer Project at Meridial Back to jobs Arabic (Emirati) Language Specialist - Freelance AI Trainer Project World Wide - Remote Are you an Arabic (Emirati) language expert eager to shape the... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $8 - $65 per hour

     ...Job Application for Arabic (Levantine) Language Specialist - Freelance AI Trainer Project at Meridial Back to jobs Arabic (Levantine) Language Specialist - Freelance AI Trainer Project World Wide - Remote Are you an Arabic (Levantine) language specialist eager to... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  •  ...Job Application for Tutoring Specialist - Freelance AI Trainer Project at Meridial Back to jobs Tutoring Specialist - Freelance AI Trainer Project World Wide - Remote Are you an experienced instructional professional with hands-on knowledge of pedagogy, complex... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $35 per hour

     ...Job Application for Kotlin Coding Specialist - Freelance AI Trainer Project at Meridial Back to jobs Kotlin Coding Specialist - Freelance AI Trainer Project World Wide - Remote Are you a Kotlin expert eager to shape the future of AI? Large-scale language models... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  • $15 - $30 per hour

     ...Job Application for Audio Editor for Dialogue / Audio Post-Production - Freelance AI Trainer Project at Meridial Back to jobs Audio Editor for Dialogue / Audio Post-Production - Freelance AI Trainer Project World Wide - Remote Audio Editor for Dialogue / Audio Post... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  •  ...remote Dutch-speaking annotators to evaluate AI-generated content with a sharp eye for...  ...Wij zijn op zoek naar Nederlandstalige freelance beoordelaars die AI-gegenereerde content kunnen...  ...data-annotatie • Beschikbaarheid voor een kortlopend project met start op korte termijn... 
    Freelance
    Project
    Temporary
    Immediate start
    Remote

    Rise Data Labs

    Remote
    a month ago
  • $22 per hour

     ...Job Application for 3D Modeling & Python Specialist - Freelance AI Trainer Project at Meridial Back to jobs 3D Modeling & Python Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent 3D Modeling and Python Specialists... 
    Freelance
    Project
    Hourly pay
    Part-time
    Remote

    Invisible Technologies

    Remote
    a month ago
  •  ...engineering data programs for frontier AI model production. About...  ...We are looking for a Strategic Project Lead with direct experience...  ...data, RLHF or preference data, SWE benchmarks, model evaluations,...  ...timelines. Review code, tests, task metadata, and final artifacts... 
    Freelance
    Project
    Part-time
    Remote
    Flexible hours

    Turing

    Remote
    a month ago
  •  ...About Verita AI Verita AI is a seed-stage company backed by Kindred...  ...realistic software engineering tasks in the Harbor framework and...  ...experience with real, shipped projects Comfort with Docker, the command...  ...with Harbor, Terminal-Bench or similar agent benchmarks... 
    Freelance
    Project
    Weekly pay
    Immediate start
    Remote
    Flexible hours

    Verita AI

    Remote
    3 days ago
  •  ...Evaluation & Repository Validation About the projects: we are building LLM evaluation and...  ..., in this project, is to build verifiable SWE tasks based on public repository histories in a...  ...is one of the world’s fastest-growing AI companies accelerating the advancement and... 
    Freelance
    Project
    Part-time
    Remote

    Turing

    Remote
    a month ago
  •  ...of the world’s fastest-growing AI companies, accelerating the...  ...in a multi-speaker diarization project, engaging in natural, unscripted...  ...speech sample, or one-person task. Key responsibilities...  ...as contribution. Perks of Freelancing With Turing: Work in a fully... 
    Freelance
    Project
    Full-time
    Part-time
    Remote
    Flexible hours

    Turing

    Remote
    a month ago
  •  ...Activities Participate in a 1-hour AI research interview focused on...  ...Duration High-demand fast project — single 1-hour interview setup...  ...AI models. You'll work on tasks like evaluating code, testing AI...  ...better at programming. This is freelance work with flexible hours, so you... 
    Freelance
    Project
    Flexible hours

    Revelo

    Remote
    5 days ago
  •  ...Lead large-scale AI annotation projects while managing clients and teams. About Turing: Turing...  ...evaluation is preferred. Perks of Freelancing With Turing: Work at the forefront...  ...involving a defined number of evaluation tasks. # Each task will involve comparing... 
    Freelance
    Project
    Part-time
    Remote
    5 days/week
    Flexible hours
    Weekday work

    Turing

    Remote
    16 days ago
  •  ...care knowledge directly ensures AI medical responses are safe,...  ...New to LLM Training?These are projects where you use your technical expertise...  ...AI models. You'll work on tasks like evaluating code, testing...  ...at programming. This is freelance work with flexible hours, so you... 
    Freelance
    Project
    Flexible hours

    Revelo

    Remote
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SWE-Bench AI Task Auditor - Freelance AI Trainer Project. Be the first to apply!