Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - AI Reviewer Expert

$150 per hour
Temporary

Requirements

Must be eligible to work in Remote
Fluent proficiency in English (Written & Verbal)
Reliable high-speed internet connection
Bachelor's degree or equivalent professional experience
Demonstrated expertise in Software Engineering
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between
referral and hire is about
30 days
.
It varies by platform and role, so treat it as a rough guide for this one.
Within 2 weeks
~25%
Within 6 weeks
~60%
Within 3 months
~80%
Why this role
At $150/hr, this Software Engineer - AI Reviewer Expert position compensates Software Engineering expertise on its own terms, the kind of rate that would otherwise only show up inside a law firm, hospital, or research lab.
Skills and categories
Explore other opportunities in related specializations:
Software Engineering
High-Pay ($100+/hr)
No Degree Required
Software Engineering & Coding
Engineering & Robotics
RLHF & AI Evaluation
Expert
Related jobs
AI Engineer (LLMs & Agents) Expert
ethos • Software Engineering
$100
/hr
Data Scientist Expert
ethos • Software Engineering
$100
/hr
Head of AI & Engineering Expert
ethos • Software Engineering
$150
/hr
Senior Machine Learning Engineer / Model Evaluations Expert
ethos • Software Engineering
$125
/hr
Browse All Jobs from Ethos
Discover more opportunities on Ethos that match your skills and interests.
View All Ethos Jobs →
Verified Reviews
Loading reviews…
Community Reviews
Loading reviews…
💬
Share your experience with Ethos
Help other candidates make better decisions by leaving a review.
Sign in to leave a review
Common questions
Is Ethos regular AI training work like rating chatbot responses?
No. Ethos is an expert network, not a task queue. AI labs, investment funds, and Fortune 500s pay to access your specific domain knowledge (deal analysis, clinical reasoning, legal logic, financial modeling) through three formats: multi-week consulting engagements, 30-60 minute advisory calls, and targeted research surveys.
Do I need to keep applying for projects on Ethos?
No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.
Why do these AI training roles pay so much?
Because general knowledge isn't what's being tested. The model already knows the basics; what it needs is expertise on edge cases, the rare, difficult, highly technical judgment calls only a senior professional in the field would make correctly.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
What does Software Engineering work look like for a Software Engineer - AI Reviewer Expert?
Tasks here are scoped to Software Engineering, not generic labeling. As a Software Engineer - AI Reviewer Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $150/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who built Ethos and is it legitimate?
Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.

Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - AI Reviewer Expert in Remote vacancy
  •  ...AfterQuery is seeking Swift/iOS Developer Experts to create and refine mobile development challenges for training AI models. In this remote, flexible role, you will design and evaluate iOS development scenarios that test the AI's ability to interpret and apply complex Swift... 
    Suggested
    Remote
    Flexible hours

    AfterQuery

    Remote
    7 days ago
  • $100 per hour

     ...professional experience Demonstrated expertise in Software Engineering How long hiring takes Across the platforms...  ...60% Within 3 months ~80% Why this role AI labs pay $100/hr for a AI Engineer (LLMs & Agents) Expert because getting Software Engineering nuance... 
    Suggested
    Hourly pay
    Remote

    Ethos

    Remote
    11 days ago
  •  ...Key Responsibilities Train AI models by accurately annotating and labeling data related to drug discovery. Review and validate AI-generated content for accuracy, ensuring it meets industry standards. Provide domain expertise to enhance the performance of AI models... 
    Suggested
    Hourly pay

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models by annotating and labeling data accurately. Review and validate AI-generated content for correctness and relevance...  .... Familiarity with annotation tools and software. Background in linguistics or a related domain.... 
    Suggested

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and enhance AI models through effective data annotation and labeling. Review and validate AI-generated content to ensure accuracy and relevance. Provide domain expertise to improve AI model performance across various projects. Collaborate... 
    Suggested

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models by annotating and labeling data accurately. Review and validate AI-generated content for precision and relevance. Provide domain knowledge to boost AI model performance through iterative feedback. Collaborate on... 
    Hourly pay
    Flexible hours

    Rise Data Labs

    Remote
    18 days ago
  •  ...Cloud engineers to build the infrastructure and automation scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and...  ...few structured questions. Resume review. Every application gets read against... 
    Weekly pay
    Ongoing contract
    Remote

    AfterQuery

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models by annotating and labeling data specific...  ...to organic and inorganic chemistry. Review and validate AI-generated content for...  ...related fields. Experience with AI tools and software for data annotation. Strong analytical... 
    Flexible hours

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and enhance AI models by providing high-quality data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Provide domain expertise to help boost AI model performance in various scientific fields.... 
    Hourly pay

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models through data annotation and labeling. Review and validate AI-generated content for accuracy and consistency...  ...frameworks. Knowledge of data management tools and software. Experience in a lab environment, understanding... 
    Hourly pay

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train AI models by annotating and labeling data in Indonesian. Review and validate AI-generated content for accuracy and relevance. Provide domain expertise to enhance the performance of AI models. Collaborate on diverse AI training projects... 
    Flexible hours

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models through meticulous data annotation and labeling. Review and validate AI-generated content for accuracy, ensuring high standards are met. Provide domain expertise to enhance AI model performance across various projects... 
    Hourly pay

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models through meticulous data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Provide domain expertise to enhance AI model performance in Japanese contexts. Collaborate on various... 
    Hourly pay
    Flexible hours

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models through effective data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Provide domain expertise to enhance AI model performance based on project requirements. Collaborate... 
    Hourly pay

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models through effective data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Provide domain expertise to enhance AI model performance in diverse fields. Work on various AI... 

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train and improve AI models through effective data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Utilize Bash scripting to automate data processing tasks and improve efficiency. Provide domain... 
    Hourly pay
    Flexible hours

    Rise Data Labs

    Remote
    18 days ago
  •  ...Key Responsibilities Train AI models by providing high-quality data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Offer domain expertise to enhance AI model performance across various fields. Collaborate with cross... 
    Flexible hours

    Rise Data Labs

    Remote
    18 days ago
  • $70 per hour

     ...Generalist Document Production Specialist Expert Ethos • Remote Education...  ...application is a 10-minute call. Ethos's AI interviewer asks about your career, then matches...  ...in a QA, editorial, or production role reviewing business documents, spreadsheets ▍ 5... 
    Hourly pay
    Immediate start
    Remote
    Flexible hours

    Ethos

    Remote
    11 days ago
  • $300 per unit

     ...We are seeking Earth Sciences experts to develop realistic, terminal...  ...will design tasks that require AI agents to inspect scientific...  ...Bash, Julia, or domain-specific software. Develop tasks involving...  ...to Have: Research software engineering, scientific benchmarking, or automated... 
    40 hours/week
    Part-time
    Remote

    Turing

    Remote
    18 days ago
  • $300 per unit

     ...terminal tasks to simulate real-world engineering workflows. Role Overview: We are staffing a frontier AI initiative that requires strong Engineering experts to develop realistic, terminal-...  ...Octave, Bash, or relevant engineering software. Build reproducible,... 
    40 hours/week
    Part-time

    Turing

    Remote
    18 days ago
  •  ...Design scientific tasks for AI training in Earth Sciences....  ...seeking experienced Earth Sciences experts to develop realistic, terminal...  ...or domain-specific scientific software . Create automated tests...  ...simulations. Research software engineering experience, including... 
    40 hours/week
    Part-time
    Remote

    Turing

    Remote
    11 days ago
  •  ...micro1 micro1 is the leading AI data lab for training frontier...  ...and evaluating AI agents. Experts contribute their diverse subject...  ...as finance, healthcare, STEM engineering, and more. micro1 transforms that...  ...frontier AI. Full-Stack Software Engineer Location: Global,... 
    Part-time
    Immediate start
    Remote
    Flexible hours

    micro1

    Remote
    19 days ago
  • £81k - £108k per annumEstimated
     ...Senior Software Engineer, Backend (Identity International) Remote UK Apply At Affirm, we exist for...  ...shipping code: raising code quality and review standards, making performance, availability...  ...of your week in the codebase - leveraging AI tools to write robust Kotlin and Python,... 
    Long-term contract
    Full-time
    Remote

    Affirm

    Remote
    a month ago
  •  ...micro1 micro1 is the leading AI data lab for training frontier...  ...and evaluating AI agents. Experts contribute their diverse subject...  ...as finance, healthcare, STEM engineering, and more. micro1 transforms that...  ...testing Solid code review instincts Preferred Qualifications... 
    Part-time
    Remote
    Flexible hours

    micro1

    Remote
    15 days ago
  • £55k - £71k per annumEstimated
     ...At Abnormal AI, we protect our customers against nefarious adversaries who are constantly...  .... About The Role We are looking for a Software Engineer to help build and evolve our platform as...  ...discussions. - Participate in code and design reviews, and contribute to on-call rotations. AI... 
    Full-time

    Abnormalsecurity

    Remote
    a month ago
  • £47k - £61k per annumEstimated
     ...office. These include frontend and backend engineers, AI research scientists, and others from...  ...teams - Product, Design, Engineering Review pull requests, and support other teammates...  ...Candidate Should Have ~5+ years of software engineering experience ~ Familiarity with... 
    Remote job
    On-site
    Night shift

    Speechify

    Remote
    more than 2 months ago
  • $100 per hour

     ...chemical safety professionals to audit how AI models respond to sensitive questions in...  ...toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors...  ..., incident reports or regulatory review is a strong plus. ## Before you apply... 
    Permanent
    Full-time

    SuperAnnotate

    Remote
    15 days ago
  •  ...As a Thai Linguist in our Global AI Community, you evaluate and validate speech AI systems from a linguistic perspective—ensuring machine...  ...and contexts Speech Dataset Validation & Annotation Review voice recordings for linguistic clarity, consistency, and technical... 
    Part-time

    TELUS International

    Remote
    19 days ago
  • $40 - $90 per hour

     ...OpenFOAM, ideally with experience applying the software across different industries and engineering applications. Requirements: Strong hands-on...  ...or Europe Engagement Remote, project-based expert role Supporting AI model training and evaluation for a leading AI... 
    Hourly pay
    Freelance
    Remote

    Braintrust

    Remote
    2 days ago
  •  ...challenging chemistry problems designed to test advanced AI models Write clear, accurate, expert-level solutions for each problem Follow detailed project guidelines and quality standards Revise tasks based on reviewer feedback when needed Who Should Apply Deep, advanced... 
    Remote

    Terac

    Remote
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - AI Reviewer Expert. Be the first to apply!