About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve quality.
- Work independently and asynchronously to meet deadlines.
- Utilize expertise in Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Data Evaluator - Fully Remote | Upto $120/hr in London vacancy
$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobDataSummer workMercor
London22 days ago$120 per hour
...Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to enhance training data quality. Work independently to meet deadlines...Remote jobDataSummer workMercor
London24 days ago$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...interactions and stale patient data driving incorrect doses; update based... ...Prior data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataSummer workMercor
London15 days ago$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...missed interactions, stale patient data, and monograph guidance superseded by... ...data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataSummer workMercor
Londona month ago$120 per hour
...Contract Compensation: $100–$120/hour Location: Remote Role Responsibilities... .... Optimize models with limited data, compute, and model-size budgets.... ...data ordering. Skills in model evaluation , uncertainty estimation , and model...Remote jobDataSummer workMercor
London24 days ago$120 per hour
...Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to improve training data quality and performance. Qualifications...Remote jobDataSummer workMercor
London25 days ago$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobSummer workMercor
London3 days ago$120 per hour
...Summers , and Jack Dorsey . Position: Investment analysis / valuation / credit Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobSummer workMercor
London29 days ago$17 per hour
...Compensation: $17/hour Location: Remote Duration: Up to 6 months... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...Score the quality of musical training data to ensure high standards. Collaborate...Remote jobDataSummer workImmediate startMercor
London27 days ago$120 per hour
...Statistical Bioinformatics Expert (PhD) Type: Contract Compensation: $120/hour Location: Remote Role Responsibilities Complete realistic, multi-step scientific data-analysis tasks in computational genomics , quantitative biology , and...Remote jobDataSummer workMercor
London21 days ago$170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...Prior experience with AI training , evaluation, or human-data projects....Remote jobDataSummer workMercor
Londona month ago$170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...Prior experience with AI training , evaluation, or human-data projects....Remote jobDataSummer workMercor
London15 days ago$120 per hour
...International (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal content in disputes and international law to determine...Remote jobSummer workMercor
London10 days ago$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobSummer workMercor
London29 days ago$120 per hour
...Restructuring (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~18 hours Role Responsibilities Evaluate AI-generated legal content in restructuring and insolvency to enhance accuracy...Remote jobHourly paySummer workMercor
London10 days ago$120 per hour
...Survey Research & Consumer Insights Expert Type: Contract Compensation: $120/hour Location: Remote Role Responsibilities Review and evaluate surveys for methodological quality, clarity, and fitness for purpose. Assess survey questions...Remote jobSummer workMercor
London9 days ago$120 per hour
...Capital Markets (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review and...Remote jobSummer workMercor
London9 days ago$120 per hour
...Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobSummer workMercor
London29 days ago$120 per hour
...Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobSummer workMercor
London6 days ago$120 per hour
...Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobSummer workMercor
London2 days ago$120 per hour
...Environmental (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~13 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review six...Remote jobSummer workMercor
London10 days ago$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobSummer workMercor
London22 days ago$120 per hour
...Real Estate (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~30 hours Role Responsibilities Evaluate AI-generated legal content in finance and real estate to ensure accuracy and relevance...Remote jobSummer workMercor
London10 days ago$150 per hour
...Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities Review and... ...Excel and Google Slides for comprehensive data analysis and presentation. Collaborate...Remote jobDataSummer workMercor
London14 days ago$50 per hour
...Compensation: $20–$50/hour Location: Remote Role Responsibilities Review... ...quality processes, checklists, and evaluation criteria. Collaborate asynchronously... .... Preferred Familiarity with data annotation, content review, or evaluation...Remote jobDataSummer workMercor
London22 hours ago$25 per hour
..., and Jack Dorsey . Position: AI Data Generalist — Egocentric Video Review... ...Compensation: $20–$25/hour Location: Remote Duration: Approximately 2 weeks... ...complete structured quality-review tasks. Evaluate action segments within videos for accurate...Remote jobDataSummer workDay shiftMercor
London25 days ago$100 per hour
...Compensation: $60–$100/hour Location: Remote Role Responsibilities Design... .... Review AI agent attempts and evaluate them against your standards. Diagnose issues from messy or conflicting data, prioritize, make tradeoffs, plan, execute,...Remote jobDataSummer workMercor
London15 days ago$100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week... ...and select the stronger one. Evaluate both the content and rendering of each document... ...Excel/Spreadsheets —financial modeling, data analysis, pivot tables, complex formulas,...Remote jobDataSummer workOn-siteImmediate startMercor
London27 days ago$80 per hour
...Compensation: $55–$80/hour Location: Remote Role Responsibilities Contribute subject... ...large language models . Create high-quality data by developing difficult problems in your domain. Evaluate and improve AI model performance through...Remote jobDataSummer workMercor
Londona month ago$70 per hour
...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and... ...structured written feedback to improve training data quality and downstream performance. Develop clear...Remote jobDataSummer workMercor
London21 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
