About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Education / school Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents , spreadsheets , and slide decks .
- Provide clear, structured written feedback to enhance AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Education / school .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,...SuggestedRemote jobSummer work$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobSummer work$80 - $120 per hour
...Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobSummer work$80 - $120 per hour
.... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobSummer work$80 - $120 per hour
...Position: Pricing / ROI / revenue economics Evaluator Type: Contract... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... .... Collaborate with subject matter experts to ensure consistency and domain relevance...SuggestedRemote jobSummer work$80 - $120 per hour
...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobSummer work$80 per hour
..., and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $55–$80/hour... ...quality data by developing difficult problems in your domain. Evaluate and improve AI model performance through rigorous testing...Remote jobSummer work$80 - $120 per hour
...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobSummer work- £76k - £100k per annumEstimated...000 employees specializing in engineering and IT services. Domain Expert Role Overview Location: UK-based, hybrid working Regular... ...assurance cases, evidence requirements, model/system evaluation, testing, validation, monitoring, escalation and post-deployment...Full-timeHybrid working
$60 - $70 per hour
...hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy... ...persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains. Apply and refine evaluation rubrics for RLHF , SFT ,...Remote jobSummer work$23 - $54 per hour
...Dorsey . Position: Music & Lyrics Expert - English (US/UK/Australia) Type:... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres and... ...the application steps, including the Domain Expert Interview Receive next steps and...Remote jobSummer workImmediate start$39 per hour
...Jack Dorsey . Position: Music Audio Expert - Swedish Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...expertise in writing music in the specified domain language. Qualifications Must-Have...Remote jobSummer workImmediate start$85 per hour
...Location: Remote Role Responsibilities Evaluate the accuracy of AI-generated content in your field to ensure... ..., including tasks, files, and scoresheets, to provide expert judgment. Assess domain content for accuracy, consistency, and compliance with standards...Remote jobSummer work$40 - $70 per hour
...Dorsey . Position: Generalist Search Expert Type: Contract... ...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content... ...Review complex content for alignment with domain principles and methodologies. Provide...Remote jobSummer work$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobSummer work$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobSummer work$150 - $220 per hour
...Summers , and Jack Dorsey . Position: Investment Banking Expert Type: Contract Compensation: $150–$220/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobSummer work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications Must...Remote jobSummer work- £72k - £95k per annumEstimated...early 2022. Alten is a global engineering firm with approximately 57,000 employees specializing in engineering and IT services. Domain Expert Role Overview Location: UK-based, hybrid working Regular travel may be required to client sites, Methods offices and...Full-timeHybrid workingOn-site
$120 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role...Remote jobSummer work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobSummer work$17 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Greek Type: Contract Compensation: $17–$42/... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobSummer workImmediate start$20 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/...Remote jobSummer work- £66k - £86k per annumEstimated...0 employees specializing in engineering and IT services. Domain Expert Role Overview Location: UK-based, hybrid working Regular... ...government, local government, health, justice, policing, education or defence. ~ Energy, utilities, critical national infrastructure...Full-timeHybrid working
$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobSummer work$20 - $36 per hour
...Summers , and Jack Dorsey . Position: Music Production Expert - Hungarian Type: Contract Compensation: $20–... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality, creativity, prompt...Remote jobSummer workImmediate start- £50k - £66k per annumEstimated...tasks and deliverables for common requests within your professional domain. Diagnose and solve real issues in the Medical and Health... ...Task-based payment upon first task approval. Qualified experts paid hourly for the remainder of the project. Application Process...Remote jobHourly paySummer workImmediate start
- £46k - £61k per annumEstimated...deliverables regarding common requests within the Real Estate domain. Diagnose and solve real issues in Real Estate to advance... ...Legal Task-based payment upon first task approval. Experts qualify for hourly payment after first task completion. Application...Remote jobHourly paySummer workImmediate startFlexible hours
$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation... ...~ Experience writing lyrical music in the domain language. Preferred ~...Remote jobSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Education Evaluator - Domain Expert. Be the first to apply!
- content expert London
- database expert London
- fulfillment expert London
- medical device product expert / product specialist / regulatory auditor London
- google analytics expert London
- expert London
- legal expert London
- demolition expert London
- information analyst at health education england London
- museum education London

