About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Process improvement / SOPs Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Collaborate asynchronously with teams to ensure high-quality deliverables.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Process improvement / SOPs .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobSummer work$80 - $120 per hour
...Position: Biology / environmental science Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI model outputs . Review and assess... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...SuggestedRemote jobSummer work$80 - $120 per hour
...Position: Humanities / arts / culture Evaluator Type: Contract Compensation... ...clear, structured written feedback to improve AI model outputs . Apply deep subject... ...institution. Application Process (Takes 20–30 mins to complete) Upload...SuggestedRemote jobSummer work$80 - $120 per hour
...Position: Real estate / hospitality / events Evaluator Type: Contract... ...asynchronously to meet deadlines while improving AI model performance . Qualifications... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...SuggestedRemote jobSummer work$80 - $120 per hour
...customer research and feedback synthesis Evaluator Type: Contract Compensation... ...asynchronously to meet deadlines while improving AI model performance . Utilize... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...SuggestedRemote jobSummer work$80 - $150 per hour
...Dorsey . Position: Design Expert Type: Contract... ...independently to meet deadlines and improve AI model performance . Qualifications... ...experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$80 - $120 per hour
...: BI dashboards / performance reporting Evaluator Type: Contract Compensation... ...clear, structured written feedback to improve AI model outputs. Apply deep subject... ...reputable institution. Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$80 - $150 per hour
...Position: UI / UX Design Expert Type: Contract... ...asynchronously to meet deadlines and improve AI model performance . Qualifications... ...experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$50 per hour
...English Language and Literature Expert Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ...language gaps, providing feedback to improve LLM performance .... ...technologies . Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$80 - $120 per hour
.... Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation... ...clear, structured written feedback to improve AI outputs. Apply deep subject-matter... ...institution. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance . Qualifications... ...human-data projects. Application Process (Takes 20–30 mins to complete) Submit...Remote jobSummer work$150 - $220 per hour
...Position: Investment Banking Expert Type: Contract... ...asynchronously to meet deadlines while improving AI model performance .... ...valuation judgment, and deal-process materials. ~... ...experience with AI training , evaluation, or human-data projects....Remote jobSummer work$50 - $70 per hour
.... Position: Generalist Expert (UK/Europe) Type: Contract... ...Review and evaluate documents, slides, spreadsheets... ...written feedback and ratings to improve AI model outputs . Compare... ...slides, sheets) Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$14 - $42 per hour
...Position: Music & Lyrics Expert - Urdu Type: Contract... ...Role Responsibilities Evaluate AI-generated music across various... ...asynchronously to meet deadlines while improving AI model performance .... ...Immediate Application Process (Takes 20–30 mins to complete)...Remote jobSummer workImmediate start$80 - $120 per hour
...Legal contracts / diligence / redlines Evaluator Type: Contract Compensation... ...asynchronously to meet deadlines while improving AI model performance . Qualifications... ...institution. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work$19 per hour
...Position: Music & Lyrics Expert - Bengali Type: Contract... ...adherence, and originality. Evaluate whether lyrics sound natural,... ...to meet deadlines while improving AI model performance .... ...Immediate Application Process (Takes 20–30 mins to complete)...Remote jobSummer workImmediate start$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/... ...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years of...Remote jobSummer work$60 - $70 per hour
...Remote Role Responsibilities Evaluate AI-generated responses for safety, factual... .... Provide structured feedback to improve model alignment and safety performance.... ..., or ambiguous content. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work$39 per hour
.... Position: Music Audio Expert - Swedish Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics ,... ...of musical training data to improve model performance. Collaborate... ...Immediate Application Process (Takes 20–30 mins to complete)...Remote jobSummer workImmediate start$20 - $36 per hour
...Position: Music Production Expert - Hungarian Type: Contract... ...Role Responsibilities Evaluate AI-generated music across... ...asynchronously to meet deadlines while improving AI model performance .... ...Immediate Application Process (Takes 20–30 mins to complete)...Remote jobSummer workImmediate start$70 per hour
.... Position: Mathematics PhD Coding Experts Type: Contract Compensation... ...asynchronously to meet deadlines while improving AI model performance .... ...Date ~ Immediate Interview Process Upload your resume and application...Remote jobSummer workImmediate start$20 per hour
..., Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$... ...years of experience in teaching or research. Application Process (Takes 20–30 mins to complete) Complete an AI-led interview...Remote jobSummer work$70 per hour
.... Position: Mathematics PhD Coding Experts Type: Contract Compensation... ...asynchronously to meet deadlines while improving AI model performance .... ...Date ~ Immediate Interview Process Upload your resume and application...Remote jobSummer workImmediate start$100 - $150 per hour
...Jack Dorsey . Position: Sales Engineering Expert Type: Contract Compensation: $10... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your...Remote jobSummer work$100 per hour
...Position: Office-Suite Experts Type: Contract... ...select the stronger one. Evaluate both the content and rendering... ...feedback to the research team to improve model behavior. Participate... ...rolling basis. Application Process (Takes 20–30 mins to complete)...Remote jobSummer workOn-siteImmediate start$70 - $84 per hour
...hallucinations, and policy failures. Evaluate model robustness across misinformation,... ...Collaborate with AI researchers to improve model alignment, robustness, and safety.... ..., or scientific safety. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work$70 - $100 per hour
...Chemistry & Electronic Structure Expert Type: Contract... ...challenging computational problems to evaluate AI systems using real... ...independently to design and improve problem setups and solution validators... .... Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$140 per hour
...Survey Research & Pharma Insights Expert Type: Contract... ...methodologically sound questionnaires. Evaluate screeners, eligibility... ...recommendations for survey improvements. Work independently and... ...both sides of the review process with expertise in healthcare...Remote jobSummer work$55 per hour
...Role Responsibilities Evaluate the accuracy and depth of AI-... ...feedback to AI research teams to improve training data quality and... ...with subject matter experts to ensure consistency, relevance... ...Analysis . Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$65 - $75 per hour
...Nuclear Engineering & Safeguards Experts for Red Team Type:... ...dual-use, and adversarial. Evaluate AI model responses against a defined... ...with flexible hours to improve AI model evaluation.... ...Analysis . Application Process (Takes 20–30 mins to complete)...Remote jobSummer workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Process Improvement Expert - Evaluator. Be the first to apply!

