About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Process improvement / SOPs Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Collaborate asynchronously with teams to ensure high-quality deliverables.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Process improvement / SOPs .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...Training / onboarding / L&D Evaluator Type: Contract... ...Collaborate with subject matter experts to ensure consistency and quality... ...asynchronously to meet deadlines and improve AI model performance .... .... Application Process (Takes 20–30 mins to complete)...SuggestedRemote jobSummer work$80 - $120 per hour
...Dorsey . Position: Legal / compliance Evaluator Type: Contract... ...asynchronously to meet deadlines while improving AI model performance . Qualifications... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...SuggestedRemote jobSummer work$80 - $150 per hour
...Dorsey . Position: Design Expert Type: Contract... ...independently to meet deadlines and improve AI model performance . Qualifications... ...experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete)...SuggestedRemote jobSummer work$80 - $120 per hour
...Position: Procurement / vendor management Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI-generated work products. Apply deep... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...SuggestedRemote jobSummer work$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance . Qualifications... ...human-data projects. Application Process (Takes 20–30 mins to complete) Submit...SuggestedRemote jobSummer work$80 - $120 per hour
...Position: Biology / environmental science Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI model outputs. Collaborate with AI... ...reputable institution. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work$50 per hour
...Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract... ...fluency. Provide structured feedback to improve AI model performance in Spanish audio... ...research environments. Application Process (Takes 20–30 mins to complete) Complete...Remote jobSummer work$80 - $120 per hour
...Pricing / ROI / revenue economics Evaluator Type: Contract... ...Collaborate with subject matter experts to ensure consistency and... ...asynchronously to meet deadlines and improve output quality.... ...institution. Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$150 - $220 per hour
...Position: Investment Banking Expert Type: Contract... ...asynchronously to meet deadlines while improving AI model performance .... ...valuation judgment, and deal-process materials. ~... ...experience with AI training , evaluation, or human-data projects....Remote jobSummer work$39 per hour
.... Position: Music Audio Expert - Swedish Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics ,... ...of musical training data to improve model performance. Collaborate... ...Immediate Application Process (Takes 20–30 mins to complete)...Remote jobSummer workImmediate start- ...Enterprise client is seeking a high volume of English-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio...
$100 - $150 per hour
...Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $10... ...~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your resume...Remote jobSummer work- £50k - £66k per annumEstimated...strategic HR Subject Matter Expert with deep UK Benefits expertise... ..., and supplier market evaluation, while also supporting broader... ...negotiations, and supplier selection processes. Drive sourcing... ...for transformation, process improvement, and value creation. Champion...Full-timeFlexible hours
$13 per hour
.... Position: Music Audio Expert - Hindi Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics ,... ...asynchronously to meet deadlines and improve AI model performance .... ...Immediate Application Process (Takes 20–30 mins to complete)...Remote jobSummer workImmediate start$55 - $80 per hour
...: Automated CS Planning PhDs & Domain Experts — Zion (Arches) Type: Contract... ...complex problems in your domain. Evaluate and improve AI model performance through rigorous... ...communication skills . Interview Process Complete a short interview and...Remote jobSummer work$70 - $84 per hour
...hallucinations, and policy failures. Evaluate model robustness across misinformation,... ...Collaborate with AI researchers to improve model alignment, robustness, and safety.... ..., or scientific safety. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work- £58k - £75k per annumEstimated...Logistics & Supply Chain Management Expert Role Type: Contract Location... ...and supply chain management. Evaluate and suggest improvements in current supply chain workflows based... ...focusing on document structures and process optimization. Collaborate with project...Remote job
$145 per hour
...Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications... ...Role Responsibilities Evaluate the accuracy and depth of AI-... ...to AI research teams to improve training data quality and downstream... ...details about the interview process and platform information,...Remote jobSummer work$65 per hour
...Position: Private Banking Expert Type: Contract... ...Role Responsibilities Evaluate the performance of AI systems... ...environments. Test and improve AI models to enhance accuracy... ...using Nubank . Application Process (Takes 20–30 mins to complete)...Remote jobSummer work- £70k - £94k per annumEstimated...your career and collaborate with expert, talented colleagues to solve... ...knowledge of supply chain processes, including demand planning, inventory... ...life cycle. Experience in evaluating existing supply chain processes and identify areas for improvement using SAP IBP or Kinaxis....Full-timeShift work
$70 - $180 per hour
...Role Responsibilities Solve and evaluate challenging physics problems across various... ...with AI research teams to improve AI systems' reasoning capabilities .... ...to begin immediately Application Process (Takes 20–30 mins to complete) Submit...Remote jobSummer workImmediate start- £76k - £100k per annumEstimated...engineering and IT services. Domain Expert Role Overview Location:... ..., employees, regulated processes, safety-critical decisions,... ...evidence requirements, model/system evaluation, testing, validation,... ...deployment, reducing risk exposure, improving transparency, securing...Full-timeHybrid working
$70 - $90 per hour
.... Position: Physics PhD Experts (General Relativity, Astrophysics... ..., and Cosmology . Evaluate and refine AI model training... ...Provide structured feedback to improve AI model outputs . Qualifications... ...basis. Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$60 - $75 per hour
...Position: Software & Data Science Expert Type: Contract... ...technical documentation. Evaluate AI ability to follow precise... ...asynchronously to meet deadlines and improve AI model performance .... .... Application Process (Takes 20–30 mins to complete)...Remote jobSummer work$35.2 per hour
...languages, writing, and quality evaluation? We are launching an exciting... ...looking for Dutch-speaking experts to join our team. In this... ...prompts and responses in Dutch to improve conversational datasets. -... ...tools during the recruitment process — our security system requires...Part-timeFreelanceImmediate startRemoteFlexible hours$100 - $150 per hour
...Dorsey . Position: Legal Expert Type: Contract... ...Role Responsibilities Evaluate two AI-generated responses for... ...feedback to the research team to improve model behavior .... ...contractor Application Process (Takes 20–30 mins to complete)...Remote jobHourly paySummer workOn-siteImmediate start$50 - $70 per hour
...Dorsey . Position: Shopify Expert Type: Contract... ...Role Responsibilities Evaluate and optimize Shopify store... ...Provide ongoing support and improvements for existing Shopify setups... ...agent . Application Process (Takes 20–30 mins to complete...Remote jobSummer work$80 - $150 per hour
...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated... ...systems related to agentic search for improved performance and reliability. Scale... ...infrastructure for search systems. Interview Process ~25 mins conversational interview...Remote jobSummer work- £32k - £42k per annumEstimated...integration for connecting all your enterprise processes Agent & Application development for... ...What you'll do: The Solution Sales Expert (SSE) partners with the end-to-end account... ...Skills Agile Methodology Process Improvement Software as a Service (SaaS) Cyber Security...Long-term contractPermanentFull-timeHybrid workingOn-siteFlexible hours
$48 - $62 per hour
...Jack Dorsey . Position: AI Safety Experts — English & Danish Type: Contract... ...asynchronously to meet deadlines while improving AI model performance .... ...unconventional adversarial thinking. Application Process (Takes 20–30 mins to complete) Upload...Remote jobSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Process Improvement Expert - Evaluator. Be the first to apply!

