Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

User Research Expert - Evaluator

$80 - $120 per hour
London
  • Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: User/customer research and feedback synthesis Evaluator

Type: Contract

Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
  • Provide clear, structured written feedback to improve AI model outputs .
  • Work independently and asynchronously to meet deadlines and enhance AI model performance .
  • Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in User/customer research and feedback synthesis .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in London vacancy
  • $80 - $120 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–... 
    Suggested
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $60 - $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:...  ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your... 
    Suggested
    Remote job
    Summer work

    Mercor

    London
    11 days ago
  • $60 - $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:...  ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your... 
    Suggested
    Remote job
    Summer work

    Mercor

    London
    9 days ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour... 
    Suggested
    Remote job
    Summer work

    Mercor

    London
    15 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Position: Humanities / arts / culture Evaluator Type: Contract...  .... Collaborate with subject matter experts to ensure consistency and quality.... 
    Suggested
    Remote job
    Summer work

    Mercor

    London
    5 days ago
  • $150 per hour

     ...based in United Kingdom. Pay: $150–$350/hr Role Title: Research & Insights Expert - PowerPoint Review & Reconstruction Role Type:...  ...over consulting-firm pedigree. # Experience in AI training, evaluation, or rubric development is a plus, but not required.... 
    Remote job
    Flexible hours

    RemoteJobsOne

    London
    2 days ago
  • $50 - $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract...  ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour... 
    Remote job
    Summer work

    Mercor

    London
    29 days ago
  • $175 per hour

     ...United Kingdom. Pay: $175–$300/hr Role Title: Equity research Expert Role Type: Contractor Location: Remote We are engaging...  ...for AI training purposes. # Deliver detailed written evaluations of company models, including revenue, margin, cash flow, and... 
    Remote job

    RemoteJobsOne

    London
    2 days ago
  • $145 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  .... Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications)...  ...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Dorsey . Position: UI / UX Design Expert Type: Contract...  ...Work independently and asynchronously to evaluate and improve AI model performance .... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $150 - $220 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  .... Position: Investment Banking Expert Type: Contract...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Dorsey . Position: UI / UX Design Expert Type: Contract...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Summer work

    Mercor

    London
    28 days ago
  • $50 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...: English Language and Literature Expert Type: Contract Compensation...  ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... 
    Remote job
    Summer work

    Mercor

    London
    15 days ago
  • $20 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ..., Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–... 
    Remote job
    Summer work

    Mercor

    London
    19 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Jack Dorsey . Position: B2B Sales Expert Type: Contract...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  .... Position: Software Engineer Expert Type: Contract Compensation...  ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... 
    Remote job
    Summer work

    Mercor

    London
    2 days ago
  • $17 - $42 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Dorsey . Position: Music & Lyrics Expert - Greek Type: Contract...  ...prompt adherence, and originality. Evaluate whether lyrics sound natural, including word... 
    Remote job
    Summer work
    Immediate start

    Mercor

    London
    a month ago
  • $80 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Jack Dorsey . Position: Design Expert Type: Contract...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...: Survey Research & Consumer Insights Expert Type: Contract...  ...Role Responsibilities Review and evaluate surveys for methodological quality, clarity... 
    Remote job
    Summer work

    Mercor

    London
    19 days ago
  • $14 - $42 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract...  ...hours/week Role Responsibilities Evaluate AI-generated music across various genres... 
    Remote job
    Summer work
    Immediate start

    Mercor

    London
    a month ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Jack Dorsey . Position: B2B Sales Expert Type: Contract...  ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $60 - $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy... 
    Remote job
    Summer work

    Mercor

    London
    a month ago
  • $75 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark...  ...Preferred ~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins to... 
    Remote job
    Summer work

    Mercor

    London
    26 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  .... Position: Sales Engineering Expert Type: Contract Compensation...  ...~ Prior experience with AI training , evaluation, or human-data projects.... 
    Remote job
    Summer work

    Mercor

    London
    20 days ago
  • $20 - $36 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  .... Position: Music Production Expert - Hungarian Type: Contract...  ...hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality... 
    Remote job
    Summer work
    Immediate start

    Mercor

    London
    a month ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Dorsey . Position: Music Audio Expert - English (UK/Australia) Type:...  ...hours/week Role Responsibilities Evaluate AI model output lyrics, voice... 
    Remote job
    Summer work
    Immediate start

    Mercor

    London
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!