About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–...SuggestedRemote jobSummer work$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–...SuggestedRemote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...: Pricing / ROI / revenue economics Evaluator Type: Contract... .... Collaborate with subject matter experts to ensure consistency and domain relevance...Remote jobSummer work$150 - $220 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Investment Banking Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...Work independently and asynchronously to evaluate and improve AI model performance ....Remote jobSummer work$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications)... ...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content...Remote jobSummer work$14 - $42 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobSummer workImmediate start$19 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...prompt adherence, and originality. Evaluate whether lyrics sound natural, including word...Remote jobSummer workImmediate start$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy...Remote jobSummer work$75 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Preferred ~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins to...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Sales Engineering Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects....Remote jobSummer work$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music Audio Expert - Swedish Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobSummer workImmediate start$40 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Generalist Search Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated...Remote jobSummer work$20 - $36 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Music Production Expert - Hungarian Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality...Remote jobSummer workImmediate start$119 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...included. Rate each question's difficulty as Medium, Hard, or Expert to challenge expert-level solvers. Provide one correct...Remote jobSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour...Remote jobSummer workImmediate start- £76k - £100k per annumEstimated...in engineering and IT services. Domain Expert Role Overview Location: UK-based, hybrid... ...Client-Side Transformation Partner User-Centred Design & Delivery Cloud Transformation... ..., evidence requirements, model/system evaluation, testing, validation, monitoring,...Full-timeHybrid working
- £29k - £38k per annumEstimated...Join the team Science expert Join Rainbow as a Science Expert and help shape the science behind high-integrity carbon mitigation certification... ...The Science team sits at the core of what Rainbow does. You'll research emerging carbon removal and reduction technologies, develop the...Full-timeOn-site
$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour...Remote jobSummer workImmediate start$85 - $142 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Preclinical R&D Expert – In-house Drug Development Type: Contract Compensation...Remote jobSummer work$80 - $135 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Research Physics Expert Type: Contract Compensation: $80–$135/hour...Remote jobSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
- content expert London
- database expert London
- fulfillment expert London
- medical device product expert / product specialist / regulatory auditor London
- google analytics expert London
- expert London
- legal expert London
- demolition expert London
- fund manager research London
- research leader innovation science London

