About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–...SuggestedRemote jobSummer work$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–...SuggestedRemote jobSummer work$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:... ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your...SuggestedRemote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work- £46k - £60k per annumEstimated...Equity Research Expert Role Type: Contractor Location: Remote We are seeking experienced Equity Research Experts to contribute... ..., and sector insights. You'll apply your expertise to evaluate real-world equity research content and help train next-generation...Remote
$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...: Survey Research & Consumer Insights Expert Type: Contract... ...Role Responsibilities Review and evaluate surveys for methodological quality, clarity...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$14 - $42 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobSummer workImmediate start$150 - $220 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Investment Banking Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Healthcare Expert Type: Contract... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging...Remote jobSummer workImmediate startFlexible hours$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...: English Language and Literature Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...Remote jobSummer work$120 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Economics Research Expert Type: Contract... ...hours/week Role Responsibilities Evaluate the accuracy and depth of AI-generated content...Remote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Software Engineer Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer work$19 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...prompt adherence, and originality. Evaluate whether lyrics sound natural, including word...Remote jobSummer workImmediate start$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications)... ...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content...Remote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...Work independently and asynchronously to evaluate and improve AI model performance ....Remote jobSummer work$20 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$75 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Preferred ~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins to...Remote jobSummer work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Sales Engineering Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects....Remote jobSummer work$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music Audio Expert - Swedish Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!

