About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–...SuggestedRemote jobSummer work$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:... ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your...SuggestedRemote jobSummer work$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:... ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your...SuggestedRemote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Position: Humanities / arts / culture Evaluator Type: Contract... .... Collaborate with subject matter experts to ensure consistency and quality....SuggestedRemote jobSummer work$150 per hour
...based in United Kingdom. Pay: $150–$350/hr Role Title: Research & Insights Expert - PowerPoint Review & Reconstruction Role Type:... ...over consulting-firm pedigree. # Experience in AI training, evaluation, or rubric development is a plus, but not required....Remote jobFlexible hours$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$175 per hour
...United Kingdom. Pay: $175–$300/hr Role Title: Equity research Expert Role Type: Contractor Location: Remote We are engaging... ...for AI training purposes. # Deliver detailed written evaluations of company models, including revenue, margin, cash flow, and...Remote job$145 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications)... ...Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content...Remote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...Work independently and asynchronously to evaluate and improve AI model performance ....Remote jobSummer work$150 - $220 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Investment Banking Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...: English Language and Literature Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...Remote jobSummer work$20 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ..., Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Software Engineer Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Remote jobSummer work$17 - $42 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Greek Type: Contract... ...prompt adherence, and originality. Evaluate whether lyrics sound natural, including word...Remote jobSummer workImmediate start$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobSummer work$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...: Survey Research & Consumer Insights Expert Type: Contract... ...Role Responsibilities Review and evaluate surveys for methodological quality, clarity...Remote jobSummer work$14 - $42 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres...Remote jobSummer workImmediate start$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer work$60 - $70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy...Remote jobSummer work$75 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Preferred ~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins to...Remote jobSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Sales Engineering Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects....Remote jobSummer work$20 - $36 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Music Production Expert - Hungarian Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality...Remote jobSummer workImmediate start$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music Audio Expert - English (UK/Australia) Type:... ...hours/week Role Responsibilities Evaluate AI model output lyrics, voice...Remote jobSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!

