About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: UI / UX Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world digital product and UX deliverables .
- Score AI-generated and human work samples against criteria with detailed written justifications.
- Apply consistent, evidence-based judgment for reproducible and defensible scores.
- Incorporate structured feedback from senior reviewers and iterate quickly on work.
- Work independently and asynchronously to evaluate and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in product design, UI/UX , or design systems.
- Background at leading digital-product and UX studios or in-house product-design teams.
- Experience in Product / UI / Design Systems Design , UX Lead , or UX Writing .
- Deep fluency in interaction and visual design, design systems , and Figma .
- Exceptionally strong written communication skills.
- Detail-oriented and comfortable with peer-reviewed judgment.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background.
- Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the UI/UX Design Expert - Evaluator in London vacancy
$80 - $150 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities...SuggestedRemote jobSummer workMercor
London28 days ago$80 - $120 per hour
.... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and quality across datasets. Qualifications...SuggestedRemote jobSummer workMercor
London23 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London15 days ago$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and quality. Work independently and...SuggestedRemote jobSummer workMercor
London5 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
Londona month ago$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London29 days ago$150 - $220 per hour
...Dorsey . Position: Investment Banking Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
Londona month ago$50 per hour
..., and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various...Remote jobSummer workMercor
London15 days ago$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londona month ago$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and rate against...Remote jobSummer workImmediate startMercor
Londona month ago$20 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/...Remote jobSummer workMercor
London19 days ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Remote jobSummer workMercor
London2 days ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise, task-specific grading criteria... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
Londona month ago$17 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Greek Type: Contract Compensation: $17–$42/... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobSummer workImmediate startMercor
Londona month ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise grading criteria for real-world... ...to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer workMercor
Londona month ago$60 - $70 per hour
...Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving...Remote jobSummer workMercor
Londona month ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London20 days ago$20 - $36 per hour
...Summers , and Jack Dorsey . Position: Music Production Expert - Hungarian Type: Contract Compensation: $20–... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality, creativity, prompt...Remote jobSummer workImmediate startMercor
Londona month ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (UK/Australia) Type: Contract... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other standards....Remote jobSummer workImmediate startMercor
Londona month ago$70 per hour
...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...published papers, Kaggle datasets , open-source repositories, or self-designed scenarios. Write scientific prompts based on sourced inputs...Remote jobSummer workImmediate startMercor
Londona month ago$70 - $85 per hour
...Computational Pharmacokinetics & Systems Biology Expert Type: Contract... ...hours/week Role Responsibilities Design challenging computational problems to test... ...Tellurium , or SBML-based tools . Evaluate and refine problems through testing loops...Remote jobSummer workMercor
London15 days ago$13 per hour
...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Bengali Type: Contract Compensation: $13/hour... ...language AI data: annotation, labeling, grading, or bilingual evaluation for training datasets. Transcription and localization: MTPE...Remote jobSummer workMercor
London16 days ago$65 - $75 per hour
...radiological safety, labeled as benign, dual-use, or adversarial. Evaluate AI model responses against defined policy standards to ensure... ...correct responses. Collaborate with radiological safety experts to assess misuse potential in technical requests. Work...Remote jobSummer workMercor
London9 days ago$160 per hour
...Summers , and Jack Dorsey . Position: Analyst / Insights Experts Type: Contract Compensation: $80–$160/hour... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously to meet project deadlines...Remote jobSummer workFlexible hoursMercor
London5 days ago$65 - $75 per hour
...Write challenging single-turn prompts in Chemistry and Chemical Safety , labeled as benign, dual-use, and adversarial. Evaluate model responses against a defined policy standard to ensure correct handling. Write reference answers with technical reasoning for...Remote jobHourly payWeekly paySummer workMercor
London2 days ago$150 per hour
...Position: Sales Operations & Enablement Expert Type: Contract Compensation... ...Role Responsibilities Create and evaluate high-quality sales operations scenarios... ...performance management , and commercial process design . Interview Process Resume...Remote jobHourly payFull-timeSummer workFlexible hoursAfternoon shiftMercor
Londona month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI/UX Design Expert - Evaluator. Be the first to apply!
