About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: UI / UX Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world digital product and UX deliverables .
- Score AI-generated and human work samples against criteria with detailed written justifications.
- Apply consistent, evidence-based judgment for reproducible and defensible scores.
- Incorporate structured feedback from senior reviewers and iterate quickly on work.
- Work independently and asynchronously to evaluate and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in product design, UI/UX , or design systems.
- Background at leading digital-product and UX studios or in-house product-design teams.
- Experience in Product / UI / Design Systems Design , UX Lead , or UX Writing .
- Deep fluency in interaction and visual design, design systems , and Figma .
- Exceptionally strong written communication skills.
- Detail-oriented and comfortable with peer-reviewed judgment.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background.
- Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the UI/UX Design Expert - Evaluator in London vacancy
$80 - $150 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities...SuggestedRemote jobSummer workMercor
London9 days ago$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London25 days ago$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–...SuggestedRemote jobSummer workMercor
London24 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London23 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London23 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London19 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London19 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London18 days ago$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobSummer workMercor
London9 days ago$80 - $120 per hour
...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and domain relevance. Work independently...Remote jobSummer workMercor
London23 days ago$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and rate against...Remote jobSummer workImmediate startMercor
London15 days ago$150 - $220 per hour
...Dorsey . Position: Investment Banking Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London13 days ago$19 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11–$1... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobSummer workImmediate startMercor
London19 days ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise grading criteria for real-world... ...to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer workMercor
London13 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London8 days ago$60 - $70 per hour
...Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving...Remote jobSummer workMercor
London19 days ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London15 days ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Swedish Type: Contract Compensation: $39/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobSummer workImmediate startMercor
London25 days ago$20 - $36 per hour
...Summers , and Jack Dorsey . Position: Music Production Expert - Hungarian Type: Contract Compensation: $20–... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality, creativity, prompt...Remote jobSummer workImmediate startMercor
London20 days ago$70 per hour
...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...published papers, Kaggle datasets , open-source repositories, or self-designed scenarios. Write scientific prompts based on sourced inputs...Remote jobSummer workImmediate startMercor
London9 days ago$70 per hour
...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...published papers, Kaggle datasets , open-source repositories, or self-designed scenarios. Write scientific prompts based on sourced inputs...Remote jobSummer workImmediate startMercor
London7 days ago- £31k - £41k per annumEstimated...Italian Bilingual Expert Job Type: Contractor Location: Remote Job Overview We are seeking Italian Bilingual Experts... ...-language understanding and generation. In this role, you will evaluate Italian audio content, assess linguistic quality and...Remote job
$160 per hour
...platforms side by side. Score each response against a standardized rubric we provide. Submit concise written feedback for every evaluation. Work independently to meet deadlines while ensuring high-quality assessments. Qualifications Must-Have ~5+...Remote jobSummer workMercor
London9 days ago$70 - $84 per hour
...hour Location: Remote Role Responsibilities Design adversarial prompts to stress-test frontier AI models .... ...jailbreaks, unsafe behaviors, hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber, biosecurity,...Remote jobSummer workMercor
London3 days ago$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation across various...Remote jobSummer workImmediate startMercor
London17 days ago$100 per hour
...Jack Dorsey . Position: Office-Suite Experts Type: Contract... ...responses and select the stronger one. Evaluate both the content and rendering of each document... ...Strong in PowerPoint/Presentations —slide design, layout, data visualization, brand-consistent...Remote jobSummer workOn-siteImmediate startMercor
London16 days ago$80 - $180 per hour
...Larry Summers , and Jack Dorsey . Position: Professional Design Experts Type: Contract Compensation: $80–$180/hour... ...: 15+ hours/week Role Responsibilities Evaluate product design decisions to align with professional standards...Remote jobSummer workMercor
London15 days ago$50 - $70 per hour
...Generalist Expert — UK / Europe Type: Hourly Contract Compensation: $50–$70/hour Location: Remote Region: UK / Europe... ...Generalist Experts based in the UK or Europe to help train and evaluate next-generation AI models. As a Generalist Expert, you'll review...Remote jobHourly payWeekly payFlexible hours$70 - $100 per hour
...Position: Computational Chemistry & Electronic Structure Expert Type: Contract Compensation: $70–$... ...15–20 hours/week Role Responsibilities Design challenging computational problems to evaluate AI systems using real scientific software....Remote jobSummer workMercor
London2 days ago$70 - $90 per hour
...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type:... .../week Role Responsibilities Design challenging computational problems using... ..., or scientific software packages. Evaluate AI's ability to compute reproducible...Remote jobSummer workMercor
London19 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI/UX Design Expert - Evaluator. Be the first to apply!
