About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: UI / UX Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world digital product and UX deliverables .
- Score AI-generated and human work samples against criteria with detailed written justifications.
- Apply consistent, evidence-based judgment for reproducible and defensible scores.
- Incorporate structured feedback from senior reviewers and iterate quickly on work.
- Work independently and asynchronously to evaluate and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in product design, UI/UX , or design systems.
- Background at leading digital-product and UX studios or in-house product-design teams.
- Experience in Product / UI / Design Systems Design , UX Lead , or UX Writing .
- Deep fluency in interaction and visual design, design systems , and Figma .
- Exceptionally strong written communication skills.
- Detail-oriented and comfortable with peer-reviewed judgment.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background.
- Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 24 days ago
Similar jobs that could be interesting for youBased on the UI/UX Design Expert - Evaluator in London vacancy
$80 - $150 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities...SuggestedRemote jobSummer workMercor
London9 days ago$80 - $120 per hour
...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and domain relevance. Work independently...SuggestedRemote jobSummer workMercor
London22 days ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London22 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London17 days ago$80 - $120 per hour
...Position: Brand / creative direction / marketing collateral Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and quality. Work independently and...SuggestedRemote jobSummer workMercor
London19 days ago$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobSummer workMercor
London9 days ago$80 - $120 per hour
.... Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and quality across datasets. Qualifications...Remote jobSummer workMercor
London2 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London13 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London7 days ago$150 - $220 per hour
...Dorsey . Position: Investment Banking Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London21 days ago$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–...Remote jobSummer workMercor
London24 days ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London23 days ago$19 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11–$1... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobSummer workImmediate startMercor
London18 days ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise grading criteria for real-world... ...to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer workMercor
London12 days ago$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and rate against...Remote jobSummer workImmediate startMercor
London14 days ago$60 - $70 per hour
...Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving...Remote jobSummer workMercor
London19 days ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London14 days ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (UK/Australia) Type: Contract... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other standards....Remote jobSummer workImmediate startMercor
London25 days ago$20 - $36 per hour
...Summers , and Jack Dorsey . Position: Music Production Expert - Hungarian Type: Contract Compensation: $20–... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality, creativity, prompt...Remote jobSummer workImmediate startMercor
London20 days ago$70 per hour
...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...published papers, Kaggle datasets , open-source repositories, or self-designed scenarios. Write scientific prompts based on sourced inputs...Remote jobSummer workImmediate startMercor
London9 days ago$70 per hour
...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...published papers, Kaggle datasets , open-source repositories, or self-designed scenarios. Write scientific prompts based on sourced inputs...Remote jobSummer workImmediate startMercor
London7 days ago$150 per hour
...Position: Sales Operations & Enablement Expert Type: Contract Compensation... ...Role Responsibilities Create and evaluate high-quality sales operations scenarios... ...performance management , and commercial process design . Interview Process Resume...Remote jobHourly payFull-timeSummer workFlexible hoursAfternoon shiftMercor
London24 days ago$70 - $90 per hour
...Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type... .../week Role Responsibilities Design challenging computational problems to... .... Familiarity with benchmark or evaluation design. Background in scientific teaching...Remote jobSummer workMercor
London12 days ago$145 per hour
...Summers , and Jack Dorsey . Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications) Type: Contract... ...hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content to strengthen reasoning...Remote jobSummer workMercor
London22 days ago- £58k - £75k per annumEstimated...Description Role Title: Logistics & Supply Chain Management Expert Role Type: Contract Location: Remote Scope of... ...highlight best practices in logistics and supply chain management. Evaluate and suggest improvements in current supply chain workflows based...Remote job
$150 - $250 per hour
...and Jack Dorsey . Position: Senior Design Expert - Paid AI Design Research Study... ...to capture expert design thinking. Evaluate design quality, critique, and shipping standards... ...Senior-level design experience in product, UX, brand, or adjacent craft disciplines....Remote jobSummer workMercor
London21 days ago$150 - $200 per hour
...Position: UK-Based Banking, Consulting, Legal & Technology Experts Type: Contract Compensation: $150–$200/hour... ...Commitment: 30+ hours/week Role Responsibilities Evaluate workplace tasks and outputs to determine quality standards in your...Remote jobSummer workImmediate startFlexible hoursMercor
London20 days ago$70 - $85 per hour
...Computational Pharmacokinetics & Systems Biology Expert Type: Contract... ...hours/week Role Responsibilities Design challenging computational problems for AI... ...tools. Familiarity with benchmark or evaluation design. Background in scientific teaching...Remote jobSummer workFlexible hoursMercor
London20 days ago$70 - $84 per hour
...Location: Remote Role Responsibilities Design adversarial prompts to stress-test frontier AI models . Identify... ...jailbreaks, unsafe behaviors, hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber, biosecurity,...Remote jobSummer workMercor
London17 days ago$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation across various...Remote jobSummer workImmediate startMercor
London17 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI/UX Design Expert - Evaluator. Be the first to apply!
