About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: UI / UX Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world digital product and UX deliverables .
- Score AI-generated and human work samples against criteria with detailed written justifications.
- Apply consistent, evidence-based judgment for reproducible and defensible scores.
- Incorporate structured feedback from senior reviewers and iterate quickly on work.
- Work independently and asynchronously to evaluate and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in product design, UI/UX , or design systems.
- Background at leading digital-product and UX studios or in-house product-design teams.
- Experience in Product / UI / Design Systems Design , UX Lead , or UX Writing .
- Deep fluency in interaction and visual design, design systems , and Figma .
- Exceptionally strong written communication skills.
- Detail-oriented and comfortable with peer-reviewed judgment.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background.
- Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the UI/UX Design Expert - Evaluator in London vacancy
$80 - $150 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: UI / UX Design Expert Type: Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities...SuggestedRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
Londonmore than 2 months ago$80 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–...Remote jobSummer workMercor
Londonmore than 2 months ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical / biomedical / pharma Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londonmore than 2 months ago$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londonmore than 2 months ago$150 - $220 per hour
...Dorsey . Position: Investment Banking Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
Londonmore than 2 months ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise grading criteria for real-world... ...to meet deadlines while improving evaluation processes. Qualifications Must-...Remote jobSummer workMercor
Londona month ago$19 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11–$1... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobSummer workImmediate startMercor
Londonmore than 2 months ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londonmore than 2 months ago$50 per hour
..., and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text across various...Remote jobSummer workMercor
Londona month ago$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Remote jobSummer workMercor
London20 days ago$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres and rate against...Remote jobSummer workImmediate startMercor
Londona month ago$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobSummer workImmediate startFlexible hoursMercor
London3 days ago$20 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/...Remote jobSummer workMercor
Londona month ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise, task-specific grading criteria... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
Londonmore than 2 months ago$60 - $70 per hour
...Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality. Review content involving...Remote jobSummer workMercor
Londonmore than 2 months ago$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
Londona month ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (UK/Australia) Type: Contract... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other standards....Remote jobSummer workImmediate startMercor
Londonmore than 2 months ago$20 - $36 per hour
...Summers , and Jack Dorsey . Position: Music Production Expert - Hungarian Type: Contract Compensation: $20–... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across genres for musicality, creativity, prompt...Remote jobSummer workImmediate startMercor
Londonmore than 2 months ago$70 per hour
...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour... ...published papers, Kaggle datasets, open-source repositories, or self-designed scenarios. Write scientific prompts based on sourced input...Remote jobSummer workImmediate startMercor
Londona month ago$70 - $84 per hour
...hour Location: Remote Role Responsibilities Design adversarial prompts to stress-test frontier AI models .... ...jailbreaks, unsafe behaviors, hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber, biosecurity,...Remote jobSummer workMercor
Londona month ago$70 - $100 per hour
...Position: Computational Chemistry & Electronic Structure Expert Type: Contract Compensation: $70–$... ...15–20 hours/week Role Responsibilities Design challenging computational problems to evaluate AI systems using real scientific software....Remote jobSummer workMercor
Londona month ago$140 per hour
...Healthcare Survey Research & Pharma Insights Expert Type: Contract... ...Remote Role Responsibilities Design, review, and refine physician and patient... ...methodologically sound questionnaires. Evaluate screeners, eligibility criteria, question...Remote jobSummer workMercor
Londona month ago$55 per hour
...hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content in... ...economic tasks and solutions. Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets....Remote jobSummer workMercor
Londona month ago$12 per hour
...Jack Dorsey . Position: PDF Annotation & Transcription Experts – Telugu Type: Contract Compensation: $13/hour... ...Experience with regional-language AI data annotation or bilingual evaluation. Skills in transcription, localization, and OCR correction...Remote jobSummer workMercor
Londona month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI/UX Design Expert - Evaluator. Be the first to apply!
Related searches
- google analytics expert London
- legal expert London
- fulfillment expert London
- database expert London
- medical device product expert / product specialist / regulatory auditor London
- content expert London
- expert London
- demolition expert London
- director of user experience London
- ux researcher ux consultant home remote working London