About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: UI / UX Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world digital product and UX deliverables .
- Score AI-generated and human work samples against criteria with detailed written justifications.
- Apply consistent, evidence-based judgment for reproducible and defensible scores.
- Incorporate structured feedback from senior reviewers and iterate quickly on work.
- Work independently and asynchronously to evaluate and improve AI model performance .
Qualifications
Must-Have
- 5+ years of professional experience in product design, UI/UX , or design systems.
- Background at leading digital-product and UX studios or in-house product-design teams.
- Experience in Product / UI / Design Systems Design , UX Lead , or UX Writing .
- Deep fluency in interaction and visual design, design systems , and Figma .
- Exceptionally strong written communication skills.
- Detail-oriented and comfortable with peer-reviewed judgment.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume, portfolio, or relevant professional background.
- Qualified applicants may complete a brief assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the UI/UX Design Expert - Evaluator in London vacancy
$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobSummer workMercor
London13 hours ago$50 per hour
...Jack Dorsey . Position: Spanish (Spain) Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour... ...Collaborate with project leads to resolve ambiguities and improve task design. Qualifications Must-Have Strong writing,...SuggestedRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...SuggestedRemote jobSummer workMercor
Londona month ago- ...An Enterprise client is seeking a high volume of English-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in...Suggested
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
London13 hours ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londonmore than 2 months ago$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...Remote Role Responsibilities Design precise, task-specific grading criteria... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London13 hours ago$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobSummer workMercor
Londona month ago$150 - $220 per hour
...Dorsey . Position: Investment Banking Expert Type: Contract... ...Remote Role Responsibilities Design precise, task-specific grading criteria for... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobSummer workMercor
London13 hours ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Swedish Type: Contract Compensation: $39/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobSummer workImmediate startMercor
London13 hours ago- £53k - £69k per annumEstimated...complexity. Our teams of interdisciplinary experts combine innovative thinking and... ...are over 4,000 strategists, innovators, designers, consultants, digital experts, scientists... ...long-term infrastructure investment needs, evaluating costs / benefits of potential investment...Long-term contractFull-timeSeasonalHybrid workingOn-site5 days/week
$15 per hour
...Are you an Urdu language expert with a passion for writing and quality? Join an exciting AI project where your expertise will help... ...how AI understands and communicates in Urdu. What You’ll Do Evaluate AI-generated content for accuracy, fluency, and cultural...Part-timeFreelanceImmediate startRemoteFlexible hours$70 - $84 per hour
...Location: Remote Role Responsibilities Design adversarial prompts to stress-test frontier AI models . Identify... ...jailbreaks, unsafe behaviors, hallucinations, and policy failures. Evaluate model robustness across misinformation, cyber, biosecurity,...Remote jobSummer workMercor
London2 days ago$55 - $80 per hour
...Jack Dorsey . Position: Automated CS Planning PhDs & Domain Experts — Zion (Arches) Type: Contract Compensation: $... ...models by creating complex problems in your domain. Evaluate and improve AI model performance through rigorous problem-solving...Remote jobSummer workMercor
Londona month ago$65 per hour
...Larry Summers , and Jack Dorsey . Position: Private Banking Expert Type: Contract Compensation: $65/hour Location: Remote Role Responsibilities Evaluate the performance of AI systems within private banking environments....Remote jobSummer workMercor
Londona month ago- £49k - £65k per annumEstimated...MaxAccelerate Technology Group, focused on designing and deploying next-generation AI... ...We are now seeking an AI Subject Matter Expert (SME) to lead technical architecture, prototyping... ...injection mitigation • AI monitoring and evaluation • Responsible AI deployment...RemoteFlexible hours
- £70k - £94k per annumEstimated...to boost your career and collaborate with expert, talented colleagues to solve and deliver... ...the world’s most recognizable brands to design and implement a future ready operating model... ...project life cycle. Experience in evaluating existing supply chain processes and identify...Full-timeShift work
- £50k - £66k per annumEstimated...Chain IQ, we're looking for a bold, strategic HR Subject Matter Expert with deep UK Benefits expertise to join our Professional Services... ...wellbeing solutions, regulatory compliance, and supplier market evaluation, while also supporting broader HR subcategories including Talent...Full-timeFlexible hours
$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation across various...Remote jobSummer workImmediate startMercor
London13 hours ago- £58k - £75k per annumEstimated...Description Role Title: Logistics & Supply Chain Management Expert Role Type: Contract Location: Remote Scope of... ...highlight best practices in logistics and supply chain management. Evaluate and suggest improvements in current supply chain workflows based...Remote job
$35.2 per hour
...Overview Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Dutch-speaking experts to join our team. In this role, you will contribute to training AI systems to better...Part-timeFreelanceImmediate startRemoteFlexible hours$50 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Basque Audio Generalist Evaluator Expert Type: Contract Compensation: $50/hour Location: Remote Commitment: 10–20 hours/week...Remote jobSummer workMercor
Londona month ago$60 - $75 per hour
..., and Jack Dorsey . Position: Software & Data Science Expert Type: Contract Compensation: $60–$75/hour... ...tasks to test AI reasoning over technical documentation. Evaluate AI ability to follow precise instructions and produce accurate...Remote jobSummer workMercor
Londona month ago$70 - $90 per hour
...Larry Summers , and Jack Dorsey . Position: Physics PhD Experts (String theory, QFT, Particle physics & Nuclear physics)... ...labs to create high-quality data for large language models. Evaluate and improve AI model outputs using domain expertise. Work...Remote jobSummer workMercor
Londona month ago$70 - $180 per hour
...Type: Contract Compensation: $70–$180/hour Location: Remote Role Responsibilities Solve and evaluate challenging physics problems across various subfields. Review AI-generated proofs , derivations, and solutions for correctness...Remote jobSummer workImmediate startMercor
Londona month ago$70 - $90 per hour
...Larry Summers , and Jack Dorsey . Position: Physics PhD Experts (General Relativity, Astrophysics & Cosmology) Type:... ...General Relativity , Astrophysics , and Cosmology . Evaluate and refine AI model training to enhance future AI innovations...Remote jobSummer workMercor
Londona month ago- £76k - £100k per annumEstimated...solutions that are people-centred, safe, and designed for the future. Our human touch sets... ...engineering and IT services. Domain Expert Role Overview Location: UK-based, hybrid... ..., evidence requirements, model/system evaluation, testing, validation, monitoring, escalation...Full-timeHybrid working
$70 - $100 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract Compensation: $70–$100/hour Location: Remote Commitment...Remote jobSummer workMercor
Londona month ago$70 - $100 per hour
...Bayesian Statistics and Applied Mathematics Expert Type: Contract... ...hours/week Role Responsibilities Design challenging computational problems to test... ...tools. Familiarity with benchmark or evaluation design. Background in scientific teaching...Remote jobSummer workMercor
Londona month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to UI/UX Design Expert - Evaluator. Be the first to apply!
