Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Product Designer - AI Creative Evaluation (Contra Labs)

Temporary

About Contra Labs

Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.

By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.

How It Works

This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.

To Join the Network

  1. Portfolio review - We'll assess your Contra profile and portfolio for strength in product design, specifically across desktop and mobile applications.
  2. Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.
  3. Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.

What You May Work On

  • Evaluate AI-generated product design outputs across desktop and mobile app interfaces, applying professional design standards and best practices
  • Provide clear, structured feedback on UI/UX quality including layout, hierarchy, interaction patterns, accessibility, and visual polish
  • Help define creative benchmarks and taste standards for what great product design looks like in the next generation of AI-powered tools
  • Contribute to research on how convergence (shared best practices) and divergence (individual taste and creative direction) shape design quality

What We're Looking For

  • Strong portfolio showcasing high-quality product design work across desktop and/or mobile applications, shared via your Contra profile
  • Deep understanding of what makes app interfaces intuitive, polished, and well-crafted, from information architecture to micro-interactions
  • Ability to articulate design and UX feedback clearly and constructively
  • Comfort working in fast-paced, experimental environments (experience with AI or design tools is a plus)
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Product Designer - AI Creative Evaluation (Contra Labs) in Remote vacancy
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying... 
    Creative
    Immediate start

    Contra Labs

    Remote
    17 hours ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and technology. We partner with leading product companies to improve the creative tools that professionals use every day. Our research is grounded in how top creatives actually work, studying the... 
    Creative
    Full-time

    Contra Labs

    Remote
    17 hours ago
  •  ...About Contra Labs Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying... 
    Creative
    Full-time

    Contra Labs

    Remote
    17 hours ago
  •  ...Design tests to evaluate AI safety and identify model failures. About Turing: Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing... 
    Creative
    Ongoing contract
    Part-time

    Turing

    Remote
    20 days ago
  • $150 - $200 per hour

     ...About the role UK-Based UX/UI Product Designers is a remote review track for evaluating AI outputs across ui / ux design workflows. Reviewers grade craft, constraints, and tooling adherence; flag production-readiness issues; and document the corrected approach so the modeling... 
    Creative
    Remote

    AuraOne

    Remote
    20 days ago
  •  ...Help a leading AI lab define what great design looks like, and build the prototypes that prove it. # Overview A leading AI lab is looking for senior product designers and design-minded engineers with exceptional taste to help shape how its AI models design and build... 
    Creative
    40 hours/week
    Full-time
    Part-time
    Weekday work

    Mercor

    Remote
    20 days ago
  •  ...We are seeking elite Content Writers & AI Evaluation Specialists with expertise in copywriting, content creation and LLM evaluation. In this...  ...content strategy, and AI evaluation to create, review, and evaluate creative and informative text formats, including stories, articles,... 
    Creative
    40 hours/week

    AfterQuery

    Remote
    20 days ago
  •  ...handling visual tasks. Ability to meet productivity and quality thresholds. Familiarity or comfort with AI / generative models, visual content, or creative/graphic domains is helpful....  ...Lionbridge . Background in content evaluation, annotation, or quality assurance... 
    Creative
    Remote
    Flexible hours

    Rise Data Labs

    Remote
    20 days ago
  • £64k - £84k per annumEstimated
     ...Grafana Labs is the company behind Grafana Cloud, the fully managed...  ...source and open standards and designed for interoperability across any stack, Grafana Cloud brings AI to observability and observability...  ...team are the customer facing product experts. The team enables Grafana... 
    Creative
    Full-time
    Remote

    Grafanalabs

    Remote
    10 days ago
  • $155k - $185k per annum

    About Us: Who We Are: Left Field Labs is the creative technology agency that builds what’s next...  ...balance between innovation and pragmatism Product Innovation: We build scalable platforms...  ...thinking, blending digital, social, AI, and physical spaces to engage and delight... 
    Creative
    Remote job
    Full-time
    Flexible hours

    Left Field Labs

    Remote
    17 days ago
  • $15 per hour

     ...Evaluate Gemini's personalized Chinese responses for relevance and accuracy. About Turing...  ...research accelerator for frontier AI labs and a trusted partner for global enterprises...  ...helpful. This role requires a unique blend of creativity and analytical rigor. You will actively... 
    Creative
    Hourly pay
    40 hours/week
    Part-time

    Turing

    Remote
    20 days ago
  • £60k - £79k per annumEstimated
     ...steps. Our partner is looking for a Senior Product Designer – Growth/Website based in United Kingdom...  ...marketers to plan, implement, and evaluate experiments. - Design high-performing landing...  ...to explain design decisions clearly to creative teams and business stakeholders.... 
    Creative
    Full-time
    Remote

    Jobgether

    Remote
    2 days ago
  • £58k - £76k per annumEstimated
     ...steps. Our partner is looking for a Senior Product Designer – Growth/Website based in United...  ...identifying opportunities to launching and evaluating experiments. You will combine...  ...expertise, and the ability to combine creative execution with analytical thinking to deliver... 
    Creative
    Full-time
    Remote

    Jobgether

    Remote
    3 days ago
  • $80 per hour

     ...$1.6k/week We're working with a leading foundational AI lab to find experienced creative directors and art directors who can help train their latest...  ...work at top agencies or in-house studios to create, evaluate, and refine AI-generated presentations and slide decks across... 
    Creative
    Immediate start
    Remote
    Flexible hours

    Ethos

    Remote
    13 days ago
  • $80 per hour

     ...Generalist Freelance Presentation Designer Expert Ethos • Remote...  ...a 10-minute call. Ethos's AI interviewer asks about your...  ...with a leading foundational AI lab to find experienced freelance presentation...  ...firm or bank to create, evaluate, and refine AI-generated... 
    Creative
    Hourly pay
    Freelance
    Immediate start
    Remote
    Flexible hours

    Ethos

    Remote
    13 days ago
  • €110k - €134k per annum

     ...Grafana Labs is the company behind Grafana Cloud, the fully managed...  ...source and open standards and designed for interoperability across any stack, Grafana Cloud brings AI to observability and observability...  ...team are the customer facing product experts. The team enables Grafana... 
    Creative
    Full-time
    Remote

    Grafana Labs

    Remote
    9 days ago
  • $125 per hour

     ...3 months ~80% Why this role $125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the overhead of running a consulting practice around it.... 
    Hourly pay
    Remote

    Ethos

    Remote
    13 days ago
  • £103k - £134k per annumEstimated
     ...AlphaSense: AlphaSense is the AI platform redefining market...  ...About the Team: AlphaSense's Product team stands at the forefront of...  ...are seeking a Senior Product Designer to join our growing Mobile team...  ..., leveraging your exceptional creative skills and design expertise to... 
    Creative
    Full-time

    Alpha Sense

    Remote
    7 days ago
  •  ...UI/UX designers to build the design evaluation and Figma workflow scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring UI/UX designers as contractors to... 
    Weekly pay
    Ongoing contract
    Remote

    AfterQuery

    Remote
    20 days ago
  • $70 per hour

     ...experience Demonstrated expertise in Creative How long hiring takes Across the AI training platforms we refer...  ...Presentation Specialist / Visual Graphics Designer (Consulting) Expert work puts your...  ...on the same footing as an AI lab's own research staff, without the overhead... 
    Creative
    Hourly pay
    Remote
    Weekend work

    Ethos

    Remote
    13 days ago
  • $70 per hour

     ...$1.4k/week We're working with a leading foundational AI lab to find experienced customer and user researchers who can...  ...years in customer or user research, feedback synthesis, or product discovery to create, evaluate, and refine AI-generated documents, spreadsheets, and... 
    Immediate start
    Remote
    Flexible hours

    Ethos

    Remote
    13 days ago
  • About Us: Who We Are: Left Field Labs is the creative technology agency that builds what’s next...  ...balance between innovation and pragmatism Product Innovation: We build scalable platforms...  ...thinking, blending digital, social, AI, and physical spaces to engage and delight... 
    Creative
    Remote job
    Hourly pay
    Full-time
    Temporary
    Part-time

    Left Field Labs

    Remote
    17 days ago
  • $70 per hour

     ...Design UX Researcher Expert Ethos • Remote Education...  ...is a 10-minute call. Ethos's AI interviewer asks about your career...  ...with a leading foundational AI lab to find experienced UX...  ...research, feedback synthesis, or product discovery to create, evaluate,... 
    Hourly pay
    Immediate start
    Remote
    Flexible hours
    Shift work

    Ethos

    Remote
    13 days ago
  • $75 per hour

     ...months ~80% Why this role This UX/UI Designer – Generative AI Platform Expert role pays $75/hr for...  ...Software Engineering & Coding Creative & Design UX/UI Design Expert Related...  ...expert network, not a task queue. AI labs, investment funds, and Fortune 500s pay... 
    Creative
    Hourly pay
    Remote

    Ethos

    Remote
    13 days ago
  •  ...At TELUS Digital , we know that as AI becomes more powerful, the need for robust...  ...stakes adversarial testing sessions, employing creative "jailbreaking" techniques to probe model vulnerabilities...  ...to update model safety guardrails. Evaluate the model’s ethical decision-making in "... 
    Creative
    Part-time

    TELUS International

    Remote
    21 days ago
  • £50k - £66k per annumEstimated
     ...About ElevenLabs ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023...  ...foundational models. Everything we do is the result of the creativity and commitment of our team - builders doing the best work of... 
    Creative
    Full-time
    Immediate start
    Remote

    ElevenLabs

    Remote
    9 days ago
  • $70 per hour

     ...We're working with a leading foundational AI lab to find experienced brand strategists and...  ...brand, agency, or CPG company to create, evaluate, and refine AI-generated presentations...  ...and architecture presentations, campaign creative rationale slides, brand tracking readouts... 
    Creative
    Immediate start
    Remote
    Flexible hours

    Ethos

    Remote
    13 days ago
  • £37k - £50k per annumEstimated
     ...social and end-to-end content production agency. Since 2008 we’ve been...  ...re looking for a 2D/3D Motion Designer to join a new in-house team at...  ...You'll be an ideas-driven Creative, who’s able to work independently...  ...must have strong interest in AI and emerging technologies, and... 
    Creative
    Remote job
    Full-time

    eight&four

    Remote
    22 days ago
  •  ...methods and computational science, ML inference and GPU kernels, enterprise operations, security, hardware design, and creative technology — to help evaluate how frontier AI models reason about hard, real-world expert-level problems. This is research-and-evaluation work, not... 
    Creative

    AfterQuery

    Remote
    20 days ago
  •  ...Create and evaluate social scenarios for AI interaction effectiveness. About Turing: Turing is one of...  ...: Working with the world’s leading AI labs to advance frontier model capabilities...  ...human-AI interaction evaluation pilot designed to assess whether providing social context... 
    Creative
    Full-time
    Temporary
    Part-time

    Turing

    Remote
    20 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Product Designer - AI Creative Evaluation (Contra Labs). Be the first to apply!