Get new jobs by email
£70k per annum
...legacy, boast a robust client list, and now seek to boost their evaluation capability. They deliver work that shifts perspectives and... ...would be at the heart of the business and will involve leading projects for clients, line management and adding new clients. The business...ProjectRemoteShift work- ...Key Responsibilities Evaluate AI-generated project plans, status reports, stakeholder communications, and other project artifacts for quality and accuracy. Compare AI-generated responses head-to-head based on planning rigor, execution feasibility, and stakeholder relevance...ProjectHourly payPart-timeImmediate start
Mercor
Remote12 days ago - ...professional judgment Take part in calibration sessions with other evaluators to align scoring standards Preferred Qualifications... ...development in the AI field and the chance to work on innovative projects that directly shape the future of AI in real estate work....ProjectFlexible hours
Rise Data Labs
Remote12 days ago - ...Define project management standards and train AI systems for delivery. About Turing: Turing is one of the world’s fastest-growing... ...deterministic rules and reference assets for AI models. You will design, evaluate, and ground evaluation datasets to ensure AI-generated project...Project40 hours/weekPart-timeRemoteWeekend work
Turing
Remote6 days ago - ...Project managers to build the planning and delivery scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring project managers as contractors to author and...ProjectWeekly payOngoing contractRemote
AfterQuery
Remote12 days ago $55 - $100 per hour
...the Expert tier and are expected to maintain accuracy above the project's threshold, which will be shared during onboarding. Skills &... ...electromagnetism Technical written communication Critical evaluation of mathematical derivations Meta-level scientific reasoning...ProjectClaru
Remote8 days ago- ...What You'll Do You'll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic financial work... ...as needed. Refine your work based on testing, feedback, and project guidelines. Specific methodologies, tools, and training will...Project
Rise Data Labs
Remote12 days ago $40 - $125 per hour
...contracts professional like you. As a Contract Manager you'll evaluate AI drafting and review, hunt for the ambiguities and internal... ...average contributor stays 5+ years. Flexible, remote, and always project-available. How it works Apply, pass the qualification assessment...ProjectWeekly payFull-timeRemoteFlexible hoursDataAnnotation
Remote7 days ago$55 - $100 per hour
...patterns?). You'll also encounter backend architecture tasks where you evaluate whether a Node.js or Java service is structured sensibly for the... ...would accept it in a real PR. Some tasks use Eclipse-based Java projects; comfort navigating that toolchain is expected. You should...ProjectClaru
Remote8 days ago$90 - $120 per hour
...is graded against. This is a standing listing for consultants who want AI training and evaluation work, not a specific job opening. It stays open whether or not a matching project is running this week. New projects start on short notice, so instead of posting and pulling...ProjectOdd jobPart-timeMercor
Remotea month ago- ...writing information synthesis written communication content evaluation executive reporting staff coordination feedback... ...Military Operations & Reporting SMEs to collaborate on a customer's project, leveraging deep subject matter expertise in military operations...ProjectPart-timeRemote
micro1
Remote13 days ago - ...Key Responsibilities Review and evaluate posts on various social media platforms. Identify and analyze the quality of information... ...information critically. To register and become a part of this exciting project, simply submit your application and we'll be in touch. Join us...ProjectRemote
Appen
Remote13 days ago - ...Skills Ontology and Learning Recognition Project Lead Office of Registrar Exempt, Contingent II, Full Time, Pay Grade 3.4 Job location... ...sponsored projects. ~ Familiarity with military learning evaluation, workforce learning records, digital credentials,...ProjectFull-timeOn-siteRemote
$130 per hour
...English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based. What this opportunity...ProjectHourly payPermanentPart-timeMindrift (Toloka)
Remote6 days ago- ...Evaluate AI chatbot responses for small business scenarios in Korean. About Turing: Turing is one of the world’s fastest-growing AI... ...work environment. Opportunity to collaborate on high-impact projects with global reach. Offer Details: Project-based with...ProjectPart-timeFreelanceRemoteFlexible hours
Turing
Remote12 days ago - ...handling, concurrency, retries, and regressions where relevant. Evaluate performance measures such as latency, throughput, and memory use... ...completed assessments may be considered for future work if the project expands. Paid task after selection Selected experts will...ProjectImmediate start
Mercor
Remote9 days ago Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa
...coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants... ...opportunities for clarification or information gathering Project Details : Project duration - 3 weeks (short term project)...ProjectFull-timeTemporaryPart-timeTuring
Remote12 days ago$70 - $110 per hour
...10/hr, remote, async, paid weekly. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models... ...monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches. How our hiring process works...ProjectWeekly payOngoing contractRemoteAfterQuery
Remote12 days ago- ...Lead teams to create and evaluate realistic LLM conversational data. About Turing Turing is a leading AI company accelerating the... ...cloud storage, and other applications. The manager will oversee project execution, maintain quality standards, guide technical decision-...Project40 hours/weekPart-timeFreelanceRemote
Turing
Remote12 days ago - ...Analyze GitHub issues and evaluate LLM performance on real-world code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering...ProjectPart-timeFreelanceRemote
Turing
Remote12 days ago - ...Safety · CBRN What this pays Rates are set by the client project, not by us, and we do not know them until a contract is in place... ...a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe, and...ProjectHourly payRemote
Pasiflora AI
Remote7 days ago $20 - $100 per hour
...for Small Business Ownership or Manager – Freelance AI Trainer Project at Meridial Back to jobs Small Business Ownership or Manager... ...realistic small business scenarios and operational challenges; evaluate outputs related to budgeting, pricing, marketing strategy, hiring...ProjectHourly payPart-timeFreelanceRemoteInvisible Technologies
Remote12 days ago$50 - $100 per hour
...software engineers to validate real-world repositories used to evaluate large language models. You will triage issues, set up reproducible... ...Review and triage issues in open-source GitHub projects. Prepare repositories for evaluation, including containerisation...ProjectHourly payRemoteRemoExperts
Remote12 days ago- ...micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter... ...Cantonese Language Evaluators to contribute to a language-focused project supporting a valued customer. In this role, you'll apply your expertise...ProjectPart-timeRemote
micro1
Remote12 days ago $25 - $45 per hour
...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... ...per task: ~1.5 hours per run (evidence and scoring included) Project kickoff: Monday, October 12 Onboarding: Today (Fri), Saturday...ProjectPart-timeOn-siteWeekend workmicro1
Remote5 days ago- ...Design tests to evaluate AI safety and identify model failures. About Turing: Based in San Francisco, California, Turing is the world... ...drive lasting results. Nature of Engagement: This is a project-based independent contractor engagement. Contractors are engaged...ProjectOngoing contractPart-time
Turing
Remote12 days ago - ...micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter... ...Remote micro1 is engaging Research Engineers to participate in a project focused on code generation and model evaluation for a customer's...ProjectPart-timeRemote
micro1
Remote12 days ago - ...Skills Financial Literacy Tax Filing Data Review Rubric Evaluation Google Workspace About micro1 micro1 is the leading AI... ...Workflow Evaluations to participate in a short-term customer project focused on evaluating U.S. tax and financial workflows. In this...ProjectTemporaryPart-timeImmediate startRemote
micro1
Remote13 days ago - ...Job Application for French Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial Back to jobs French Audio Evaluations Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent Audio Evaluation...ProjectHourly payPart-timeFreelanceRemote
Invisible Technologies
Remote12 days ago $60 - $100 per hour
...into self-contained tasks: a prompt, input files (STEP, KiCad projects, .blend files, meshes), and an automated grader Build and iterate... ..., or a related field Prior AI training, benchmark, or evaluation work, or heavy daily use of AI coding agents Role Highlights...ProjectHourly payFreelanceImmediate start5 days/weekMercor
Remote9 days ago
