Create complex prompts to evaluate and improve AI model performance.
About Turing:
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
About the Role
We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs). You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.
Key Responsibilities
- Create complex, domain-specific prompts to test LLM capabilities.
- Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
- Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
- Develop challenging test cases and edge cases that expose model limitations.
- Provide clear, detailed, and evidence-based feedback to improve model performance.
Minimum Qualifications
- Master’s degree or higher in a relevant field.
- At least three years of professional, research, or teaching experience.
- Excellent written English communication skills.
- Strong analytical and critical-thinking abilities.
- Exceptional attention to detail.
Preferred Qualifications
- Experience working with LLMs or Generative AI.
- Familiarity with prompt engineering, AI evaluation, or model testing.
- Experience designing challenging prompts, identifying edge cases, or stress-testing AI models.
Ideal Candidate
The ideal candidate is curious, detail-oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage.
Skills: Business Analysis
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Tooling Engineer in Remote vacancy
- ...Exceptional attention to detail. Preferred Qualifications Experience working with LLMs or Generative AI. Familiarity with prompt engineering, AI evaluation, or model testing. Experience designing challenging prompts, identifying edge cases, or stress-testing AI models....SuggestedPart-time
Turing
Remote2 days ago - ...Motor Engineer, AI Integration – Automotive, (Fixed-Term) Location: Remote Department: Motor engineer / A.I. Integration Contract... ...expect from us At Activate Group, we want everyone to have the tools and support they need to do their best work. We're an innovative...SuggestedRemote jobLong-term contractFull-timeTemporaryFixed-term contractWork from home
- ...knowledge of power electronics and electronic circuit design. Experience with component selection, schematic capture, and PCB layout tools such as KiCad (mandatory). Understanding of switching regulators, MOSFETs, gate drivers, protection circuits, and power...Suggested40 hours/weekPart-time
Turing
Remote8 days ago $40 - $90 per hour
...your location. We’re looking for a freelancer with strong expertise in crash simulation and testing using OpenRadioss to support engineering simulation projects. Requirements: Strong hands-on experience with OpenRadioss. Expertise in crash analysis and impact...SuggestedHourly payFreelanceRemoteBraintrust
Remote2 days ago£70k - £80k per annum
Evangelise a change in culture. Shift left, automate earlier and better. Improve the product. You already know how to automate. Frameworks from scratch, APIs, UIs and regression testing too. The company has nailed manual testing but the knowledge to take the function...SuggestedRemote jobPermanentEarly shift- ...nx freecad geometric dimensioning and tolerancing (gd&t) engineering drawing interpretation technical documentation design for... ...precision. Produce detailed 2D and 3D models using industry-standard tools (SolidWorks, Fusion 360, Onshape, Inventor, Creo, NX) and...Part-timeRemote
micro1
Remote19 days ago - ...worked the fuel cycle itself — enrichment, reprocessing, fabrication, criticality safety — and who know which parameters are routine engineering and which ones only matter to someone going somewhere else with them. What matters most is being able to tell a routine...Part-time
Mercor
Remote18 days ago - ...experience): Safeguards Analyst / IAEA or Euratom Inspector — material accountancy, inspection regimes, Additional Protocol. Nuclear Engineer, Fuel Cycle — enrichment, reprocessing and criticality, end to end. Nuclear Security Engineer (national laboratory) — MPC&A,...
Mercor
Remote18 days ago - ...AfterQuery is seeking Industrial Engineering Experts to create and refine engineering and operations challenges for our AI training modules. In this remote, flexible role, you will design and evaluate industrial engineering scenarios that test the AI's ability to interpret...RemoteFlexible hours
AfterQuery
Remote18 days ago - £59k - £77k per annumEstimated...performance across the wider team Experience Required Strong background in strategic procurement and category management within engineering, industrial, manufacturing, utilities, infrastructure, or energy environments Experience across categories such as industrial...Remote jobPermanentFlexible hours
- £43k - £55k per annumEstimated...GE HealthCare seeks a Field Service Engineer to provide onsite technical support for nuclear medicine, CT, and PET imaging equipment across Scotland. The role involves troubleshooting medical devices, collaborating with internal teams, and ensuring customer satisfaction....Remote
$50 - $60 per hour
...– $60/hour Commitment: Hourly, ~40 h/week Field: Other Engineering Role Overview: Mercor is looking for industrial and manufacturing... ...using spreadsheets, CAD, process-mapping, or statistical tools Currently pursuing or recently completed Masters studies, or...Hourly payFull-timePart-timeInternshipImmediate startMercor
Remote3 days ago£75k - £100k per annum
...solely focused on innovation, they're on a mission to make a difference, change the world, and that's where you come in! As a Production Engineer, you'll be at the forefront of their new groundbreaking project, using cutting-edge technology to revolutionise customer...Remote jobPermanent£55k - £70k per annum
...Make a positive difference, your engineering skills will contribute to decarbonisation. The mission is simple, net zero as soon as possible. There is only one planet so it is time to make that transition towards greener energy and a more sustainable way of living. You would...Remote jobPermanentImmediate startShift work£90k - £100k per annum
...Google cloud is essential here, you’ll utilise the suite of AI tooling within it to build out the infrastructure that supports an innovative... .... Other tooling is broad, there is a belief that as a senior engineer you will be able to learn and pick up what is required. You...Remote jobPermanentImmediate start£85k - £95k per annum
...build an AI solution, through the construction of a brand new platform that responds to customer enquiries. Therefore, a Production Engineer is sought after to spearhead the development of robust infrastructure. Your role involves utilising infrastructure as code to create...Remote jobPermanent$40 - $125 per hour
...Weekly Overview We’re looking for an experienced Validation Engineer to help train AI models. You’ll write hard, verifiable... ...aerospace, HVAC, robotics, energy, or related fields. ~ Fluency in the tools of your specialty, such as CAD (SolidWorks, Fusion 360, Onshape,...Weekly payFull-timeRemoteFlexible hoursDataAnnotation
Remote13 days ago- £41k - £54k per annumEstimated...Cencora seeks a Project Engineer to support warehouse automation and distribution facility engineering projects. The role involves designing, building, and improving material handling systems, operational processes, and facilities through cross-functional collaboration with...
- £65k - £85k per annumEstimated...and Services industry is looking for a Senior DevOps / Automation Engineer (IBM Z & Hybrid Platform) to lead automation and DevOps... ..., and artefact management through Nexus Repository or equivalent tools. - Design and optimise PostgreSQL schemas, queries, and automation...Full-timeHybrid workingRemoteFlexible hours
- £62k - £81k per annumEstimated...as one of the World’s Best Management Consulting Firms. Our Technology team are looking for an experienced Infrastructure Operations Engineer to join the team. Baringa’s TeCy Group (Technology & Cyber) is a global function supporting the firm as it enters new markets. We’re...Full-time
$60 - $120 per hour
...pay Required Skills Python Mechanical Engineering About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as...Part-timeImmediate startRemoteFlexible hoursmicro1
Remote5 days ago$70 per hour
...Pay: up to $70/hour In this hourly, remote contractor role, you will review AI-generated engineering solutions and/or generate expert Mechanical Engineering content, evaluating reasoning quality and step-by-step problem-solving while providing crisp written feedback. You...Hourly payRemoteSuperAnnotate
Remote15 days ago$80 - $105 per hour
...About the Role We are looking for mechanical engineering experts to help train and evaluate AI models. You will create realistic problems... ...and specifications. Working knowledge of engineering analysis tools (for example CAD, FEA or CFD). Excellent written English....Hourly payRemoteRemoExperts
Remote18 days ago- ...AfterQuery is seeking Mechanical Engineering Experts to create and refine engineering challenges for our AI training modules. In this remote, flexible role, you will design and evaluate mechanical engineering scenarios that test the AI's ability to interpret and apply complex...RemoteFlexible hours
AfterQuery
Remote18 days ago - ...Mechanism & kinematic sense GD&T & tolerance judgment CAD tools expertise About micro1 micro1 is the leading AI data lab for... ...knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise into high...Part-timeRemote
micro1
Remote19 days ago $70 - $125 per hour
...Pay: $70 – $125/hour Commitment: Part time, ~40 h/week Field: Other Engineering The research teams behind the best-known AI models come to Mercor for mechanical engineering judgment they can't generate on their own. Your standards and expertise become the rubric...Odd jobPart-timeMercor
Remotea month ago$100 - $120 per hour
...120/hour Commitment: Part time, ~40 h/week Field: Other Engineering Mercor is seeking experienced Mechanical Engineers to support... ...and validating physical hardware , using relevant engineering tools such as CAD/CAE, FEA, CFD/thermal simulation, dynamic or controls...Part-timeRemoteFlexible hoursMercor
Remote25 days ago$159k - $215k per annum
...solve. We are standing up a dedicated Automation Intelligence engineering team to own that problem end to end: detection in the browser,... ...— and using that data to prioritize Hands-on with AI coding tools: You use AI coding agents in your own work, have opinions about...Full-timeVisa sponsorshipRemoteWork from home- £70k - £89k per annumEstimated...all applications and next steps. Our partner is looking for an Engineering Manager, Automation Intelligence based in United Kingdom. Lead the... ...: Lead an agent-first development workflow in which AI tools support specification, coding, review, and security checks, with...Full-timeRemote
- £52k - £68k per annumEstimatedYour in depth Bare Metal experience is required, joining a largely remote team. This is a long-term contract that will extend multiple times. This organisation is known country-wide, and based in the North of England. The role can be fully remote, however, if you're Manchester...Remote jobLong-term contractPermanentOn-site
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tooling Engineer. Be the first to apply!
