About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote
Role Responsibilities
- Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
- Review model-generated implementations involving cloud platforms , Kubernetes , CI/CD systems , observability , and infrastructure automation .
- Identify bugs, edge cases, reliability issues, and failure modes in model outputs.
- Compare outputs from multiple frontier models to assess their strengths and weaknesses.
- Apply professional engineering judgment to realistic infrastructure engineering scenarios.
Qualifications
Must-Have
- 2+ years of professional DevOps , SRE , or Cloud Engineering experience.
- Experience with AWS , Azure , GCP , Kubernetes , Terraform , CI/CD pipelines , or observability tooling.
- Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
- Ability to evaluate model-generated infrastructure and reliability engineering solutions.
Preferred
- Experience supporting production-scale systems.
Compensation & Legal
- $400 per accepted task
- Compensation tied to accepted work.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the DevOps Engineer - AI Model Evaluator in London vacancy
$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type:... ...AI coding agents to complete and evaluate complex infrastructure engineering tasks...SuggestedRemote jobSummer workMercor
Londona month ago- £79k - £105k per annumEstimated...health, performance, video, and AI insights from the locker room... ...ARE PASSIONATE ABOUT PLATFORM ENGINEERING We are looking for a talented and inquisitive Principal DevOps Engineer whose drive for... ...Catapult’s global cloud platform, evaluating emerging technologies (e.g., Serverless...SuggestedLong-term contractHybrid workingOn-siteShift work
- £88k - £117k per annumEstimated...Shape the Future of AI & Data with Us At Datatonic, we are... ...expertise in machine learning, data engineering, and analytics on Google... ...Your Mission As a Senior DevOps Engineer, you will play a key... ...Active, Pure Gym). Hybrid Model: A WFH allowance to keep you...SuggestedFull-timeHybrid workingWork from homeProbationary period
- £71k - £93k per annumEstimated...work they do! Our Product & Engineering Team: Liberis is building... ...is going through an AI-first transformation, rethinking... ...in GitHub Actions and/or Azure DevOps, covering build, test, security... ...decisions on platform tooling: evaluate new tools, write ADRs, and drive...SuggestedHybrid workingOn-site
£100k per annum
...Senior Azure DevOps Engineer A fantastic opportunity for a Senior DevOps Engineer to join a world-leading technology company developing cutting-edge AI-powered cybersecurity solutions. You will join a highly talented R&D function working on the infrastructure and systems...SuggestedLong-term contractFull-timeHybrid workingOn-siteImmediate start- £61k - £81k per annumEstimated...UBDS is seeking a Cloud Engineer with hands-on experience in Microsoft Azure to join our growing Cloud Platforms team. This role is ideal... ...technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to...Full-time
- £62k - £83k per annumEstimated...one of the UK's fastest-growing healthtech companies. Our AI-powered platform, EMMA, is used by hundreds of organisations... .... ABOUT THE ROLE We are looking for a senior Azure DevOps / Infrastructure Engineer to take ownership of our Azure cloud infrastructure. This is...Long-term contractFull-timeImmediate startRemoteFlexible hours
- ...empower businesses to grow and thrive in a competitive landscape. Our AI powered platform streamlines logistics, payments, and supply... ...the future of global trade. The role: As a RedCloud DevOps Engineer you’ll be working on a Cloud native platform which provides B2B...Rotating shifts
£50k - £80k per annum
...DevOps Engineer - Remote in Europe About Opply Opply's AI agents run operations for consumer goods brands - from sourcing to logistics to finance - freeing their... ...an AI matching and forecasting proprietary model 2) AI self learning platform that orders the ingredients...On-siteRemote- £67k - £88k per annumEstimated...sharp as the intelligence it delivers. We are looking for a Senior DevOps Engineer with a strong background in DevOps and extensive hands-on... ...learnings Continuously test, learn and improve Are fluent in AI and agentic workflows Our ideal candidate has production...Full-timeHybrid workingRemoteShift work
Elliptic
London10 days ago - £64k - £85k per annumEstimated...line need technology built to match the threat. Today, Ripjar's AI-native software and data fusion products are used by governments... ...continuous innovation culture. What you’ll be doing: As a DevOps Engineer at Ripjar you will be responsible for ensuring the reliability...Hybrid workingOn-siteRemoteFlexible hours
£70k - £85k per annum
...Engineering and innovation go hand in hand. Without trying, failing, trying again and failing again, trying something new, failing a third time... ...can scale quickly to a sudden increase in demand, even an AI integration. Tooling can change day to day as each challenge will...PermanentPart-timeRemote- £99k - £131k per annumEstimated...Role: Senior Devops Engineer Contract: Permanent Location: London / Greater Oxford Area Working Pattern: Flexible & Hybrid Salary:... ...high-stakes environments in the world defence - national security, AI and robotics. The decisions we make now will define not just how...PermanentFull-timeHybrid workingFlexible hours
- £43k - £56k per annumEstimated...We are Permutable AI – a London based market intelligence company... ...-LLM architectures with deep engineering expertise, we are setting the... ...making. The Role: Senior DevOps Engineer As we embark on... ...re developing cutting-edge AI models, surfacing new market insights...PermanentFull-timeHybrid workingOn-siteImmediate startFlexible hours
£120k - £150k per annum
...You’ll have the chance to stick in this company’s memory as their first DevOps engineer; a rare opportunity to be THE DevOps pioneer / architect / SME / wizard who lays the foundation for a cutting-edge AI accelerator. This start-up is all about combining hardware, software,...Permanent- £45k - £58k per annumEstimated...right process gives every client the right result. The Platform Engineering capability within Digital is a growing team of people dedicated... ...a better place rarely is. About Capgemini Capgemini is an AI-powered global business and technology transformation partner,...PermanentFlexible hours
£120k - £150k per annum
...Not every job lets you build something truly from scratch, but this one does. This London-based AI accelerator is looking for its first-ever DevOps engineer. That means no outdated systems to untangle, no rigid processes to follow—just a blank canvas and the chance to shape...Permanent- ...About Us: ClearRoute is an engineering consultancy bridging Quality... ...support, improve, and modernise the DevOps Toolchain by delivering secure... ..., risk-aware solutions. AI Assisted Engineering Design... ...hand-off driven delivery models, and ensure developers, citizen...Hybrid workingWork from homeShift work
- £67k - £89k per annumEstimated...DevOps Engineer — Bazel Monorepo Fractile · London or Bristol · Full-time · Hybrid (3 days onsite) About Fractile... ..., and software that will redefine the frontier of AI — running the world's most advanced models at radically higher speed and lower cost. Founded in...Full-timeHybrid workingRemote
- £63k - £82k per annumEstimated...the expertise, technology, and business model of the 21st century’s most innovative companies... ...of systems is powered by Lattice OS, an AI-powered operating system that turns... ...global Maritime and AUKUS missions. As a DevOps Engineer, you will design and implement developer...Full-timeImmediate start
- £48k - £64k per annumEstimated...is looking for an experienced, Security Cleared (SC Cleared) AWS DevOps Engineer to design, build and maintain resilient cloud infrastructure and... ...solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation...Full-time
- £73k - £95k per annumEstimated...data into competitive advantage. Generative AI runs on unstructured data - the most... ...strong product mindset - we encourage our engineering teams to build an understanding of the product... ...the best solutions possible. We’re hiring a DevOps engineer working within our DevOps pod to:...Full-timeRemoteFlexible hours
- £73k - £97k per annumEstimated...Role As a Senior Platform Software Engineer at Humanoid, you will be at the heart of... ...allow high fidelity robotic controls and AI development. You will be responsible for writing... ...across multiple domains. Test & Evaluate Systems: Integrate new systems with our robots...Full-timeOn-site
- £66k - £89k per annumEstimated...abstractions) that standardises data engineering workloads (batch/streaming... ...and safety controls (evaluation pipelines, guardrails, access... ...quality, pipeline reliability, model performance ~ Agent Ops:... ...Experience with CI/CD (Azure DevOps, GitHub Actions) ~ Basic...Full-time
- £60k - £80k per annumEstimated...Enable scalable engineering workflows across our global AI and data platform Are you a Platform Engineer who... ...with AIOps Engineers to improve AI evaluation and operational workflows on Databricks... ...in platform engineering, DevOps or cloud engineering roles ~ Strong...PermanentFull-time
- ...About II Intelligent Internet is building sovereign AI from first principles. Open-source, for everyone. Our... ...Strong Generative AI fluency and comfort writing about models, capabilities, limitations, evaluation, and real-world implications with accuracy. Practical...Full-time
- £96k - £123k per annumEstimated...by advanced technology, data, AI and digital innovation. Clients... ...for an experienced Platform Engineering Manager to join the team.... ...artifacts and drive Cloud and DevOps industry best practices on engineering... ...Privacy Notice , to evaluate your application and meet our...Hybrid workingFlexible hours
- £48k - £64k per annumEstimated...organisations solve complex challenges through strategy, design, engineering, and delivery. We work closely with our clients to deliver... ...management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that...Full-timeFlexible hours
- £78k - £104k per annumEstimatedDevSecOps Engineer Position Description At CGI, we are transforming how organisations deliver... ...and accountability, enabling you to shape DevOps and SRE best practice while driving... ...technology. To support our recruitment team, AI tools may be used to help assess...
- ...About Us ClearRoute is an engineering consultancy bridging Quality Engineering, Cloud... ...to help them build the foundations for AI, from model-serving infrastructure and MLOps pipelines... ...pipelines model training, versioning, evaluation, and promotion to production using platforms...Hybrid working
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DevOps Engineer - AI Model Evaluator. Be the first to apply!
Related searches
- devops platform engineer London
- azure devops engineer London
- devops engineer software engineer aws focused London
- senior devops engineer London
- devops infrastructure engineer London
- devops engineer at bae systems. London
- devops engineer and kubernetes London
- devops engineer at kpmg London
- devops engineer London
- devops engineer azure windows linux powershell bash London