About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: English Language and Literature Expert
Type: Contract
Compensation: $50/hour
Location: Remote
Role Responsibilities
- Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
- Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
- Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
- Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance .
- Provide detailed linguistic feedback and analysis to guide ongoing model training efforts .
Qualifications
Must-Have
- Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
- Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
- Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
- Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
- Strong attention to detail, analytical judgment, and written communication skills.
- Ability to work independently in a distributed, remote environment .
Preferred
- Interest in AI and LLM-driven language technologies .
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the English Linguistic Expert - Evaluator in London vacancy
$50 per hour
...and Jack Dorsey . Position: English Language and Literature Expert Type: Contract Compensation... ...Role Responsibilities Evaluate the quality and accuracy of LLM-... ...rewrite English content to meet high linguistic, stylistic, and cultural standards....English languageRemote jobSummer workMercor
London24 days ago$39 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - English (UK/Australia) Type: Contract Compensation:... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics, voice generation, and other...English languageRemote jobSummer workImmediate startMercor
Londonmore than 2 months ago$50 - $70 per hour
...Jack Dorsey . Position: Generalist Expert (UK/Europe) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar... ...comprehension and written communication in English Strong attention to detail and sound...English languageRemote jobSummer workMercor
Londona month ago$14 - $42 per hour
...Dorsey . Position: Music & Lyrics Expert - Urdu Type: Contract Compensation... .../week Role Responsibilities Evaluate AI-generated music across various genres... ...follow detailed written instructions in English . Experience as a songwriter,...English languageRemote jobSummer workImmediate startMercor
Londonmore than 2 months ago$17 - $42 per hour
...Dorsey . Position: Music & Lyrics Expert - Greek Type: Contract Compensation... ...prompt adherence, and originality. Evaluate whether lyrics sound natural, including... ...follow detailed written instructions in English . Experience as a songwriter,...English languageRemote jobSummer workImmediate startMercor
Londonmore than 2 months ago$60 - $70 per hour
...hour Location: Remote Role Responsibilities Evaluate AI-generated responses for safety, factual accuracy, policy... ...research, security, or a related field. ~ Excellent written English , critical thinking, and analytical reasoning skills. ~ Ability...English languageRemote jobSummer workMercor
Londonmore than 2 months ago$20 - $36 per hour
...Dorsey . Position: Music Production Expert - Hungarian Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across genres for... ...follow detailed written instructions in English. ~2+ years of experience as a music...English languageRemote jobSummer workImmediate startMercor
Londonmore than 2 months ago- £41k - £53k per annumEstimated...Job Title: British English Voice Expert Job Type: Contract Location: Remote World Wide... ...support an AI training project focused on evaluating English audio recordings. You will... ...or sound production. Experience in linguistics, phonetics, language teaching, media,...English languageRemote job
- £38k - £49k per annumEstimated...Italian Bilingual Expert Job Type: Contractor Location: Remote... ...generation. In this role, you will evaluate Italian audio content, assess linguistic quality and authenticity, and provide... ...Strong Italian language proficiency, English communication skills, and attention...English languageRemote job
$24 - $30 per hour
.... Position: AI Session Annotator (English) Type: Contract Compensation... ...timing, and spatial language use. Evaluate if the assistant appropriately warned users... ...Experience in data annotation, linguistic QA, content moderation, or AI model evaluation...English languageRemote jobSummer workImmediate startMercor
Londona month ago$18 per hour
...British English AI Product Evaluator The Project Productive Playhouse is building a talent pool of... ...What We're Looking For ~ Native or expert-level fluency in English, as spoken in... ...Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes...English languageHourly payFreelanceFlexible hours- £38k - £50k per annumEstimated...Job Title: Korean Language Expert Role Type: Contractor Location... ...Experts to contribute their linguistic knowledge and bilingual... ...systems. In this role, you will evaluate, create, translate, and annotate... ...content between Korean and English , prioritizing contextual meaning...English languageRemote job
$160 per hour
...rubric we provide. Submit concise written feedback for every evaluation. Work independently to meet deadlines while ensuring high... ...matters. ~ Sharp attention to detail and precise written English. ~ Able to work independently to a rubric and to deadlines....English languageRemote jobSummer workMercor
Londona month ago$18 - $50 per hour
.... As a Human-AI Interaction (HAI) & UX Expert , you are the architect of the user experience... ...Accessibility & Inclusivity Design: Evaluate how models handle diverse speech patterns... ..."vibe" and natural flow of dialogue. English Proficiency: Minimum B1 (Intermediate...English languageHourly payPart-timeRemoteFlexible hours$120 per hour
...and Jack Dorsey . Position: Legal Expert — Disputes & International (Project Donna... ...hours Role Responsibilities Evaluate AI-generated legal content in disputes... ...completeness, and usefulness. Precise written English skills. Able to work independently...English languageRemote jobSummer workMercor
Londona month ago$38 per hour
...Overview Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for English-speaking experts to join our team. What you will do: Identify realistic search-related failures...English languageRemote jobHourly payFreelanceImmediate startWelocalize
London7 days ago$80 - $110 per hour
...Commitment: 10 hours/week Role Responsibilities Evaluate research-level physics problems in stochastic autocatalytic growth... ...with LaTeX , Python , SymPy , and Jupyter . English at B2 or above , including written reasoning. Preferred...English languageRemote jobSummer workMercor
London25 days ago$80 - $110 per hour
...Commitment: 10 hours/week Role Responsibilities Evaluate research-level physics problems in your subfield to enhance AI... ...proficiency with LaTeX , Python , SymPy , and Jupyter . English at B2 or above , including written reasoning. Application...English languageRemote jobSummer workMercor
London7 days ago$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation... .... ~ Proficiency in both Punjabi and English. ~ Experience writing lyrical music...English languageRemote jobSummer workImmediate startMercor
Londonmore than 2 months ago$80 - $110 per hour
...Commitment: 10 hours/week Role Responsibilities Evaluate AI model training and improve model outputs in research-level... ...Proficiency in LaTeX , Python , SymPy , and Jupyter . English at B2 or above , including written reasoning. Preferred...English languageRemote jobSummer workMercor
London25 days ago- £36k - £48k per annumEstimated...estimated 20 hrs/week. Please submit all resumes or CVs in English. Brand: TripleTen What you will do: Design and build... ..., and difficulty calibration across the course. Research, evaluate, and sign off on technical solutions and tooling so the curriculum...English languageOn-siteRemote
$13 per hour
...Jack Dorsey . Position: Music Audio Expert - Hindi Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...Understand and follow directions in the English language for accurate assessments....English languageRemote jobSummer workImmediate startMercor
Londonmore than 2 months ago$105 - $140 per unit
...: Football (Soccer) Fan – Live Match AI Evaluator (UK & Spain) Type: Contract... ...questions about live scores, player stats, and expert analysis. Run questions on two AI... ...the United Kingdom or Spain. Native English or Spanish speaker. Strong written English...English languageRemote jobSummer workFlexible hoursMercor
London14 days ago$90 per hour
...read a page's scripts and understand their DOM impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience....English languageRemote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour... ...Education / school . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...Humanities / arts / culture . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google...Remote jobSummer workMercor
Londonmore than 2 months ago$80 - $120 per hour
...customer research and feedback synthesis Evaluator Type: Contract Compensation... .... Collaborate with subject matter experts to ensure consistency and quality across... ...~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Jack Dorsey . Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation: $80–$120/hour... .../ revenue economics . ~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office and Google Workspace...Remote jobSummer workMercor
Londona month ago$80 - $120 per hour
...Position: Humanities / arts / culture Evaluator Type: Contract Compensation... .... Collaborate with subject matter experts to ensure consistency and quality.... ...~ Native or professional fluency in English . ~ Highly proficient in Microsoft Office...Remote jobSummer workMercor
Londona month ago- £48k - £62k per annumEstimated...Financial Systems & Accounting Expert Role Type: Contractor Location: Remote,... ...judgment and financial systems expertise to evaluate and improve AI-generated outputs and... ...required. ~ Strong written and verbal English communication skills ( B2 level or above...English languageRemote jobImmediate startFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to English Linguistic Expert - Evaluator. Be the first to apply!
