Mercor - 274 Jobs
Toronto, ON
Posted today
Job Details:
Remote
$25.00 - $37.00 / hour
Full-time
Entry Level
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Bilingual French Generalist Evaluator Expert
Type: Contract
Compensation: $25–$37/hour
Location: Remote
Duration: 2–4 months
Commitment: 20+ hours/week
Role Responsibilities
- Develop detailed prompts in French and/or English for Canada, Belgium, Switzerland, and France. Ensure natural phrasing and real-world relevance.
- Establish high-level expectations for correct responses. Develop rubrics that account for linguistic nuance and cultural conventions.
- Run prompts through models. Assess outputs for accuracy, fluency, and cultural fit in French, comparing with English.
- Collaborate in QA review processes. Ensure prompt tasks and rubrics meet rigor and consistency across French-language benchmarks.
Qualifications
Must-Have
- Native-level fluency in French (written) specific to Canada, Belgium, Switzerland, or France. Strong reading/writing ability in English.
- Must be native to Canada, Belgium, Switzerland, or France. Deep cultural and linguistic familiarity.
- BS or BA from a reputable institution (completed or in progress).
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
- Familiarity with ChatGPT or similar tools.
Preferred
- Experience in teaching, research, editing, or academic writing.
- Experience creating evaluation criteria, rubrics, or grading guidelines.
- Familiarity with LLMs, prompting, or model evaluation.
Application Process (Takes 20–30 mins to complete)
- Complete an AI-led interview (about 15 minutes).
- If approved, complete a paid assessment focused on writing and rubric creation.
- If selected, you will be invited to work on the project.
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: [email protected]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Share This Job:
Frequently Asked Questions
This is a contract role lasting 2–4 months with a commitment of 20+ hours per week.
Candidates must have native-level written fluency in French and be native to Canada, Belgium, Switzerland, or France, with strong English reading/writing ability.
The position is remote and offers $25.00–$37.00 per hour.
You will develop prompts in French and/or English for several regions, establish rubrics, run prompts through models, and assess outputs for accuracy, fluency, and cultural fit in French vs English.
A BS or BA (completed or in progress), native-level French, strong English, independent work ability, and familiarity with ChatGPT or similar tools.
The process includes an AI-led interview, a paid assessment focused on writing and rubric creation, then an invitation to work on the project if selected.
Preferred qualifications include experience creating evaluation criteria, rubrics, or grading guidelines, and familiarity with LLMs, prompting, or model evaluation.
