Job Description

This role offers a unique opportunity for native French speakers from Canada, Belgium, Switzerland, or France to engage in a high-impact AI research project. As a Bilingual French Generalist Evaluator Expert, you will create and evaluate French/English prompt–golden answer pairs that are essential for training advanced language models.

Ideal candidates will possess exceptional writing skills and a deep understanding of local language usage, tone, and cultural context, including regional distinctions in French. This flexible, short-term position is perfect for professionals who excel at distilling complex concepts into clear, culturally relevant French text while ensuring technical precision in English.

• Multilingual Prompt Design & Optimization: Create detailed prompts in French and/or English, ensuring natural phrasing and relevance for users in Canada, Belgium, Switzerland, and France.
• Define and Document Evaluation Standards: Establish expectations for correct responses in consumer contexts and develop comprehensive rubrics that reflect linguistic nuance and cultural conventions.
• Model Testing and Grading (Bilingual): Assess model outputs for accuracy, fluency, and cultural fit in French, comparing results against English as needed.
• Benchmarking & Quality Assurance: Collaborate in QA processes to ensure prompt tasks and rubrics maintain consistency and reliability across French-language benchmarks.

• Native-level fluency in French (written), specific to Canada, Belgium, Switzerland, or France, with strong reading/writing ability in English.
• Must be native to Canada, Belgium, Switzerland, or France and have lived in or spent significant time in the country.
• BS or BA from a reputable institution (completed or in progress).
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.
• Familiarity with ChatGPT or similar tools.
• Based in Canada, Belgium, Switzerland, or France, or able to produce culturally accurate French aligned with one of these regions.

• Experience in teaching, research, editing, or academic writing.
• Experience creating evaluation criteria, rubrics, or grading guidelines.
• Familiarity with LLMs, prompting, or model evaluation (helpful but not required).

Contributors are expected to commit at least 20 hours per week for approximately 2–4 months.

• Complete an AI-led interview (about 15 minutes).
• If approved, complete a paid assessment focused on writing and rubric creation.
• If selected, you will be invited to work on the project.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Job Tags

Similar Jobs