hackajob is collaborating with Mercor to connect them with exceptional professionals for this role.
Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages. ## Job Responsibilities ### Evaluate Internet-Native Communication – Analyse content from French- and English-speaking online communities. – Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity. – Identify errors involving slang, memes, cultural references, sarcasm, and code-switching. ### Develop Evaluation Standards – Build evaluation rubrics for bilingual internet communication. – Define expectations for culturally appropriate and platform-native language. – Document linguistic and cultural edge cases. ### Conduct Model Testing and Feedback – Test language models using real-world bilingual prompts. – Evaluate outputs in English and French. – Provide detailed feedback to improve performance. ### Support Quality Assurance – Participate in QA reviews and benchmark creation. – Ensure consistency across evaluators and datasets. ## Minimum Qualifications – Native or near-native fluency in French and professional fluency in English. – Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions. – Active participation in internet culture across both languages. – Strong writing, analytical, and critical thinking skills. – Available to commit 10–20 hours per week. ## Preferred Qualifications – Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation. – Familiarity with differences between European French, Québec French, and other French varieties. – Experience evaluating online content and internet-native communication. – Interest in AI and multilingual language technologies. #LI-DNI