Job Description:
Language: Dutch (C1/C2 proficiency) and English (C level)
As a Language Expert, you will be a key member of the Language Experts group, responsible for monitoring and evaluating the quality of multimodal Large Language Models (LLMs) for your assigned locale. You will assess how effectively the model understands user requests, generates relevant and accurate responses, and communicates information clearly and naturally.
Your responsibilities will include creating prompts, testing the model, evaluating responses, providing detailed feedback, rewriting prompt-response pairs, and reviewing the work of other evaluators. You will collaborate with cross-locale teams to identify improvements, share insights, and help enhance AI model quality.
Key Responsibilities
- Evaluate and rate complex prompt-response pairs.
- Design prompts and test AI model performance.
- Localize and adapt AI interactions to reflect cultural and linguistic nuances.
- Perform quality checks and rewrite prompt-response pairs where required.
- Analyze evaluation data and identify trends for improvement.
- Develop language-specific evaluation guidelines and ensure evaluation quality.
Qualifications
- Bachelor’s degree in Linguistics or a related field.
- Native-level fluency in the target language.
- Strong understanding of linguistics, syntax, semantics, phonetics, and language analysis.
- Excellent analytical, written, and verbal communication skills in English.
Preferred Skills
- Experience with data annotation, localization, AI evaluation, or computational linguistics.
- Research experience.
- Basic knowledge of Python or Regular Expressions (RegEx) is an advantage.
Main Skills: C1/C2 level language fluency, linguistic analysis, cultural localization, prompt engineering, AI model evaluation, multimodal prompt-response rating, quality control, rewriting, data annotation, evaluation guideline development, analytical thinking, research, data analysis, written communication, verbal communication, cross-locale collaboration, and computational linguistics.
#LI-DNI