At TELUS Digital, we help the world’s leading organizations build safer, smarter, and more reliable AI systems. As a GenAI Multilingual Specialist — LLM/VLM Evaluation & SFT Expert, you will support the development and evaluation of next-generation Large Language Models (LLMs) and Vision-Language Models (VLMs).
Your role is to act as the “human reasoning layer” behind AI systems by evaluating multilingual AI-generated content for factual accuracy, logical consistency, instruction adherence, and cultural relevance. You will work across multilingual Supervised Fine-Tuning (SFT), rubric-based scoring, fact verification, and multimodal (image + text) evaluation workflows.
Responsibilities
- Evaluate AI Outputs
- Review AI-generated responses for quality, reasoning accuracy, factual correctness, and compliance with project guidelines.
- Create and evaluate multilingual Supervised Fine-Tuning (SFT) data to improve AI model performance across multiple languages and domains.
- Perform Multimodal (VLM) Assessment
- Analyze relationships between images and text outputs to evaluate contextual accuracy and multimodal reasoning quality.
- Apply Rubric-Based Scoring
- Assess outputs using structured scoring frameworks and standardized evaluation rubrics.
- Conduct Research & Fact Verification
- Verify claims using authoritative sources and apply citation standards to distinguish factual information from unsupported assertions.
- Escalate Edge Cases
- Identify ambiguous outputs, policy concerns, and reasoning inconsistencies that require escalation or additional review.
- Maintain Operational Accuracy
- Follow complex project SOPs and quality standards consistently across high-volume evaluation workflows.
Qualification path
What You Bring (Mandatory Qualifications):
- Language Expertise: Native or fluent-level proficiency in at least one required language with strong reading and writing ability.
- Analytical Thinking: Ability to evaluate content objectively and identify inconsistencies, logical gaps, or quality issues.
- Attention to Detail: Strong procedural discipline and the ability to follow detailed project guidelines accurately.
- Communication & Reliability: Strong communication skills with the ability to work independently in remote environments.
- Research & Verification Skills: Comfortable conducting fact-checking and validating information using credible and authoritative sources.
- Technical Familiarity: Previous experience in freelance work, translation, writing, annotation, AI data projects, localization, or content evaluation is a plus.
- AI/ML Experience: Prior experience with AI/ML annotation, LLM evaluation, or SFT projects is strongly preferred.
Specialized Knowledge Areas Preferred
Candidates with academic or professional backgrounds in the following areas are highly valued:
- Computer Science
- Biology
- Law
- Finance
- Physics
- Mathematics
- Engineering
Assessment:
In order to be hired into our community, you’ll go through a subject-specific qualification exam that will determine your suitability for the position and complete ID verification.
Why Join the TELUS Digital AI Community:
- Community Connection: Work remotely as part of a 1M+ diverse global AI Community of contributors and experts.
- Impactful Expertise: Use your native language and academic degree to shape real-world AI systems and products used by millions every day.
- Hands-on Innovation: Gain experience in the latest AI research, evaluation, and fine-tuning methodologies.
- Global Collaboration: Collaborate with a network of specialists across 20+ domains and 500+ languages and dialects.
- Flexible Engagement: Manage your own schedule while making a meaningful impact on the future of technology.
#LI-DNI