Thomson Reuters fournit des services d’information et des logiciels professionnels. Son portail Workday publie les recrutements de son entité à Zoug.
Senior Research Engineer, Model Evaluations
Vous concevrez et développerez des outils d’évaluation pour les modèles de langage de Thomson Reuters, notamment pour des usages juridiques et professionnels complexes. Vous contribuerez à la mise à l’échelle et à l’optimisation de ces évaluations, ainsi qu’au déploiement des nouveaux modèles. Le poste est basé à Zug et propose un mode de travail hybride.
3× plus de chances d’entretien avec un cold email
Voir l’offre originaleRepères sur Thomson Reuters
- Domaine officiel
- thomsonreuters.com
- Offres ouvertes
- 9
Détails de l’offre
La description complète publiée par Thomson Reuters.
Job Description
Thomson Reuters Labs builds and ships custom models for professional workflows requiring fiduciary-grade AI. The Thomson LLM family was developed by training leading open-weight models on decades of authoritative Thomson Reuters content, with thousands of hours of subject-matter-expert input. Owning the model layer is how we earn trust in the most regulated, highest-stakes professional workflows. See the detailed technical report for more information on the latest model release: Thomson 1.0 Technical Report on Hugging Face.
The evaluation team focuses on providing signal for model development and adoption using a combination of benchmarks and targeted evaluations to assess performance on highly complex legal and professional workflows. The team works with legal experts to adapt their expertise into benchmarks and with product leaders to ensure model capabilities are aligned with real, user-facing flows in professional work.
As a research engineer on the team, you would be working with researchers to design, develop, optimize and scale the evaluation suite as Thomson scales to newer releases and product integrations. You’ll work in cutting edge areas of AI development, such as multi-agent systems and decision models to keep the Thomson model suite at the frontier of specialized professional LLMs.
Key Responsibilities
- Build and operate the evaluation suite that runs Thomson evaluations
- Design and develop the platform to scale as the scale of evaluations grow
- Implement and tune optimization techniques to reduce cost and latency without sacrificing quality.
- Contribute to the work needed for a production footing: contribute to the team’s ISO 27001 compliance path
- Work directly with the evaluation pod to get new model releases evaluated and live on the leaderboard.
Required Qualifications
Hands-on research engineering experience in evaluations
- with examples of building, scaling and optimizing evaluations suites and what impact your work had
- Experience working closely with researchers and cross-functional stakeholders to translate research ideas and requirements into scalable systems
- Experience ensuring research systems reliability and scaling
- Familiarity with current developments in LLMs
- with an understanding of how to design systems flexible enough to handle new innovations Preferred
Qualifications
Familiarity with common evaluation frameworks like Inspect, Harbor, lm-evaluation-harness
- Familiarity with AI-assisted coding and with leveraging coding agents at scale to accelerate work Even if you don’t have all the above requirements, we encourage you to apply to explore a mutual fit! #LI-FP3 What’s in it For You?
- Hybrid
- Work Model: We’ve adopted a flexible hybrid working environment for our office-based roles while delivering a seamless experience that is digitally and physically connected.
- Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
- Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
- Industry Competitive
Benefits
We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing. - Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more.
We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together. - Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives. - Making a Real-World Impact: We are one of the few companies globally that helps its customers pursue justice, truth, and transparency.
Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world. DISCLAIMER The above information in this description has been designed to indicate the general nature and level of work performed by employees within this classification. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of employees assigned to this job.
About Us
Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news.
We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward. As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals.
To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace.
We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law. More information on requesting an accommodation here. Learn more on how to protect yourself from fraudulent job postings here. More information about Thomson Reuters can be found on thomsonreuters.com
Prérequis
- Hands-on research engineering experience in evaluations
- Experience building, scaling, and optimizing evaluation suites
- Experience working closely with researchers and cross-functional stakeholders
- Experience ensuring research systems reliability and scaling
- Familiarity with current developments in LLMs
- Familiarity with evaluation frameworks like Inspect, Harbor, lm-evaluation-harness
- Familiarity with AI-assisted coding and coding agents
Avantages mentionnés
- Flexible hybrid working environment
- Flexible work arrangements, including work from anywhere for up to 8 weeks per year
- Flexible vacation
- Two company-wide Mental Health Days off
- Access to the Headspace app
- Retirement savings
- Tuition reimbursement
- Employee incentive programs
- Resources for mental, physical, and financial wellbeing
- Two paid volunteer days off annually
3× plus de chances d’entretien avec un cold email
Candidater à cette offre
Comment candidater ?
L’offre est publiée sur le site de Thomson Reuters. Ouvrez l’offre originale ↗ pour y déposer votre candidature. Screeningpass ne remplit pas de formulaire à votre place.
À qui écrire chez Thomson Reuters pour ce poste ?
Lancez une recherche de contact depuis cette page. Screeningpass vous propose jusqu’à trois personnes liées au poste. Vous choisissez celle à qui écrire, puis Screeningpass cherche son email professionnel et prépare un message. Vous le relisez et l’envoyez vous-même avec Gmail. Une adresse email n’est pas toujours disponible, et une réponse n’est jamais garantie.
Combien coûte la recherche d’un contact ?
Une recherche coûte 1 crédit. Le crédit vous est rendu si la recherche échoue. L’inscription offre 3 crédits, soit 3 recherches.
À quoi sert Screeningpass ?
Screeningpass rassemble des offres de stage, d’alternance et d’emploi publiées par les entreprises. Pour une offre, Screeningpass trouve une personne à contacter dans l’entreprise, cherche son email professionnel et prépare un message à partir de votre CV. Voir le fonctionnement en détail.