Content Evaluator - Customer Support - LLM Benchmarking

This role focuses on evaluating and improving the performance of large language models (LLMs) through customer support simulations and benchmarking exercises. The ideal candidate will possess strong analytical skills, attention to detail, and a passion for ensuring high-quality AI outputs.

Key Responsibilities:

Evaluate LLM responses based on predefined criteria.
Identify areas for improvement in LLM performance.
Provide feedback to enhance LLM accuracy and relevance.
Conduct benchmarking tests to assess LLM capabilities.
Simulate customer support interactions to evaluate LLM effectiveness.
Document evaluation findings and contribute to model refinement.

Requirements/Qualifications:

1 to 3 years of experience in customer support or a related field.
Excellent communication and analytical skills.
Strong attention to detail and ability to identify subtle nuances.
Familiarity with large language models (LLMs) is a plus.
Ability to work independently and as part of a team.
Proficiency in using various software tools and platforms.

About the Company:

Innodata India is a technology-driven organization specializing in data solutions and services. They provide support to businesses across various industries, helping them leverage data for improved decision-making and operational efficiency.