World Wide - Remote•Worldwide - Remote
Remote
Senior
Full Time
about 2 hours ago
💰$6 - $65/hour
freelanceremoteAI evaluationaudio evaluationcontractor
Requirements
- •Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation
- •Native or bilingual proficiency in the target language with fluency in reading, listening, writing, and speaking
- •Strong analytical and verbal communication skills for conducting simulated customer support role-plays
- •Basic computer programming literacy including understanding JSON structures, functions, methods, and simple logic
- •Meticulous, detail-oriented approach to working with structured prompts, complex evaluation rubrics, and technical guidelines
- •Access to a high-quality microphone for clean, reliable audio input
What You'll Do
- •Creating and executing complex, role-play-based evaluation scenarios simulating realistic customer service interactions
- •Evaluating AI model performance across qualitative and quantitative metrics focusing on task completion accuracy, conversational naturalness, and audio comprehension
- •Assessing AI model's programming literacy including understanding JSON structures, functions, methods, and reasoning about structured data
- •Contributing to the development of diverse, high-quality audio datasets reflecting real customer expectations
About Invisible Agency
Clients give us complex business problems and we become their operations, automation, and AI partner to deliver operational breakthroughs.
San Francisco, CA, US
250 - 500
IT Services