Spanish Audio Specialist - Freelance AI Trainer Project

About this role

<p>A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.</p> <p>Responsibilities</p> <ul> <li>Create and execute <strong>role-play–based evaluation scenarios</strong> that simulate realistic customer service interactions across multiple domains, including:</li> <ul> <li>Flight bookings and travel support</li> <li>Financial services</li> <li>Telecommunications and technical support</li> </ul> <li>Contribute to the development of <strong>diverse and representative datasets</strong> used to assess conversational audio agents.</li> <li>Evaluate model performance across a standardized set of qualitative and quantitative metrics.</li> <li>Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.</li> </ul> <p>Evaluation Metrics</p> <p>Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:</p> <ul> <li><strong>Task completion accuracy</strong> and efficiency</li> <li><strong>Conversational naturalness</strong> (tone, flow, and coherence)</li> <li><strong>Audio comprehension and response quality</strong></li> <li><strong>Instruction adherence and contextual understanding</strong></li> <li><strong>Basic computer programming literacy</strong>, including:</li> <ul> <li>Understanding of <strong>JSON structures</strong></li> <li>Familiarity with <strong>functions and methods</strong></li> <li>Ability to reason about structure