AI Quality Engineer

Job Description Key Responsibilities • Design and implement evaluation frameworks (evals) to assess LLM and agentic AI system quality, including accuracy, consistency, safety, and task completion rates. • Build and maintain automated test pipelines for AI features, covering unit, integration, and end-to-end scenarios across agentic workflows. • Develop tooling to detect regressions in model behavior, prompt outputs, and agent decision-making across releases. • Define and track quality metrics f…