Senior Software Engineer, AI Evaluation and Coding Agents

Role Overview Help improve AI coding agents by reviewing their work across real-world software repositories. You will assess whether an agent understands a task, selects an appropriate approach, and produces code that is correct, robust, and maintainable. Your technical judgment and precise feedback will help create the evaluation signals used to strengthen model performance. Key Responsibilities Design, refine, and iterate on rubrics and evaluation criteria for preference data. Review and labe…