Location
toronto
Job Type
Full-time
Posted
June 04, 2026
Job Description
Lead the charge in building next-gen AI systems as a Senior Quality Engineer. Design evaluation frameworks and ensure high-quality responses with a focus on automation and testing efficiency.
This role requires 6+ years of experience in software engineering, emphasizing testing infrastructure and ML evaluation. Shape evaluation standards while collaborating with product teams to translate quality criteria into measurable tests. Your contributions ensure that generative AI delivers accurate, relevant, and grounded responses in a groundbreaking technology environment.
Key Responsibilities:
• Design and build evaluation infrastructure for AI systems
• Create automated test suites for validating answer quality
• Develop systems for regression detection of quality issues
• Establish frameworks measuring response accuracy and citation correctness
• Monitor operational efficiency of AI execution processes
Requirements:
• 6+ years in software engineering with focus o...
This role requires 6+ years of experience in software engineering, emphasizing testing infrastructure and ML evaluation. Shape evaluation standards while collaborating with product teams to translate quality criteria into measurable tests. Your contributions ensure that generative AI delivers accurate, relevant, and grounded responses in a groundbreaking technology environment.
Key Responsibilities:
• Design and build evaluation infrastructure for AI systems
• Create automated test suites for validating answer quality
• Develop systems for regression detection of quality issues
• Establish frameworks measuring response accuracy and citation correctness
• Monitor operational efficiency of AI execution processes
Requirements:
• 6+ years in software engineering with focus o...
Ready to Apply?
Submit your application for Innovative AI Quality Engineer Driving Evaluation Infrastructure Development at IDC
Apply Now