AI Evaluation Engineer

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in South Africa. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably, safely, and efficiently. You will develop automated testing systems for complex reasoning, multi-turn conversations, and agent interactions …