LLM Agent Reliability & Evaluation Engineer

SHOPEE IP SINGAPORE PRIVATE LIMITED is seeking a specialist to design and own the evaluation framework for LLM Agents, including benchmarks and human-annotated judgments, with continuous monitoring to guide optimization. You will lead reliability analyses over multi-step agent trajectories, drive evaluation-driven optimization (Harness design, tool calling, context engineering, memory), and oversee post-training in SFT/DPO/RL with data pipelines and reward models, plus RAG systems and tool-laye…