LLM Inference Optimization Engineer (GPU)

Rakuten Asia Pte Ltd in Singapore invites an experienced LLM Inference Optimization Engineer to join our AI & Data Division. You will optimize large-scale inference workloads on GPU clusters, implement quantization and caching strategies, and collaborate with global teams to maximize throughput and minimize latency. You will work with vLLM, TensorRT-LLM, Triton, and custom kernels on NVIDIA hardware, while profiling performance and driving SLO-aligned improvements in a fast-paced, international…