Senior ML Engineer | Kimchi (Inference Stack Optimization)

Requisitos

• 5+ years building real ML systems with depth in inference or training infrastructure
• Production-grade Python: services, not scripts
• Hands-on experience running vLLM, SGLang, or TensorRT-LLM and understanding engine performance on GPUs
• Has measured quantization regressions, not just compression ratios
• Multi-GPU and multi-node experience: tensor/expert parallelism, collective communication, failure modes

Desejáveis

• LLM routing experience: RouterBench-class evals, cost/quality/latency Pareto fronts
• Calibration, abstention, or conformal methods in production decision systems
• Ran online A/B loops with drift monitoring on a model touching real money