Member of Technical Staff, Inference

Requisitos

• Bachelor's degree or equivalent experience in computer science, engineering, or similar
• Deep understanding of transformer architectures and their variants
• Strong programming skills in Python with experience in PyTorch internals
• Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI)
• Ability to read and implement model architectures and inference techniques from research papers

Desejáveis

• Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving
• Familiarity with RL frameworks and algorithms for LLMs
• Experience with multimodal inference (audio/image/video/text)
• Contributions to open-source ML or system infrastructure projects
• Implemented core features in vLLM or other inference engine projects