[Job - 31995] Senior Software Developer

Requisitos

• Solid backend development experience (Kotlin/Java, Node.js)
• Knowledge of LLMs and generative AI applications
• Knowledge of integrating and operating models via providers such as Azure OpenAI, Azure AI Foundry, AWS Bedrock, GCP Vertex AI
• Knowledge of LLM routing, load balancing, fallback, streaming, token management and prompt caching
• Knowledge of PostgreSQL and/or MongoDB

Desejáveis

• Hands-on experience with LiteLLM, including Router, deployments, callbacks, customizations and proxy configuration
• Experience with Azure AI Foundry, AWS Bedrock and GCP Vertex AI in production scenarios
• Experience with AI Gateway / LLM Gateway / Model Gateway architectures
• Knowledge of LLM observability, including Langfuse, OpenTelemetry, Prometheus, Grafana
• Experience with LangChain, LangGraph, Semantic Kernel or similar frameworks