Description
LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services, and we're looking for a Backend Engineer (New Grad) to help us build rock-solid guardrails and observability tooling at scale.
Company
LiteLLM is a platform that simplifies model access, spend tracking, and fallbacks across 100+ LLMs. It enables platform teams to grant developers access to multiple models via an OpenAI-compatible interface, while automatically attributing costs, enforcing budgets and rate limits, and logging activity for observability. It supports cloud and on-prem deployments, and offers Open Source and Enterprise options with features such as guardrails, prompt management, and logging to S3/GCS. Netflix and Lemonade have publicly cited using LiteLLM to provide Day 0 access to new models.
Related postings
Cohere
Senior Security EngineerNew York, NY, USA and 4 othersGridware
Senior Security EngineerSan Francisco, CA, USAMetriport
Senior Security EngineerSan Francisco, CA, USASemgrep
Senior Security EngineerNew York, NY, USA and 3 others