🔀

LiteLLM

LLMs

Unified API interface for 100+ LLM providers.

20kstars2.5kforksPython

About

LiteLLM provides a single OpenAI-compatible interface for calling models from Anthropic, Cohere, Azure, Hugging Face, and many more — with built-in cost tracking, fallbacks, and load balancing.

Key Features

Provider abstraction
Cost tracking
Fallbacks
Load balancing

Related Resources

🦜

LangChain

Framework for building LLM-powered applications using composable primitives.

🦙

llama.cpp

Run LLaMA-class models efficiently on consumer hardware.

🦙

Ollama

Simple local LLM runtime with a clean developer experience.