🔀

LiteLLM

LLMs

Unified API interface for 100+ LLM providers.

15kstars1.7kforksPython

About

LiteLLM provides a single OpenAI-compatible interface for calling models from Anthropic, Cohere, Azure, Hugging Face, and many more, with built-in cost tracking and fallbacks.

Key Features

Provider abstraction
Cost tracking
Fallbacks
Load balancing

Related Resources

🦜

LangChain

Framework for building LLM-powered applications using composable primitives.

🦙

llama.cpp

Run LLaMA-class models efficiently on consumer hardware.

🦙

Ollama

Simple local LLM runtime with a clean developer experience.