🦙

Ollama

LLMs

Simple local LLM runtime with a clean developer experience.

162kstars13kforksGo

About

Ollama lets you run, version, and distribute LLMs locally using a simple CLI and Modelfile format. It abstracts hardware acceleration and model configuration behind an OpenAI-compatible REST API and remains the default on-ramp for local inference.

Key Features

Local models
REST API
Modelfiles
GPU support

Related Resources

🦜

LangChain

Framework for building LLM-powered applications using composable primitives.

🦙

llama.cpp

Run LLaMA-class models efficiently on consumer hardware.

⚡

vLLM

High-throughput, memory-efficient LLM serving engine.