Back to Resources
🎯

Guidance

LLMs

Constrained generation and structured output for LLMs.

19kstars1.3kforksPython
View on GitHub

About

Guidance allows precise control over LLM outputs using a templating language that interleaves generation with constraints, conditionals, and tool calls.

Key Features

  • Structured output
  • Constrained decoding
  • Templates
  • Tool calls

Tags

Structured outputJSONConstrained generation

Related Resources

🦜

LangChain

Framework for building LLM-powered applications using composable primitives.

🦙

llama.cpp

Run LLaMA-class models efficiently on consumer hardware.

🦙

Ollama

Simple local LLM runtime with a clean developer experience.