Back to Resources

🧪

promptfoo

Evaluation

Test and evaluate LLM outputs with CI/CD integration.

5kstars400forksTypeScript

View on GitHub Visit Website

About

promptfoo is a developer tool for testing prompts, comparing models, and catching regressions in LLM-powered features using a YAML-based test suite.

Key Features

Prompt testing
Model comparison
CI/CD
Red teaming

Tags

EvaluationTestingCI/CDPrompt engineering

Related Resources

RAGAS

Evaluation framework for RAG pipelines.

LM Evaluation Harness

Unified framework for evaluating language models on benchmarks.