🎛️

PEFT

Training & Fine-tuning

Parameter-efficient fine-tuning methods by Hugging Face.

18kstars1.8kforksPython

About

PEFT provides LoRA, Prefix Tuning, IA³, and other methods that reduce the compute and memory cost of adapting large models to new tasks.

Streamlined fine-tuning of LLMs with PEFT and full-param support.

Transformer Reinforcement Learning for RLHF and alignment.

Deep learning optimization library for large-scale training.