Axolotl
Config-driven fine-tuning for open LLMs
Hugging Face TRL
Train language models with SFT, DPO and RL
LLaMA-Factory
Unified fine-tuning for 100+ language models
OpenAI fine-tuning
Fine-tune OpenAI models on your own examples
Tinker
Fine-tuning API for open-weight models
torchtune
PyTorch-native library for fine-tuning LLMs
Unsloth
Faster, lower-memory fine-tuning of open models