torchtune
PyTorch-native library for fine-tuning LLMs
torchtune is a PyTorch library with recipes for fine-tuning popular LLMs. It is written in plain PyTorch with hackable training loops and supports LoRA, QLoRA and full tuning.
More in Fine-tuning
Axolotl
Fine-tuning
Config-driven fine-tuning for open LLMs
Hugging Face TRL
Fine-tuning
Train language models with SFT, DPO and RL
LLaMA-Factory
Fine-tuning
Unified fine-tuning for 100+ language models
OpenAI fine-tuning
Fine-tuning
Fine-tune OpenAI models on your own examples
Oumi
Fine-tuning
Open platform to train, evaluate and deploy models
Tinker
Fine-tuning
Fine-tuning API for open-weight models