AI Gateway Directory

Hugging Face TRL alternatives

7 other fine-tuning listed here. Hugging Face TRL is open source.

Axolotl

Config-driven fine-tuning for open LLMs

Open sourceFine-tuning

LLaMA-Factory

Unified fine-tuning for 100+ language models

Open sourceFine-tuning

OpenAI fine-tuning

Fine-tune OpenAI models on your own examples

PaidFine-tuning

Oumi

Open platform to train, evaluate and deploy models

Open sourceFine-tuning

Tinker

Fine-tuning API for open-weight models

PaidFine-tuning

torchtune

PyTorch-native library for fine-tuning LLMs

Open sourceFine-tuning

Unsloth

Faster, lower-memory fine-tuning of open models

Open sourceFine-tuning