VFlash: Fast, Accurate Visual Planning via Flash Primitive Decoding
u_Unrolled
All projects

LLMs · Intermediate · by hiyouga

LLaMA-Factory: Unified fine-tuning for 100+ LLMs

Comprehensive framework supporting SFT, DPO, PPO, ORPO, and KTO for fine-tuning 100+ LLMs with a web UI and CLI — the Swiss Army knife of LLM training.

2–3 weeks 67300 on GitHubPythonPyTorchTransformersDeepSpeedvLLM
Open the code on GitHub

What you'll learn

  • Supervised fine-tuning (SFT) with custom datasets
  • Preference alignment: DPO, PPO, ORPO, and KTO methods
  • Multi-GPU training with DeepSpeed ZeRO and FSDP
  • Evaluation and benchmarking fine-tuned models

Read first

The lessons that explain what this project uses.

Part of the LLMs in Depth path.

Milestones

0/4

Built it? Show it.

Add your own repo to earn 150 XP and the Shipper badge. It appears on your profile, so it's ready for your resume.

More llms projects