Patreon
Home / Apps / LoRA and Fine-Tuning Training: Kohya, Musubi Tuner, OneTrainer, AI Toolkit / LoRA Training Tips: Learning Rate, Network Rank, Alpha & Bat

LoRA Training Tips: Learning Rate, Network Rank, Alpha & Batch Size

Excellent tips for LoRA training, slightly improved: how network rank, alpha, optimizer, batch size and precision change the effective learning rate.

lora trainingfine tuningtutorial
LoRA Training Tips: Learning Rate, Network Rank, Alpha & Batch Size

Highlights

Explains how to sweep learning rates from 1e-7 to 1e-3 and spot values that are too low or too high, why min SNR gamma helps, and links the best Kohya and OneTrainer DreamBooth and fine-tuning workflows for SD 1.5 and SDXL.

Where to get it: the full post is free on this Patreon post by Furkan Gözükara (SECourses). Published Jul 19, 2024.

Related

Musubi Tuner App: 1-Click LoRA & Fine-Tune Training With 435 Presets

Musubi Tuner App: 1-Click LoRA & Fine-Tune Training With 435 Presets

SECourses Musubi Tuner trains LoRAs and full fine-tunes of Qwen Image, Wan 2.2, FLUX 2, Z Image and LTX 2.3 on Windows or cloud GPUs with 435 ready presets.

Kohya FLUX Fine Tuning / DreamBooth Training Tutorial: Windows & Cloud

Kohya FLUX Fine Tuning / DreamBooth Training Tutorial: Windows & Cloud

Kohya FLUX full fine tuning / DreamBooth trains full checkpoints with configs for GPUs with as low as 8 GB VRAM, all using Torch Compile on Windows and Linux.

Kohya FLUX LoRA Training: Full Tutorial & Configs for Windows & Cloud

Kohya FLUX LoRA Training: Full Tutorial & Configs for Windows & Cloud

Kohya SS GUI FLUX LoRA training step by step, with the best optimized configs for 4 GB to 48 GB GPUs and a 68 minute Windows tutorial with 74 chapters.

More in LoRA and Fine-Tuning Training: Kohya, Musubi Tuner, OneTrainer, AI Toolkit.