Multi-GPU FLUX Full Fine-Tuning Test on RunPod: 2x A100 80 GB Results
Multi-GPU FLUX full fine-tuning / DreamBooth on 2x A100 80 GB GPUs gave only a 26% speed gain over one GPU, so 2x GPU training is not worth it yet.

Highlights
Requirements and conclusions from the experiments: multi-GPU fine-tuning needs at least 80 GB GPUs, Fused Backward Pass saves no VRAM there and slows training, and a single L40S is cheaper and faster. The first part of the Kohya install took 30 minutes on RunPod versus about 2-3 minutes on Massed Compute.
Related

Qwen Image 2512 Training Comparison: The Best Model to Train
Qwen Image 2512 is the new king for training: the video compares trained Base, 2512, Edit 2509 and Edit 2511 models and shows a big leap in realism.

Kohya vs OneTrainer for FLUX Dev Fine-Tuning / DreamBooth: Comparison
Kohya and OneTrainer compared for FLUX Dev fine-tuning: OneTrainer with EMA and a copied Kohya config gave weaker results than the best Kohya config.

FLUX 2 vs FLUX SRPO & New Kohya SS GUI Premium FLUX Training App
FLUX 2 Pro compared with a trained FLUX SRPO model, plus the new Kohya trainer V35 that trains FLUX on GPUs with as little as 6 GB VRAM.