Patreon
Home / Videos / Stop Using GGUF for FLUX Dev: FP8 Scaled and NVFP4 Run Up to

Stop Using GGUF for FLUX Dev: FP8 Scaled and NVFP4 Run Up to 2x Faster (ComfyUI CUDA 13 Test)

BF16, GGUF Q8, FP8 Scaled and NVFP4 precisions compared for speed and quality in ComfyUI with CUDA 13; NVFP4 ran 87% faster than GGUF Q8 on Z Image Turbo.

Published Jan 16, 2026 · 6,771 views · Watch on YouTube

Get the app and files

BF16 vs GGUF Q8 vs FP8 Scaled vs NVFP4: Quality and Speed Comparison

BF16 vs GGUF Q8 vs FP8 Scaled vs NVFP4: Quality and Speed Comparison

BF16, GGUF Q8, FP8 Scaled and NVFP4 precisions compared for speed and quality in ComfyUI with CUDA 13; NVFP4 ran 87% faster than GGUF Q8 on Z Image Turbo.

Chapters

  1. 0:00 Introduction: GGUF Q8 vs NVFP4 vs BF16 vs FP8 Precision Comparison
  2. 0:38 FP8 Quantization & New NVFP4 Model Quantizer App in Musubi Trainer
  3. 1:08 The New FLUX SRPO Mixed NVFP4 Model & FLUX 2 Klein 9B Announcement
  4. 1:56 Speed Comparison Setup: ComfyUI CUDA 13 & Compiled Libraries
  5. 2:41 Z Image Turbo Speed Test: GGUF Q8 vs NVFP4 (87% Faster)
  6. 3:09 Z Image Turbo Speed Test: BF16 vs FP8 Scaled vs GGUF Improvements
  7. 3:32 Installing & Using Image Comparison Slider Tool for Quality Check
  8. 3:55 Z Image Turbo Quality: BF16 vs GGUF Q8 vs FP8 Scaled
  9. 4:13 Z Image Turbo Quality: NVFP4 Degradation Analysis
  10. 4:27 FLUX 2 Dev Speed Test: GGUF Q8 vs NVFP4 (100% Faster)
  11. 4:43 FLUX 2 Dev Speed Test: FP8 Scaled vs BF16 Performance
  12. 5:12 FLUX 2 Dev Quality: BF16 vs GGUF Q8 vs Mixed FP8 Scaled
  13. 5:38 FLUX 2 Dev Quality: NVFP4 Mixed Precision Analysis
  14. 5:54 Benchmark Settings: 2048px Resolution & Quality 1 Preset Details
  15. 6:25 FLUX 1 Dev Speed Test: GGUF Q8 vs NVFP4 (118% Faster)
  16. 7:21 FLUX 1 Dev Speed Test: BF16 & FP8 Scaled Performance Stats
  17. 7:42 FLUX 1 Dev Quality: BF16 vs GGUF Q8 vs FP8 Scaled
  18. 7:55 FLUX 1 Dev Quality: NVFP4 Visual Degradation Review
  19. 8:06 FLUX 1 Kontext Dev: Model Intro & Outpainting Tutorial Reference
  20. 8:40 FLUX 1 Kontext Dev Speed: GGUF Q8 vs NVFP4 (93% Faster)
  21. 8:59 FLUX 1 Kontext Dev Speed: BF16 & FP8 Scaled Comparisons
  22. 9:12 FLUX 1 Kontext Dev Quality: Original vs Edited Image (Hair Change)
  23. 9:36 FLUX 1 Kontext Dev Quality: BF16 vs GGUF Q8 vs FP8 Scaled
  24. 9:51 How to Use SwarmUI Unified Model Downloader & Bundles
  25. 10:36 Downloading Models via URL from CivitAI & Hugging Face to Cloud
  26. 11:45 SECourses Musubi Trainer: Creating Custom FP8 Quantized Models
  27. 12:44 The New FLUX SRPO NVFP4 Mixed Precision Model Overview
  28. 13:15 Live Demo: FLUX SRPO NVFP4 Speed Test on RTX 5090 (5.7s)
  29. 13:52 VRAM Usage Analysis: NVFP4 on RTX 5090 (14GB Usage)
  30. 14:16 Live Comparison: BF16 Speed & VRAM Test on RTX 5090
  31. 15:15 Troubleshooting: Fixing Low RAM/VRAM Issues with Arguments
  32. 16:25 Why You Should Upgrade to ComfyUI CUDA 13 Version
  33. 16:51 SimplePod AI: Updated Instructions & Template Setup
  34. 17:29 RTX 6000 Blackwell Fix & nvitop Utilization Verification
  35. 18:18 Conclusion, Contact Info & Support Channels

About this video

It was always wondered how much quality and speed difference exists between BF16, GGUF, FP8 Scaled and NVFP4 precisions. In this tutorial I have compared all these precision and quantization variants for both speed and quality. The results are pretty surprising. Moreover, we have developed and published NVFP4 model quant generator app and FP8 Scaled quant generator apps. The links of the apps are below if you want to use them. Furthermore, upgrading ComfyUI to CUDA 13 with properly compiled libraries is now very much recommended. We have observed some noticeable performance gains with CUDA 13. So for both SwarmUI and ComfyUI solo users, CUDA 13 ComfyUI is now recommended.

📂 Resources & Links:

📥 Download ComfyUI CUDA 13 Installer: [ https://www.patreon.com/posts/ComfyUI-Installers-105023709 ]

📥 SwarmUI & ComfyUI Unified Model Downloader: [ https://www.patreon.com/posts/SwarmUI-Install-Download-Models-Presets-114517862 ]

🤖 NVFP4 Model Quantizer App: [ https://www.patreon.com/posts/nvfp4-quantizer-app-148217625 ]

🤖 SECourses Musubi Trainer (FP8 Scaled Quantization App): [ https://www.patreon.com/posts/nvfp4-quantizer-app-148217625 ]

🛠️ Image Comparison Slider Tool: [ https://www.patreon.com/posts/image-video-comparison-slider-app-133935178 ]

☁️ SimplePod AI: [ https://simplepod.ai/ref?user=secourses ]

New Model FLUX 2 Klein 9B: [ https://huggingface.co/black-forest-labs/FLUX.2-klein-9B ]

🎥 FLUX 1 Kontext Dev Tutorial (inpaint - outpaint - image fix): [ https://youtu.be/XWzZ2wnzNuQ ]

🎥 Previous ComfyUI Installation Tutorial: [ https://youtu.be/yOj9PYq3XYM ]

How to Use SwarmUI Presets & Workflows in ComfyUI + Custom Model Paths Setup for ComfyUI & SwarmUI Tutorial: [ https://youtu.be/EqFilBM3i7s ]

SECourses Discord Channel for 7/24 Support: [ https://discord.com/invite/software-engineering-courses-secourses-772774097734074388 ]

SECourses Musubi Tuner Tutorial: [ https://youtu.be/DPX3eBTuO_Y ]

NVIDIA NVFP4 Blog Post to learn More: [ https://developer.nvidia.com/blog/introducing-nvfp4-for-efficient-and-accurate-low-precision-inference/ ]

⏱️ Video Chapters:

0:00 Introduction: GGUF Q8 vs NVFP4 vs BF16 vs FP8 Precision Comparison

0:38 FP8 Quantization & New NVFP4 Model Quantizer App in Musubi Trainer

1:08 The New FLUX SRPO Mixed NVFP4 Model & FLUX 2 Klein 9B Announcement

1:56 Speed Comparison Setup: ComfyUI CUDA 13 & Compiled Libraries

2:41 Z Image Turbo Speed Test: GGUF Q8 vs NVFP4 (87% Faster)

3:09 Z Image Turbo Speed Test: BF16 vs FP8 Scaled vs GGUF Improvements

3:32 Installing & Using Image Comparison Slider Tool for Quality Check

3:55 Z Image Turbo Quality: BF16 vs GGUF Q8 vs FP8 Scaled

4:13 Z Image Turbo Quality: NVFP4 Degradation Analysis

4:27 FLUX 2 Dev Speed Test: GGUF Q8 vs NVFP4 (100% Faster)

4:43 FLUX 2 Dev Speed Test: FP8 Scaled vs BF16 Performance

5:12 FLUX 2 Dev Quality: BF16 vs GGUF Q8 vs Mixed FP8 Scaled

5:38 FLUX 2 Dev Quality: NVFP4 Mixed Precision Analysis

5:54 Benchmark Settings: 2048px Resolution & Quality 1 Preset Details

6:25 FLUX 1 Dev Speed Test: GGUF Q8 vs NVFP4 (118% Faster)

7:21 FLUX 1 Dev Speed Test: BF16 & FP8 Scaled Performance Stats

7:42 FLUX 1 Dev Quality: BF16 vs GGUF Q8 vs FP8 Scaled

7:55 FLUX 1 Dev Quality: NVFP4 Visual Degradation Review

8:06 FLUX 1 Kontext Dev: Model Intro & Outpainting Tutorial Reference

8:40 FLUX 1 Kontext Dev Speed: GGUF Q8 vs NVFP4 (93% Faster)

8:59 FLUX 1 Kontext Dev Speed: BF16 & FP8 Scaled Comparisons

9:12 FLUX 1 Kontext Dev Quality: Original vs Edited Image (Hair Change)

9:36 FLUX 1 Kontext Dev Quality: BF16 vs GGUF Q8 vs FP8 Scaled

9:51 How to Use SwarmUI Unified Model Downloader & Bundles