8 GB LoRA Training - Fix CUDA & xformers For DreamBooth and Textual Inversion in Automatic1111 SD UI
Stable Diffusion and SDXL video list: 75 expert-level tutorials on Automatic1111, DreamBooth, LoRA, Textual Inversion and Google Colab, with fixed subtitles.
Published Jan 24, 2023 · 38,041 views · Watch on YouTube
Get the app and files

Stable Diffusion & SDXL: 75 Expert-Level Generative AI Tutorials
Stable Diffusion and SDXL video list: 75 expert-level tutorials on Automatic1111, DreamBooth, LoRA, Textual Inversion and Google Colab, with fixed subtitles.

60 Generative AI Tutorials: Stable Diffusion, SDXL, LoRA & DreamBooth
60 generative AI video tutorials in one list, each marked local, RunPod, Kaggle or Colab, from Stable Diffusion and SDXL training to voice cloning.
Chapters
- 0:00 Introduction to How to downgrade CUDA version
- 1:46 Automatic1111 will ask you to upgrade CUDA. Don't yet.
- 2:03 How to downgrade your CUDA version in your Automatic1111 installation folder
- 4:30 How to install DreamBooth extension
- 5:07 How to install and use dev branch of DreamBooth extension
- 6:42 How to stash local changes to checkout different git branch
- 7:13 How to start LoRA training for 8 GB VRAM GPUs
- 8:22 Settings and setup for LoRA training
- 13:36 How to generate ckpt file from LoRA training checkpoint
About this video
updated tutorial: https://youtu.be/pom3nQejaTs - Our Discord : https://discord.gg/HbqgGaZVmr. This video I am showing how to downgrade CUDA and xformers version for proper training and I am showing how to do LoRA training with 8GB GPU. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on 🥰 https://www.patreon.com/SECourses
Playlist of Stable Diffusion Tutorials, #Automatic1111 and Google Colab Guides, DreamBooth, Textual Inversion / Embedding, #LoRA, AI Upscaling, Pix2Pix, Img2Img:
https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3
This CUDA downgrade will not be necessary probably after the extensions get updated. However it is not certain when will they get updated. Meanwhile you can downgrade and use CUDA 11.6.
Stable Diffusion Playlist : https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3
The commands you need to execute with order to downgrade CUDA
https://gist.github.com/FurkanGozukara/e2db853d2016a4a9ae2cc32dc41d730a
Run CMD as administrator if you get error
1:
activate
2:
pip uninstall torch torchvision
3:
pip uninstall torchaudio
4:
pip uninstall xformers
5:
pip install torch torchvision --extra-index-url https://download.pytorch.org/whl/cu116
6:
pip install -U -I --no-deps https://github.com/C43H66N12O12S2/stable-diffusion-webui/releases/download/torch13/xformers-0.0.14.dev0-cp310-cp310-win_amd64.whl
These below are specific hashes used in video but not necessary to use. You can install newest version of both DreamBooth and Automatic1111 and just downgrade CUDA with the above commands.
Automatic 1111 commit : dc8d1f4f8beb546089abd107db3432e03339c9c0
Dreambooth commit : c544ee11aee0085a7fbb7fdda65898dea2145f0c
Watch this video for learning how to use FileWords:
#xformers
OUTLINE
0:00 Introduction to How to downgrade CUDA version
1:46 Automatic1111 will ask you to upgrade CUDA. Don't yet.
2:03 How to downgrade your CUDA version in your Automatic1111 installation folder
4:30 How to install DreamBooth extension
5:07 How to install and use dev branch of DreamBooth extension
6:42 How to stash local changes to checkout different git branch
7:13 How to start LoRA training for 8 GB VRAM GPUs
8:22 Settings and setup for LoRA training
13:36 How to generate ckpt file from LoRA training checkpoint
Sure, here are some additional details on how transformers can be used with CUDA-enabled NVIDIA hardware:
Transfer learning: Transfer learning is a technique that can be used to leverage pre-trained transformer models, such as BERT or GPT-2, to improve the performance of NLP tasks with limited training data. NVIDIA's hardware and software can be used to fine-tune these pre-trained models on specific NLP tasks, allowing for faster convergence and higher accuracy.
Customization and optimization: The flexibility of transformers allows for a wide range of customization options and optimization techniques. NVIDIA's software libraries can be used to implement custom activation functions, weight initialization schemes, and other architectural modifications to improve model performance. In addition, CUDA enables developers to optimize the transformer models for specific hardware configurations, such as different numbers of GPUs, to achieve the best performance.
Real-time applications: Transformers can be used for real-time NLP applications, such as chatbots and speech recognition, which require low latency and high throughput. NVIDIA's hardware and software can be used to optimize transformer models for real-time applications by reducing inference time and increasing throughput.