Patreon
Home / Videos / Transform Your Sketches into Masterpieces with Stable Diffus

Transform Your Sketches into Masterpieces with Stable Diffusion ControlNet AI - How To Use Tutorial

Our Discord : https://discord.gg/HbqgGaZVmr. In this video, You will see the new amazing Stable Diffusion technology - #ControlNet. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on 🥰 https://www.patreon.com/SECourses

Published Feb 12, 2023 · 41,995 views · Watch on YouTube

Chapters

  1. 0:00 What is revolutionary new Stable Diffusion AI technology ControlNet
  2. 0:36 What is ControlNet with Canny Edge
  3. 0:49 What is ControlNet with M-LSD Lines
  4. 1:17 What is ControlNet with HED Boundary
  5. 1:41 What is ControlNet with User Scribbles
  6. 1:58 What is ControlNet Interactive Interface
  7. 2:08 What is ControlNet with Fake Scribbles
  8. 2:28 What is ControlNet with Human Pose
  9. 2:45 What is ControlNet with Semantic Segmentation
  10. 3:02 What is ControlNet with Depth
  11. 3:15 What is ControlNet with Normal Map
  12. 3:35 How to download and install Anaconda
  13. 4:33 How to download / git clone ControlNet
  14. 5:25 How to download ControlNet models from Hugging Face repo
  15. 6:37 Which folder is the correct folder to put ControlNet models
  16. 7:03 How to install ControlNet to generate virtual environment with correct dependencies
  17. 8:53 How to start run first app Canny Edge
  18. 9:59 Correct local URL of the app
  19. 10:11 Testing first test image bird with Canny Edge
  20. 11:42 How to start M-LSD lines ControlNet app
  21. 12:10 How to set low VRAM option in configuration
  22. 13:20 Start again M-LSD lines ControlNet app
  23. 13:37 Running Hough Line Maps app example
  24. 14:28 Example of Control Stable Diffusion with HED Maps
  25. 14:45 Testing ControlNet with User Scribbles

About this video

Our Discord : https://discord.gg/HbqgGaZVmr. In this video, You will see the new amazing Stable Diffusion technology - #ControlNet. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on 🥰 https://www.patreon.com/SECourses

Playlist of #StableDiffusion Tutorials, Automatic1111 and Google Colab Guides, DreamBooth, Textual Inversion / Embedding, LoRA, AI Upscaling, Pix2Pix, Img2Img:

https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3

ControlNet GitHub repo : https://github.com/lllyasviel/ControlNet

Paper Adding #Conditional Control to Text-to-Image Diffusion Models :

https://github.com/lllyasviel/ControlNet/raw/main/github_page/control.pdf

Anaconda download link : https://www.anaconda.com/products/distribution

GitBash download link : https://git-scm.com/downloads

Pre-trained models repo link : https://huggingface.co/lllyasviel/ControlNet

0:00 What is revolutionary new Stable Diffusion AI technology ControlNet

0:36 What is ControlNet with Canny Edge

0:49 What is ControlNet with M-LSD Lines

1:17 What is ControlNet with HED Boundary

1:41 What is ControlNet with User Scribbles

1:58 What is ControlNet Interactive Interface

2:08 What is ControlNet with Fake Scribbles

2:28 What is ControlNet with Human Pose

2:45 What is ControlNet with Semantic Segmentation

3:02 What is ControlNet with Depth

3:15 What is ControlNet with Normal Map

3:35 How to download and install Anaconda

4:33 How to download / git clone ControlNet

5:25 How to download ControlNet models from Hugging Face repo

6:37 Which folder is the correct folder to put ControlNet models

7:03 How to install ControlNet to generate virtual environment with correct dependencies

8:53 How to start run first app Canny Edge

9:59 Correct local URL of the app

10:11 Testing first test image bird with Canny Edge

11:42 How to start M-LSD lines ControlNet app

12:10 How to set low VRAM option in configuration

13:20 Start again M-LSD lines ControlNet app

13:37 Running Hough Line Maps app example

14:28 Example of Control Stable Diffusion with HED Maps

14:45 Testing ControlNet with User Scribbles

Used lineart source :

https://www.deviantart.com/basiliskzero/art/Free-Dragon-Lineart-285772092

From official paper of Adding Conditional Control to Text-to-Image Diffusion Models

We present a neural network structure, ControlNet, to control pretrained large

diffusion models to support additional input conditions. The ControlNet learns

task-specific conditions in an end-to-end way, and the learning is robust even when