Patreon
Home / Videos / Forget Photoshop - How To Transform Images With Text Prompts

Forget Photoshop - How To Transform Images With Text Prompts using InstructPix2Pix Model in NMKD GUI

Stable Diffusion and SDXL video list: 75 expert-level tutorials on Automatic1111, DreamBooth, LoRA, Textual Inversion and Google Colab, with fixed subtitles.

Published Jan 25, 2023 · 14,087 views · Watch on YouTube

Get the app and files

Stable Diffusion & SDXL: 75 Expert-Level Generative AI Tutorials

Stable Diffusion & SDXL: 75 Expert-Level Generative AI Tutorials

Stable Diffusion and SDXL video list: 75 expert-level tutorials on Automatic1111, DreamBooth, LoRA, Textual Inversion and Google Colab, with fixed subtitles.

60 Generative AI Tutorials: Stable Diffusion, SDXL, LoRA & DreamBooth

60 Generative AI Tutorials: Stable Diffusion, SDXL, LoRA & DreamBooth

60 generative AI video tutorials in one list, each marked local, RunPod, Kaggle or Colab, from Stable Diffusion and SDXL training to voice cloning.

Chapters

  1. 0:00 Introduction to new AI model InstructPix2Pix Learning to Follow Image Editing Instructions
  2. 0:44 What is InstructPix2Pix
  3. 1:31 Examples of InstructPix2Pix from official developers
  4. 2:47 Introduction to the NMKD Stable Diffusion GUI
  5. 3:38 How to download NMKD Stable Diffusion GUI
  6. 4:42 How to setup and install NMKD Stable Diffusion GUI
  7. 6:56 How to run NMKD Stable Diffusion GUI
  8. 7:09 How to generate text to image AI images by using NMKD Stable Diffusion GUI
  9. 7:26 How to open settings of NMKD Stable Diffusion GUI
  10. 7:48 How to use InstructPix2Pix in NMKD Stable Diffusion GUI
  11. 8:01 How to select which GPU or use CPU in NMKD Stable Diffusion GUI
  12. 8:22 How to load base image and instruct Pix2Pix to transform images
  13. 9:07 How to display both original image and transformed image in NMKD Stable Diffusion GUI
  14. 9:46 What are Prompt and image guidance and CFG scale of InstructPix2Pix image transformation
  15. 10:23 More detailed explanation of Image CFG weight and Text CFG weight
  16. 12:33 How to open logs / debug CMD window in NMKD Stable Diffusion GUI
  17. 14:01 Visual effects of different prompt and image guidance CFG scale
  18. 15:09 How to try multiple different prompts by using prompt queue feature of NMKD Stable Diffusion GUI
  19. 16:14 Different prompt examples of InstructPix2Pix
  20. 17:28 How to upscale transformed images into bigger resolution by using AI upscale algorithms

About this video

Our Discord : https://discord.gg/HbqgGaZVmr. Newest AI model InstructPix2Pix is amazing to transform your images with plain English prompts.If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on 🥰 https://www.patreon.com/SECourses

Playlist of Stable Diffusion Tutorials, #Automatic1111 and Google Colab Guides, DreamBooth, Textual Inversion / Embedding, #LoRA, AI Upscaling, Pix2Pix, Img2Img:

https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3

I am also showing how to install and use NMKD Stable Diffusion open source GUI.

InstructPix2Pix Official Web Site : https://www.timothybrooks.com/instruct-pix2pix

NMKD Stable Diffusion GUI GitHub : https://github.com/n00mkrad/text2image-gui

Download NMKD Stable Diffusion GUI : https://nmkd.itch.io/t2i-gui

Wiki of NMKD Stable Diffusion GUI : https://github.com/n00mkrad/text2image-gui/blob/main/README.md

Our Discord Channel : https://discord.com/invite/HbqgGaZVmr

Stable Diffusion 1.5 Version : https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/main

Best VAE file : https://huggingface.co/stabilityai/sd-vae-ft-mse-original/tree/main

Online free InstructPix2Pix demo : https://huggingface.co/spaces/timbrooks/instruct-pix2pix

Easiest Way to Install & Run Stable Diffusion Web UI on PC by Using Open Source Automatic Installer

https://youtu.be/AZg6vzWHOTA

How to Use SD 2.1 & Custom Models on Google Colab for Training with Dreambooth & Image Generation

https://youtu.be/2yGGorOxtbA

Stable Diffusion - Dreambooth - txt2img - img2img - Embedding - Hypernetwork - AI Image Upscale

https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3

0:00 Introduction to new AI model InstructPix2Pix Learning to Follow Image Editing Instructions

0:44 What is InstructPix2Pix

1:31 Examples of InstructPix2Pix from official developers

2:47 Introduction to the NMKD Stable Diffusion GUI

3:38 How to download NMKD Stable Diffusion GUI

4:42 How to setup and install NMKD Stable Diffusion GUI

6:56 How to run NMKD Stable Diffusion GUI

7:09 How to generate text to image AI images by using NMKD Stable Diffusion GUI

7:26 How to open settings of NMKD Stable Diffusion GUI

7:48 How to use InstructPix2Pix in NMKD Stable Diffusion GUI

8:01 How to select which GPU or use CPU in NMKD Stable Diffusion GUI

8:22 How to load base image and instruct Pix2Pix to transform images

9:07 How to display both original image and transformed image in NMKD Stable Diffusion GUI

9:46 What are Prompt and image guidance and CFG scale of InstructPix2Pix image transformation

10:23 More detailed explanation of Image CFG weight and Text CFG weight

12:33 How to open logs / debug CMD window in NMKD Stable Diffusion GUI

14:01 Visual effects of different prompt and image guidance CFG scale

15:09 How to try multiple different prompts by using prompt queue feature of NMKD Stable Diffusion GUI

16:14 Different prompt examples of InstructPix2Pix

17:28 How to upscale transformed images into bigger resolution by using AI upscale algorithms

Abstract

We propose a method for editing images from human instructions: given an input image and a written instruction that tells the model what to do, our model follows these instructions to edit the image. To obtain training data for this problem, we combine the knowledge of two large pretrained models---a language model (GPT-3) and a text-to-image model (Stable Diffusion)---to generate a large dataset of image editing examples.