Patreon
Home / Videos / Video To Anime - Generate An EPIC Animation From Your Phone

Video To Anime - Generate An EPIC Animation From Your Phone Recording By Using Stable Diffusion AI

SD 1.5 classification images: 10598 aesthetic and 6080 photo of man images generated on v1-5-pruned.ckpt, ready as regularization images for training.

Published Mar 27, 2023 · 55,590 views · Watch on YouTube

Get the app and files

10598 Aesthetic & 6080 Photo of Man Classification Images (SD 1.5)

10598 Aesthetic & 6080 Photo of Man Classification Images (SD 1.5)

SD 1.5 classification images: 10598 aesthetic and 6080 photo of man images generated on v1-5-pruned.ckpt, ready as regularization images for training.

Chapters

  1. 0:00 How to turn a video into an animation in a fully automated manner for free
  2. 0:54 Introduction to Davinci Resolve free edition
  3. 1:08 Introduction to FFmpeg
  4. 1:15 Short tutorial video for Davinci Resolve
  5. 1:19 How to prepare your real video footage
  6. 1:32 How to change timeline resolution in Davinci Resolve
  7. 2:00 Imported video image scaling Davinci Resolve - mismatched resolution files
  8. 2:12 Edit tab and video importing in Davinci Resolve
  9. 2:21 Where to see properties of your video in Davinci Resolve
  10. 2:36 How to crop a video into square or any aspect ratio with Davinci Resolve
  11. 3:17 Negative side of using distant position
  12. 3:49 How to export / render your video in Davinci Resolve with best settings
  13. 4:30 How to export all frames of a video by using FFmpeg
  14. 5:16 Parameters of extracting all frames of a video by using FFmpeg
  15. 5:30 File names importance for batch processing scripts
  16. 6:31 How to install and use Automatic1111 Web UI
  17. 6:57 Which training dataset I made to train myself from video exported frames
  18. 7:26 Why and how I used RunPod IO for training
  19. 8:00 Why I trained myself and a style into SD 1.5 for video to animation
  20. 8:47 How to train yourself and a style tutorial
  21. 9:08 How to do 2 concept training in Stable Diffusion 1.5 DreamBooth
  22. 9:38 What DreamBooth settings I have used to train myself and style into SD 1.5 in this tutorial
  23. 11:37 Master tutorial for DreamBooth
  24. 12:03 What is ControlNet, how to install and use it
  25. 12:24 Settings change of ControlNet to use in video to anime process
  26. 12:52 Multi-frame video rendering for Stable Diffusion script for video to animation with consistency
  27. 13:37 How install external scripts to Automatic1111 Web UI
  28. 14:44 How to change commit version of git repos, ex. Automatic1111 web UI
  29. 15:57 When you are ready to start processing real video frames into anime
  30. 16:16 You don't have to do pre-training to follow this tutorial
  31. 16:46 First step of video to animation
  32. 17:31 Importance of first generated frame
  33. 17:39 How to generate your first converted driving frame
  34. 18:59 What kind of initial frame to image conversation you should aim
  35. 20:10 What is the difference if we don't train ourselves and just use a custom model
  36. 20:48 Next step after you got first converted frame of your anime video
  37. 21:20 The settings used in img2img tab for batch frame processing
  38. 21:57 Multi-frame Video rendering for StableDiffusion settings
  39. 23:25 How to upscale all video to animation generated frames
  40. 23:43 How to fix naming of the batch generated images for upscaling
  41. 25:19 How to do batch upscaling by AI in Automatic1111 Web UI
  42. 26:05 How to improve faces, eyes, when doing upscaling by AI
  43. 26:25 How to animate generated frame images
  44. 26:40 How to import images as an image sequence into Davinci Resolve for animating
  45. 27:31 Clip attributes fixing
  46. 27:39 First time playing our animated video
  47. 27:50 How to improve flickering problem with a very simple trick
  48. 28:30 How to move clip frame by frame in Davinci Resolve
  49. 29:05 Which composite mode to reduce flickering problem in Davinci Resolve
  50. 29:40 How to apply deflickering in Davinci Resolve
  51. 30:35 How animation made in this video could have been improved significantly
  52. 31:54 Which other technique I have tested - img2img alternative test
  53. 32:33 img2img alternative test video to animation results
  54. 33:15 Searched for freely available deflickering tools - models - libraries
  55. 33:43 All-In-One-Deflicker
  56. 34:55 My videos have fully corrected subtitles

About this video

RunPod: https://bit.ly/RunPodIO. Discord : https://bit.ly/SECoursesDiscord. Turn your real video into an animation with just 1 click by using Stable Diffusion for free. If I have been of assistance to you and you would like to show your support for my work, please consider becoming a patron on 🥰 https://www.patreon.com/SECourses

Playlist of StableDiffusion Tutorials, Automatic1111 and Google Colab Guides, DreamBooth, Textual Inversion / Embedding, LoRA, AI Upscaling, Pix2Pix, Img2Img:

https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3

Davinci Resolve Free: https://bit.ly/DavinciResolv

FFmpeg: https://ffmpeg.org/download.html

Davinci Resolve Tutorial: https://youtu.be/_-yYRGKyz8E

Gist file where commands, scripts, settings shared: https://bit.ly/VideoToAnimeGistFile

How to install Automatic1111: https://youtu.be/AZg6vzWHOTA

How to use custom models on Automatic1111: https://youtu.be/aAyvsX-EpG4

How to use RunPod tutorial : https://youtu.be/QN1vdGhjcRc

How to install DreamBooth on RunPod IO : https://youtu.be/oI0GEnrySS0

How to train yourself and a style tutorial : https://youtu.be/m-UVVY_syP0

Pre-generated classification images:

https://www.patreon.com/posts/10598-aesthetic-80588052

Master tutorial for DreamBooth: https://youtu.be/Bdl-jWR3Ukc

DreamBooth best settings experiment: https://youtu.be/sRdtVanSRl4

What is ControlNet, how to install and use it: https://youtu.be/vhqqmkTBMlU

The used script in this video : https://bit.ly/FrameRenderScript

Upscale models database: https://upscale.wiki/wiki/Model_Database

0:00 How to turn a video into an animation in a fully automated manner for free

0:54 Introduction to Davinci Resolve free edition

1:08 Introduction to FFmpeg

1:15 Short tutorial video for Davinci Resolve

1:19 How to prepare your real video footage

1:32 How to change timeline resolution in Davinci Resolve

2:00 Imported video image scaling Davinci Resolve - mismatched resolution files

2:12 Edit tab and video importing in Davinci Resolve

2:21 Where to see properties of your video in Davinci Resolve

2:36 How to crop a video into square or any aspect ratio with Davinci Resolve

3:17 Negative side of using distant position

3:49 How to export / render your video in Davinci Resolve with best settings

4:30 How to export all frames of a video by using FFmpeg

5:16 Parameters of extracting all frames of a video by using FFmpeg

5:30 File names importance for batch processing scripts

6:31 How to install and use Automatic1111 Web UI

6:57 Which training dataset I made to train myself from video exported frames

7:26 Why and how I used RunPod IO for training

8:00 Why I trained myself and a style into SD 1.5 for video to animation

8:47 How to train yourself and a style tutorial

9:08 How to do 2 concept training in Stable Diffusion 1.5 DreamBooth