This workflow explores how to use various AI tools to create compelling character animations and "render" them using AI.

If you like my work, please consider supporting me on Patreon: https://www.patreon.com/Mickmumpitz
Follow me on Twitter: https://twitter.com/mickmumpitz
Tools used in this video:
- midjourney: https://www.midjourney.com/
- ChatGPT: https://chat.openai.com/
- blender: https://www.blender.org/
- ICON: https://huggingface.co/spaces/Yuliang/ICON
- Stable Diffusion WebUI: https://github.com/AUTOMATIC1111/stable-diffusion-webui- Control Net
- Sad Talker: https://github.com/OpenTalker/SadTalker/blob/main/docs/webui_extension.md
- Deforum: https://github.com/deforum-art/sd-webui-deforum
- Adobe Creative Cloud: https://www.adobe.com/
- DaVinci Resolve: https://www.blackmagicdesign.com/de/products/davinciresolve
-runway GEN-1: https://research.runwayml.com/gen1
- Wav2Lip: https://colab.research.google.com/github/justinjohn0306/Wav2Lip/blob/master/Wav2Lip_simplified_v5.ipynb#scrollTo=Qgo-oaI3JU2u
Other resources:
- Sad Talker (Huggingface): https://huggingface.co/spaces/vinthony/SadTalker
- High resolution Depth Maps for Stable Diffusion WebUI: https://github.com/thygate/stable-diffusion-webui-depthmap-script
- 3D model Male Figure: https://clara.io/view/d49ee603-8e6c-4720-bd20-9e3d7b13978a
- Blender Beginner Tutorials:Blender Beginner Tutorial - Part 1: https://www.youtube.com/watch?v=nIoXOplUvAw
The ULTIMATE GUIDE to Cameras in Blender (Beginners Start Here!) https://www.youtube.com/watch?v=TvXoSiV6YrM
- Stable Diffusion Models: https://civitai.com/
Chapters:
00:00 Intro
00:32 Creating the characters
02:16 Generating the 3D model
04:03 Voice
04:26 Facial Animation
05:58 Body Animation
07:51 Patreon
08:25 "Re-Rendering" with GEN-1
11:44 "Re-Rendering" with DEFORUM
14:12 Results