Patreon
Home / Videos / Every Voice and Clip in This Video Is AI: Ovi Makes Talking

Every Voice and Clip in This Video Is AI: Ovi Makes Talking Videos With Sound, Locally

Ovi is a free, open source model that generates videos with synchronized audio from text or images; our app runs it locally with as low as 8.2 GB VRAM.

Published Oct 04, 2025 · 5,146 views · Watch on YouTube

Get the app and files

Ovi Released: Generate Videos With Audio Like VEO 3 or SORA 2 Locally

Ovi Released: Generate Videos With Audio Like VEO 3 or SORA 2 Locally

Ovi is a free, open source model that generates videos with synchronized audio from text or images; our app runs it locally with as low as 8.2 GB VRAM.

About this video

App link : https://www.patreon.com/posts/140393220

With newest updates now we have GPU presets for 6-GB, 8-GB, 10-GB, 12-GB, 16-GB, 24-GB, 32-GB and more GPUs since I have implemented tiled-VAE of ComfyUI + T5 text encoding on CPU

Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generation

Hopefully full tutorial coming soon

Project page : https://aaxwaz.github.io/Ovi/

Full scale ultra advanced app for Ovi - an open source project that can generate videos from both text prompts and image + text prompts with real audio.

Project GitHub is here : https://github.com/character-ai/Ovi

I have developed an ultra advanced Gradio app and much better pipeline that fully supports block swapping

Now we can generate full quality videos with as low as 8.2 GB VRAM

Hopefully I will work on dynamic on load FP8_Scaled tomorrow to improve VRAM even further

So more VRAM optimizations will come hopefully tomorrow

Our implemented block swapping is the very best one out there - I took the approach from famous Kohya Musubi tuner

The 1-click installer will install into Python 3.10.11 venv and will auto download models as well so it is literally 1-click

My installer auto installs with Torch 2.8, CUDA 12.9, Flash Attention 2.8.3 and it supports literally all GPUs like RTX 3000 series, 4000 series, 5000 series, H100, B200, etc

All generations will be saved inside outputs folder and we support so many features like batch folder processing, number of generations, full preset save and load

This is a rush release (in less than a day) so there can be errors please let me know and I will hopefully improve the app

Look the examples to understand how to prompt the model that is extremely important

Look our below screenshots to see the app features

RTX 5090 can run it without any block swap with just cpu-offloading - really fast

50 Steps recommended but you can do low too like 20

1-Click to install on Windows, RunPod and Massed Compute

High-Quality Synchronized Audio

We pretrained from scratch our high-quality 5B audio branch using a mirroring architecture of WAN 2.2 5B, as well as our 1B fusion branch.

Data-Driven Lip-sync Learning

Achieving precise lip synchronization without explicit face bounding boxes, through pure data-driven learning

Multi-Person Dialogue Support

Naturally extending to realistic multiple speakers and multi-turn conversations, making complex dialogue scenarios possible

Contextual Sound Generation

Creating synchronized background music and sound effects that match visual actions

OSS Release to Expedite Research

We are excited to release our full pre-trained model weights and inference code to expedite video+audio generation in OSS community.

Human-centric AV Generation from Text & Image (TI2AV)

Given a starting first frame and text prompt, Ovi generates a high quality video with audio.

All videos below have their first frames generated from an off-the-shelf imagen model.

Human-centric AV Generation from Text (T2AV)

Given a text prompt only, Ovi generates a high quality video with audio.

Videos generated include large motion ranges, multi-person conversations, and diverse emotions.

Multi Person AV Generation from Text or Image (TI2AV)

Given a text prompt with optional starting image, Ovi generates a video with multi person dialogue.

Sound effect (SFX) AV Generation from Text w or w/o Image (TI2AV or T2AV)