SEFurkan GözükaraSECourses · Generative AI Join onPatreon

JoyCaption Multi-GPU Batch Image Captioner Gradio App Released

JoyCaption batch image captioner app splits images across multiple GPUs automatically and loads the model in 4-bit with 9.5 GB VRAM, even in multi-GPU mode.

The first fully multi-GPU supporting and very advanced batch captioner with a Gradio interface, tested on 8x RTX A6000 and on an RTX 3090 Ti + RTX 3060 PC. Published with 1-click installers for Windows, RunPod and Massed Compute, and it resumes with the skip captioned images option.

Updated By Dr. Furkan Gözükara
WindowsRunPodMassed Compute1-Click InstallerNews
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released
Older post. this is an older post kept for reference. The current, maintained version is All JoyCaption Apps: 1-Click Installers With Batch Captioning.

Multi-GPU batch caption with JoyCaption. JoyCaption uses Meta-Llama-3.1–8B and google/siglip-so400m-patch14–384 and a fine tuned image captioning neural network.

Link : JoyCaption Image Captioner: Batch & Multi-GPU Installers (Legacy)

Link for batch caption editor : SECourses Caption Editor Pro: Easy Batch Caption Editing Gradio App

Coding multi-gpu in Python and Torch and bitsandbytes was truly a challange.

Our APP uses JoyCaption image captioning fine tuned model.

Our APP supports bitsandbytes 4bit model loading as well even in multi GPU mode (9.5 GB VRAM)

Tested on 8x RTX A6000 (cloud) and RTX 3090 TI + RTX 3060 (my PC)

1-click to install on Windows, RunPod and Massed Compute

Excellent caption quality, automatically distributes images into each GPU, lots of features. You can resume caption with skip captioned images option.

For full details checkout screenshots

JoyCaption Multi-GPU Batch Image Captioner Gradio App Released
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (2)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (3)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (4)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (5)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (6)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (7)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (8)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (9)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (10)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (11)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (12)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (13)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (14)
JoyCaption Multi-GPU Batch Image Captioner Gradio App Released (15)
↑ ↓ to move · Enter to open · Esc to close · Ctrl K or / to search from any page