PALLAIDIUM

A generative AI movie studio integrated into the Blender Video Editor.

Text Generation

Generate video, image, and audio from text prompts with advanced AI models.

Media Conversion

Convert between different media types including text, image, video, and audio.

Advanced Controls

Fine-tune your results with ControlNet, OpenPose, LoRAs, and more.

Requirements

• Windows (Unsupported: Linux and MacOS)

• A CUDA-supported Nvidia card with at least 6 GB VRAM

• CUDA: 12.4

• 20+ GB HDD (Each model is 6+ GB)

Installation

1. Download and install git (must be on PATH): https://git-scm.com/downloads

2. Download the add-on from GitHub

3. On Windows, right-click on the Blender icon and "Run Blender as Administrator"

4. Install the add-on: Preferences > Add-ons > Install > select file > enable

5. In preferences, hit "Uninstall Dependencies" button

6. Restart Blender via "Run as Administrator"

7. In preferences, hit "Install Dependencies" button

8. Restart computer and run Blender via "Run as Administrator"

9. Open add-on UI in Sequencer > Sidebar > Generative AI

Core Features

Video Generation

Transform prompts into stunning video content

Text to Video

Image to Video

Video to Video

Batch Processing

Image Generation

Create and control image generation with precision

ControlNet

OpenPose

Canny Edge

IP Adapter

Style Control

Fine-tune and perfect your creative vision

Multiple LoRAs

Style Mixing

Quality Control

Seed Control

Audio & Text

Comprehensive audio and text generation

Text to Speech

Music Generation

Image to Text

Voice Options

Supported AI Models

Video Models

stabilityai/stable-video-diffusion-img2vid-xt
stabilityai/stable-video-diffusion-img2vid
THUDM/CogVideoX-5b
cerspense/zeroscope_v2_XL

Image Models

stabilityai/stable-diffusion-xl-base-1.0
ByteDance/SDXL-Lightning
stabilityai/stable-diffusion-3-medium-diffusers
black-forest-labs/FLUX.1-schnell
fluently/Fluently-XL-Final

Audio Models

stabilityai/stable-audio-open-1.0
Parler TTS
facebook/musicgen-stereo-medium
WhisperSpeech
Bark

Usage Restrictions

Content Restrictions

  • • No content that is demeaning or harmful to people, their environment, culture, religion, etc.
  • • No pornographic, violent, or bloody content generation
  • • No error and false information generation

Model Usage

  • • Pallaidium does not include any genAI models (weights)
  • • Models are downloaded from HuggingFace as needed
  • • Most models are for non-commercial/research purposes only
  • • Check individual model licenses on HuggingFace for commercial use