16 KiB
16 KiB
AI Video Production Master Guide
The Complete System for Script-to-Video on a Home Mac
Target Hardware: 128GB M4 Max MacBook Pro Philosophy: Maximum quality, minimal cloud cost, full creative control
Table of Contents
- The Landscape in 2025
- Architecture Decision: Local vs Cloud Hybrid
- Style & Character Consistency
- LoRA Fine-Tuning Strategy
- Hiring Artists & Building Datasets
- Synthetic Video Elements
- Cost Comparison: Self-Hosted vs InVideo
- The Complete Pipeline
- Scripts & Workflows
The Landscape in 2025
Tier 1: Cloud APIs (Highest Quality, Highest Cost)
| Service | Best For | Cost | Character Consistency |
|---|---|---|---|
| Runway Gen-4 | Professional filmmaking | ~$0.05/sec | ⭐⭐⭐⭐⭐ Best in class |
| Kling 2.1 | Realistic motion, lip-sync | ~$0.03/sec | ⭐⭐⭐⭐ |
| Veo 3.1 | Cinematic polish | Waitlist | ⭐⭐⭐⭐ |
| Sora | Long-form narrative | ~$0.05/sec | ⭐⭐⭐ |
Tier 2: Self-Hosted (Maximum Control, Setup Required)
| Model | Best For | VRAM | Apple Silicon |
|---|---|---|---|
| Wan 2.1/2.2 | Style control, I2V | 12-24GB | ✅ Slow but works |
| LTX Video | Fast iteration | 8-16GB | ✅ Good |
| Hunyuan Video | Quality balance | 24GB+ | ⚠️ Marginal |
Tier 3: SaaS Platforms (Convenience, Less Control)
| Service | Monthly Cost | Minutes | Per-Minute Cost |
|---|---|---|---|
| InVideo Plus | $20 | 50 | $0.40/min |
| InVideo Max | $48 | 200 | $0.24/min |
| InVideo Gen | $96 | 400 | $0.24/min |
Key Insight: For style-specific work, self-hosted + occasional cloud burst is 3-10x cheaper than SaaS platforms while offering superior creative control.
Architecture Decision
The Hybrid Approach (Recommended)
┌─────────────────────────────────────────────────────────────────┐
│ YOUR M4 MAX (128GB) │
├─────────────────────────────────────────────────────────────────┤
│ LOCAL TASKS (Free, Unlimited) │
│ ├── Image Generation (Flux via ComfyUI) │
│ ├── LoRA Training (up to rank 32, small datasets) │
│ ├── Style Development & Iteration │
│ ├── Audio Generation (TTS, Music) │
│ ├── Video Composition (FFmpeg) │
│ ├── Motion Graphics (Remotion/After Effects) │
│ └── Subtitle/Overlay Rendering │
├─────────────────────────────────────────────────────────────────┤
│ CLOUD BURST (Pay-per-use) │
│ ├── Video Generation (Wan I2V on RunPod/Vast.ai) │
│ ├── Large LoRA Training (48GB+ VRAM needed) │
│ └── Batch Processing (10+ clips simultaneously) │
└─────────────────────────────────────────────────────────────────┘
Why This Works
- Image generation is fast locally - Flux on M4 Max: 30-60 sec/image
- I2V is slow locally - Wan 2.1: 15 min/step × 6 steps = 90 min/clip
- Cloud I2V is fast - Wan 2.1 on H100: ~2 min/clip
- Cloud is cheap - Vast.ai H100: $1.87/hr = ~$0.06/clip
Cost Calculation for a 10-Clip Video
| Approach | Time | Cost |
|---|---|---|
| Full Local (M4 Max) | 15+ hours | $0 (electricity) |
| Hybrid (local img + cloud I2V) | 2-3 hours | ~$2-4 |
| InVideo Max | 30 min | $48/mo subscription |
| Runway Gen-4 | 30 min | ~$15-25 |
Winner: Hybrid approach at $2-4 per video vs $48+/mo subscription.
Style and Character Consistency
The Core Problem
Diffusion models have no memory. Each generation is independent. This causes:
- Hair color drift
- Clothing changes
- Face morphing
- Style inconsistency
Solution Matrix
| Technique | Setup Time | Quality | Best For |
|---|---|---|---|
| LoRA Training | 4-8 hours | ⭐⭐⭐⭐⭐ | Your unique style |
| IPAdapter + FaceID | 20 min | ⭐⭐⭐⭐ | Consistent faces |
| Reference Image Workflow | 5 min | ⭐⭐⭐ | Quick consistency |
| Prompt Discipline | 0 min | ⭐⭐ | Basic consistency |
Recommended Stack for Maximum Consistency
# The "Belt and Suspenders" Approach
CONSISTENCY_STACK = {
"style": "LoRA (trained on your artistic style)",
"face": "IPAdapter FaceID Plus",
"composition": "ControlNet (pose/depth)",
"prompt": "Structured with locked variables",
"i2v": "Use keyframe as anchor image",
}
IPAdapter + AnimateDiff Pipeline
Research shows 94% style consistency with this combination vs 68% with AnimateDiff alone.
Reference Image → IPAdapter → AnimateDiff → Consistent Animation
↓
Style Transfer
(weight: 0.8)
Prompt Discipline Rules
- Lock visual descriptors: Always say "brown trench coat" not "coat"
- Fix camera setup: "50mm lens, low-angle shot, studio lighting"
- Use trigger words: "txcl_style painting" for your LoRA
- Repeat key phrases: Exact same description across all shots
LoRA Fine-Tuning Strategy
When to Train a LoRA
✅ Train when:
- You need a unique artistic style
- You want consistent characters
- You're producing 10+ pieces in the same style
- You have 20-100 high-quality reference images
❌ Don't train when:
- One-off projects
- You can achieve results with IPAdapter
- You don't have quality reference images
Dataset Requirements
| LoRA Type | Images Needed | Quality | Diversity |
|---|---|---|---|
| Style | 50-100 | Very high | Same style, different subjects |
| Character | 20-30 | High | Same character, different poses |
| Concept | 30-50 | High | Same concept, varied contexts |
Training Parameters (Flux LoRA)
# Conservative start (recommended)
rank: 32
alpha: 32
learning_rate: 1e-4
steps: 1000-2000
batch_size: 1
gradient_accumulation: 4
resolution: 1024
# Memory-constrained (M4 Max)
rank: 16
steps: 1500
use_8bit_adam: true
gradient_checkpointing: true
Where to Train
| Platform | Cost | Speed | VRAM |
|---|---|---|---|
| Local M4 Max | Free | Slow (8-12hr) | 128GB unified |
| Vast.ai A100 | ~$1.50/hr | Fast (1-2hr) | 80GB |
| RunPod H100 | ~$2/hr | Fastest | 80GB |
| fal.ai | ~$5-15/train | Managed | N/A |
Hiring Artists
Why Commission Original Art?
- Copyright clarity - You own it, no legal ambiguity
- Unique style - No one else has this LoRA
- Quality control - Curated dataset, better results
- Ethical foundation - Artist compensated fairly
Finding Artists
| Platform | Best For | Budget Range |
|---|---|---|
| ArtStation | Professional concept artists | $500-5000+ |
| Fiverr | Quick, budget-friendly | $50-500 |
| Upwork | Long-term collaboration | $200-2000 |
| DeviantArt | Niche styles | $100-1000 |
| Direct (Twitter/IG) | Specific artists | Varies |
Commission Structure
What to Request:
I'm commissioning [N] illustrations for use as AI training data.
Deliverables:
- [20-50] high-resolution images (2048x2048+ PNG)
- Consistent style across all pieces
- Varied subjects: [list categories]
- Full commercial rights including AI training
Style reference: [attach examples]
Timeline: [X weeks]
Budget: $[Y]
Usage: These images will train a LoRA model for
[personal/commercial] video production.
Contract Essentials
Must Include:
- ✅ Full commercial usage rights
- ✅ AI/ML training rights explicitly stated
- ✅ No exclusivity (you can use anywhere)
- ✅ Artist credit requirements (if any)
- ✅ Revision policy
- ✅ Delivery format and resolution
Sample Clause:
"Client receives perpetual, worldwide, exclusive rights to use
the commissioned works for any purpose, including but not limited
to: training artificial intelligence or machine learning models,
generating derivative works, commercial products, and any future
technologies. Artist retains right to display in portfolio only."
Budget Guidelines
| Project Scale | Images | Budget | Artist Level |
|---|---|---|---|
| MVP | 20-30 | $200-500 | Emerging |
| Production | 50-100 | $500-2000 | Mid-level |
| Premium | 100+ | $2000-10000 | Professional |
Synthetic Video Elements
The Modern Motion Graphics Stack
2025 Trends
- Deep Glow - Intense light blooms, layered neons
- Liquid Motion - Fluid, morphing typography
- 3D + 2D Hybrid - Depth in flat design
- Neo Brutalism - Raw, glitchy, utilitarian
- Retro Revival - 80s/90s grain and neon
Tools for Different Needs
| Tool | Best For | Learning Curve | Output |
|---|---|---|---|
| After Effects | Professional broadcast | High | Video files |
| Motion | macOS-native, quick | Medium | Video files |
| Remotion | Code-driven, React devs | Medium | Video/GIF |
| Rive | Interactive, web export | Low | Web/Apps |
| Cavalry | Procedural animation | Medium | Video files |
| DaVinci Fusion | Integrated compositing | High | Video files |
Remotion for Programmers
// Example: Animated title card with metrics
import { useCurrentFrame, interpolate } from 'remotion';
export const TitleCard: React.FC<{title: string}> = ({title}) => {
const frame = useCurrentFrame();
const opacity = interpolate(frame, [0, 30], [0, 1]);
const scale = interpolate(frame, [0, 30], [0.8, 1]);
return (
<div style={{
opacity,
transform: `scale(${scale})`,
fontFamily: 'SF Pro Display',
fontSize: 72,
background: 'linear-gradient(135deg, #667eea 0%, #764ba2 100%)',
WebkitBackgroundClip: 'text',
WebkitTextFillColor: 'transparent',
}}>
{title}
</div>
);
};
Non-Academic/Business Chart Styles
Avoid:
- Default Excel/PowerPoint charts
- Clip art and stock icons
- Generic sans-serif fonts
- White backgrounds with black text
Embrace:
- Dark backgrounds with neon accents
- Custom iconography (Phosphor, Heroicons)
- Variable fonts with animated weight
- Gradients and glass effects
- Micro-animations on data points
Chart Animation Patterns
Entry Animations:
├── Stagger reveal (data points appear sequentially)
├── Draw-on (line charts animate along path)
├── Scale-up (bars grow from axis)
└── Morph (smooth transition between states)
Emphasis:
├── Pulse highlight (attention to key data)
├── Glow intensification (important values)
└── Color shift (state change)
Cost Comparison
InVideo AI vs Self-Hosted (Monthly)
Scenario: 10 videos/month, 3 minutes each, 10 shots per video
| Component | InVideo Max | Self-Hosted Hybrid |
|---|---|---|
| Subscription | $48/mo | $0 |
| Cloud GPU (burst) | N/A | ~$20-40/mo |
| Storage | Included | ~$5/mo (local) |
| Total | $48/mo | $25-45/mo |
| Control | Limited | Full |
| Style Customization | Template-based | Unlimited |
| Character Consistency | Basic | Advanced (LoRA/IPAdapter) |
Break-Even Analysis
InVideo: $48/mo = $576/year
Self-hosted setup: ~$200 one-time (software, plugins)
Self-hosted running: ~$30/mo = $360/year
Year 1: InVideo $576 vs Self-hosted $560
Year 2+: InVideo $576 vs Self-hosted $360
Savings after Year 1: $216/year
When to Use Each
Use InVideo when:
- Time is more valuable than money
- Corporate/template style is acceptable
- No custom style requirements
- Quick turnaround needed
Use Self-Hosted when:
- Unique artistic style required
- Character consistency critical
- Budget-conscious
- Learning/experimentation phase
- Privacy/data concerns
The Complete Pipeline
Phase 1: Pre-Production (Local)
Script → Shot List → Visual Prompts → Reference Gathering
↓
Style Development (LoRA training if needed)
↓
Audio Production (TTS, music)
Phase 2: Visual Generation (Hybrid)
LOCAL: Flux Image Generation
└── Generate all keyframes
└── IPAdapter for consistency
└── ControlNet for composition
CLOUD: Wan 2.1 I2V (on Vast.ai/RunPod)
└── Batch process all shots
└── 10 clips × 2 min = 20 min total
└── Cost: ~$0.60
Phase 3: Post-Production (Local)
Motion Graphics Layer (Remotion/AE)
└── Title cards
└── Lower thirds
└── Data visualizations
└── Transitions
Composition (FFmpeg/DaVinci)
└── Video assembly
└── Audio sync
└── Color grading
└── Final export
Automation Script
See scripts/full_pipeline.py for the complete automated workflow.
Scripts and Workflows
Available in this skill:
scripts/cloud_i2v_batch.py- Batch I2V on cloud GPUsscripts/cost_calculator.py- Compare costs across platformsscripts/lora_training_cloud.py- Train LoRA on Vast.aiscripts/motion_graphics_generator.py- Programmatic title cardsworkflows/comfyui_i2v_optimized.json- Optimized ComfyUI workflow
Quick Start
# Calculate costs for your project
python scripts/cost_calculator.py --shots 10 --duration 5
# Generate title cards
python scripts/motion_graphics_generator.py --style "neo-brutalist"
# Batch I2V on cloud
python scripts/cloud_i2v_batch.py --images ./keyframes --provider vastai