87 lines
2.3 KiB
Markdown
87 lines
2.3 KiB
Markdown
# ffmpeg-analyse-video-skill
|
|
|
|
AI agent skill that analyses video content by extracting frames with ffmpeg and using vision to generate timestamped step-by-step summaries.
|
|
|
|
Works with screen recordings, tutorials, presentations, footage, and animations.
|
|
|
|
## Install
|
|
|
|
```bash
|
|
npx skills add fabriqaai/ffmpeg-analyse-video-skill
|
|
```
|
|
|
|
## Requirements
|
|
|
|
- **ffmpeg** and **ffprobe** installed on your system
|
|
- macOS: `brew install ffmpeg`
|
|
- Ubuntu/Debian: `sudo apt install ffmpeg`
|
|
- Windows: `choco install ffmpeg` or `winget install ffmpeg`
|
|
|
|
## Usage
|
|
|
|
Provide a video file path and ask your agent to analyse it:
|
|
|
|
```
|
|
Analyse this video: /path/to/recording.mp4
|
|
```
|
|
|
|
```
|
|
What happens in this video? ~/Desktop/demo.mov
|
|
```
|
|
|
|
```
|
|
Summarise this recording: ./tutorial.mp4
|
|
```
|
|
|
|
### Advanced
|
|
|
|
```
|
|
Analyse 2:00 to 5:00 of meeting.mp4
|
|
```
|
|
|
|
```
|
|
Analyse this video in high detail: demo.mp4
|
|
```
|
|
|
|
```
|
|
Focus on the code shown in this video: screencast.mp4
|
|
```
|
|
|
|
## How It Works
|
|
|
|
```
|
|
Main Agent Sub-Agents (disposable context)
|
|
────────── ──────────────────────────────
|
|
1. ffprobe metadata ───►
|
|
2. ffmpeg frame extraction ───►
|
|
3. Split frames into batches ──► 4. Read images (vision)
|
|
Write text descriptions
|
|
to batch_N_analysis.md
|
|
5. Read text files only ◄─── (context discarded)
|
|
6. Synthesise final output
|
|
```
|
|
|
|
Frame images are only ever read inside disposable sub-agent contexts. The main agent receives lightweight text-only analysis files — no images enter the main conversation. This cuts context usage by ~90% compared to reading frames directly.
|
|
|
|
### Frame Extraction Strategies
|
|
|
|
| Video Duration | Strategy | Expected Frames |
|
|
|---------------|----------|-----------------|
|
|
| 0-60s | Interval (1 frame/2s) | 1-30 |
|
|
| 1-10min | Scene detection | 15-60 |
|
|
| 10-30min | Keyframe extraction | 30-80 |
|
|
| 30min+ | Thumbnail filter | Capped at 60 |
|
|
|
|
### Output Format
|
|
|
|
The skill produces a structured markdown report:
|
|
|
|
- **Metadata** — duration, resolution, fps, content type, frames analysed
|
|
- **Timeline** — chronological segments with descriptions
|
|
- **Key Moments** — 3-7 most significant timestamps
|
|
- **Summary** — 2-5 sentence narrative
|
|
|
|
## License
|
|
|
|
MIT
|