Back to portfolio
tool2025

Video Pipeline

Automated media processing and compilation system with AI-powered analysis and a web-based editing interface

PythonNext.jsffmpegClaude APITypeScriptTailwind CSS
Personal Project
2025
Video Pipeline

Overview

An automated media organization, analysis, and compilation pipeline that transforms raw video and image collections into polished, publication-ready compilations. A Python backend handles metadata extraction, AI-powered visual analysis, and ffmpeg-based encoding, while a full Next.js web interface provides project browsing, sidecar editing, manifest control, and real-time pipeline monitoring.

Challenge

Turning hundreds of raw clips and photos from a trip or shoot into a watchable compilation is tedious and time-consuming. Manually rating footage, fixing rotations, detecting timelapse sequences, choosing music-synced cut points, and applying consistent color grading across dozens of clips requires hours of repetitive editing work that follows predictable patterns.

Solution

We built a deterministic Python pipeline that enriches source folders in-place: extracting rich metadata (resolution, GPS, HDR, scene complexity), fixing rotations, detecting image groups, and generating thumbnails. A single batched Claude API call scores and describes every file visually. The compilation engine then assembles clips ordered by score, synchronized to music beats, with color grading, transitions, and text overlays. A compile manifest allows fine-grained manual control over trim points, ordering, and transitions without re-encoding the entire project.

Results

What previously took hours of manual editing now runs as a single command. The idempotent design means folders can be safely reprocessed as new footage arrives. The web interface replaced the need for terminal-only workflows, making the tool accessible for reviewing and tweaking compilations visually before final export.

Key Features

01AI-powered visual analysis with scoring, descriptions, and QA flags via a single batched API call
02Music beat synchronization for cut-aligned compilations across multiple themes
03Three compilation styles: Highlight, Full, and Chill with score-driven clip selection
04Idempotent reprocessing with automatic reverse-rename and LLM response caching
05Editable compile manifest for manual trim points, transitions, and ordering control
06Parallel multi-worker encoding pipeline with ffmpeg
07Rich metadata extraction: resolution, fps, GPS, HDR, color, bitrate, scene complexity
08Full Next.js web UI for project browsing, sidecar editing, preview playback, and pipeline monitoring
09Image group detection for timelapse, burst, and near-duplicate sequences
10Hero frame export with full, 16:9, and 9:16 crop variants

Gallery

Media gallery with browser and metadata view
Video player with playback controls