← the studio
A MoreSalamander · Productions engine

my-AI-scene

A local-first video production engine. A human authors a ProductionSpec; local HuggingFace models synthesize the narration, footage, and music inside it; pure-Python verifiers decide what survives to the final cut.

Same thesis, third medium.

What it is

A production guide becomes a graded, assembled MP4.

Where my-AI-story turns a series bible into multi-voice audio, my-AI-scene turns a production guide into a scored, color-graded, assembled video — the engine behind The Journal of Informal Human Protocols. Human-owned constraints → local AI synthesis → deterministic verification at every boundary.

Watch it run

A model fills each layer; a gate decides whether the layer survives.
my-AI-scene · live pipelineattempt 1
spec_load
→
narration
gate ●
→
footage
gate ●
→
music
gate ○
→
assembly
gate ●
→
episode.mp4
CLIP
— /100 · need ≥ 80
Per beat, per stage. Blocking ●: Whisper checks narration against the script; CLIP scores the still against the footage prompt; ffprobe verifies the MP4. Non-blocking ○: a music bed that fails its gate is dropped — the episode continues without it.

The three moves

Explain · Synthesize · Verify — at every boundary.
01 · Explain

The ProductionSpec — every beat, narration line, footage prompt, and grade — is authored before synthesis. The schema is the contract the whole cut is judged against.

02 · Synthesize

Local HuggingFace models fill it in — Kokoro narration, SDXL/FLUX stills, MusicGen beds — beat by beat. The models are components, not the system.

03 · Verify

Whisper transcribes narration and compares it to the script; CLIP scores each still against its prompt; ffprobe verifies the final file. Blocking gates protect the cut; music is non-blocking.

Best at — and the honest limit

A watchable cut, assembled from what passed.

my-AI-scene reliably produces a narrated, illustrated short where every kept frame cleared a gate — the worst case is a slightly simpler video, never a corrupt one.

What it can't do: the gates verify that narration matches the script and a still matches its prompt — not that the film is beautiful. It guarantees conformance, and is honest that taste is a human call downstream.