Verification
Use the lowest verification level that proves the requested result:
| Level | Required evidence |
|---|---|
| L0 | Static checks such as the focused verification script, npx tsc --noEmit, tests, and build. |
| L1 | A real Agent run against the editor at localhost:5199, followed by structural and rendered evidence. |
| L2 | The packaged desktop app completing the user scenario, including human visual review where automation is insufficient. |
Runtime behavior changes require L0 + L1. Release and desktop-only changes also require L2 when the packaged app is the behavior under test.
Prefer two signals:
read_projectfor structure: assets, tracks, items, frame placement, timeline duration.- A visual capture path for rendered evidence at exact frames.
Use view_timeline_frames for composed timeline proof. This verifies the edited OpenChatCut timeline: trims, layers, captions, effects,
markers, placeholders, crops, transitions, and layout.
For raw source-asset frame inspection, choose the cheapest path based on where the bytes live:
- The agent in this build has no local filesystem access; all source bytes live
in the project media store (
/media/uploads/). Useview_asset_frameswith the project asset id — the server takes an ffmpeg contact-sheet fast path automatically, so it is already the cheapest source-frame route. view_timeline_framesrenders the composed timeline (the editor-truth check);view_asset_framessamples raw source frames. Pick by what you are verifying.- There is no separate
get_contact_sheettool in this build — the contact sheet is whatview_asset_frames/view_timeline_framesalready return.
Use local/remote source-frame artifacts only for source understanding, moment selection, and rough trim decisions, not as edited output or timeline proof.
For local-only or upload-in-progress media, composed timeline proof may be
blocked until the asset has bytes available to the renderer. Source-frame
inspection via view_asset_frames still works as long as the asset's bytes are
on disk (/media/uploads/).
If both visual proof paths are blocked, ask the user to inspect the OpenChatCut editor directly and note the blocker explicitly.
Useful checks:
- After import:
read_project({ "view": "assets", "assetId": "<prefix>" }) - After move/trim:
read_project({ "view": "timeline" }) - After visual overlay or MG on any timeline media:
view_timeline_frames({ "frames": [30, 45, 75] }), then look at the returned frames. - For user-requested source selection or visual moment picking: sample stills with
view_asset_framesand inspect them. Use that only to choose source files, moments, and rough trims. Build the visible edit as OpenChatCut timeline items. Do not treat raw source inspection as timeline verification or as permission to produce the edited video elsewhere. - For source-frame inspection: call
view_asset_frames({"assetId":"...","sourceTimesMs":[...]})afterread_project({"view":"assets"})confirms the asset id/type. Prefer this over asking the user to reattach the file. - For local-only visual verification: upload/register cloud-readable media before relying on connector visual proof.
- For no-source validation: confirm the tool manifest exposed the parameters you used, then record the visible proof in the trace log.
When talking about seconds, verify the fps from read_project or use adapter tools that resolve fps internally.
When reporting a timeline item location, use only the latest read_project structure for track alias, item id, start, duration, and asset id. Do not report planned/default tracks or tool-call intent as verified placement.
Do not treat a command-line JSON response alone as sufficient when the user asks whether the editor reflects the result. Use the editor URL or visual proof when practical.
Real Agent transcript check
After every L1 Agent run, inspect the complete chat record before reporting success:
- Read the final assistant response and every tool row created by the run.
- Expand failed or warning rows and record the exact error.
- Check for aborted turns, repeated retries, stale proposals, incomplete jobs, and tool results that the final response incorrectly describes as successful.
- Compare the latest
read_projectresult with the visible timeline. - For visual edits, inspect returned timeline frames rather than trusting the assistant summary.
A run with a correct-looking timeline but an unreported tool error is not a clean pass. Fix the cause or report the remaining error explicitly.
If verification fails, classify the gap before changing tools:
- tool description or schema was insufficient
- skill instructions were missing a step
read_projectdid not expose enough state- editor authorization did not complete
- media/transcription pipeline failed
- cloud render/editor observation was blocked
