3D ResNets PyTorch
Use this root skill when the user asks about the 3D ResNets PyTorch repository, its CLI flags, its dataset layouts, or its video action-recognition workflows.
Read first
references/cli-reference.mdreferences/troubleshooting.mdreferences/repo-provenance.mdscripts/check_imports.pyscripts/check_main_help.py
What this skill covers
- Training, validation, inference, and fine-tuning for video action recognition.
- Dataset preparation from raw videos into JPEG frame trees, RGB HDF5 files, and annotation JSONs.
- Checkpoint handling, model-family selection, and result evaluation.
- Common data-layout and runtime compatibility pitfalls.
Route to a sub-skill
training-and-inference
Use this route for:
- Fresh training runs, resume flows, and pretrained fine-tuning.
- Validation-only runs and sliding-window inference.
- Result scoring and DataParallel checkpoint cleanup.
- Questions about model families, class counts,
ft_begin_module, orresume_path/pretrain_pathbehavior.
Read:
sub-skills/training-and-inference/SKILL.mdsub-skills/training-and-inference/references/workflows.mdsub-skills/training-and-inference/references/model-catalog.mdsub-skills/training-and-inference/references/troubleshooting.mdsub-skills/training-and-inference/scripts/evaluate_results.pysub-skills/training-and-inference/scripts/strip_dataparallel.py
data-preparation
Use this route for:
- Extracting JPEG frames or RGB HDF5 files from raw videos.
- Building Kinetics, UCF101, HMDB51, MIT, or ActivityNet JSON metadata.
- Adding ActivityNet
fpsfields. - Questions about class directories, split files, HDF5 manifests, or
jpgversushdf5layout.
Read:
sub-skills/data-preparation/SKILL.mdsub-skills/data-preparation/references/workflows.mdsub-skills/data-preparation/references/data-formats.mdsub-skills/data-preparation/references/troubleshooting.mdsub-skills/data-preparation/scripts/extract_video_frames.pysub-skills/data-preparation/scripts/extract_video_hdf5.pysub-skills/data-preparation/scripts/build_annotation_json.py
Quick runtime helpers
scripts/check_imports.pyverifies that the core source modules import from a checkout and applies the temporary legacyScalealias when needed.scripts/check_main_help.pyprints the fullmain.pyCLI help through the same compatibility shim.scripts/run_main.pyforwards into the repository CLI after preparing the checkout and compatibility shim.
Shared environment facts
This repo expects a Python environment with PyTorch, torchvision, pandas, h5py, scikit-learn, joblib, and FFmpeg/FFprobe available on PATH.
A modern torchvision wheel may not expose torchvision.transforms.Scale. If that happens, use the compatibility shim in scripts/_torchvision_compat.py or a legacy torchvision release that still ships Scale.
Route selection guidance
- If the user already has prepared videos and annotation JSONs, start with
training-and-inference. - If the user still needs frames, HDF5 files, or split JSONs, start with
data-preparation. - If the request mentions both, do data preparation first unless the videos and labels are already ready.
- If the user only wants command discovery or environment checks, use the root helpers and the sub-skill references rather than reopening the source repo.
Common handoff sequence
- Prepare or verify the dataset layout with
data-preparation. - Verify the environment with
scripts/check_imports.py. - Inspect the CLI with
scripts/check_main_help.py. - Run the desired training or inference command with
scripts/run_main.py. - Score or clean outputs with the training-and-inference helpers.
Don’t do this
- Do not point future agents back to the original checkout paths.
- Do not use
flowwith JPEG inputs. - Do not assume resume checkpoints can change architecture.
- Do not score
--inference_no_averageJSON with the result evaluator before aggregating segment outputs.


