Prepare AnomalyGenNext Inputs
The first action freezes eligible false-negative identities, isolates each FN mask to its bounding box, selects one deterministic same-type mask, and emits the clean and FN embedding specs. The second action consumes those embedding results, preserves every FN-to-clean pair, and runs native automatic mask placement (AMP) from the AnomalyGenNext container. The final action accepts only pairs for which both mask branches passed AMP, then freezes the exact generation inputs and their hashes.
Input contract
Start from assets/default_filtering.yaml. The gap parquet must contain:
textimage_id filepath gap_type bbox class split dataset_id texture_id defect_class anomaly_type fn_mask_source
Identity is explicit: anomaly_type must equal
texture_id+defect_class. Preparation intentionally has no filename or
directory-layout inference. A caller adapting an unfamiliar dataset must
normalize these fields before this boundary.
Clean references are resolved independently for each routed FN/type. A missing
directory or a directory with no supported images skips only affected FNs with
reason no_clean_reference_images; it does not disable other types.
Each selected dataset maps to an existing fine-tuned checkpoint and recipe.
The recipe must declare the exact anomaly type, and defect_spec.jsonl must
contain its placement definition. Text-routed definitions require a nonempty
roi_prompt_defect_location. The pool layout is:
textPOOL/TEXTURE/clean_image/* POOL/TEXTURE/mask/DEFECT/*
Action
Run through the selected platform after the common launch review:
bashscripts/prepare_anomalygennext_inputs.py \ --config /path/to/filtering.yaml \ --pool-dataset-root /path/to/anomalygen_pool \ --output-dir /new/result/root
The output root must not exist. The action emits fn_queries.parquet,
selected_fn_queries.parquet, mask_selection.parquet, clean_pool.parquet,
two tao-generate-image-embeddings specs, the copied filtering config, and
input_contract.json. Mask eligibility is evaluated per FN. The contract lists
eligible FN IDs plus stable skipped FN IDs and machine-readable reasons; skipped
FNs are absent from every query, embedding, mask, and AMP input. Donor masks are
tried in deterministic order until one valid same-type donor is found.
If no FN survives, preparation emits only a SKIPPED input_contract.json
with reason no_eligible_false_negatives. Detailed skip_counts, per-FN
records, and warning evidence distinguish missing clean references from mask
eligibility failures. Do not run embeddings or AMP for that typed no-op, and do
not represent it as generation success. A partial skip emits warning evidence
while specs contain only eligible FNs.
pool_dataset_root is one user-level folder input for the workflow. The
platform stages it once and retains the binding between its source and the
compute-visible path passed to preparation. Preparation freezes that compute
path into filtering_config.yaml, every clean filepath in clean_pool.parquet,
and input_contract.json. The contract declares the same typed folder as a
read-only downstream input for clean-image embedding and AMP. Each later
container must remount the original source at that exact compute path; the
generated script arguments are platform plumbing, not new user choices.
Run both emitted specs through tao-generate-image-embeddings, preserving the
same encoder. The clean-image embedding action must consume
input_contract.json.downstream_inputs.clean_embeddings so the pool paths in
its parquet resolve. The FN embedding action likewise needs mounts for the
source-image paths already carried by its input parquet. Place both outputs
under embeddings/ as named by the specs, then submit the run_amp action:
bashscripts/run_anomalygennext_amp.py \ --prepared-root /temporary/execution/root \ --published-root /persistent/result/root \ --pool-dataset-root /path/to/anomalygen_pool \ --checkpoint-root /workspace/paidf-anomalygen/checkpoints
run_amp always loads the frozen config below --prepared-root; it accepts no
second config. Its typed pool argument confirms that the platform remounted the
folder at the path already frozen into the config and parquets.
This writes knn_candidates.parquet, the native AMP request, and
amp/testcase.jsonl. When execution uses temporary storage, --published-root
records the persistent locations that will contain the saved results. The
complete checkpoint root is a required typed input mounted at the image's
canonical /workspace/paidf-anomalygen/checkpoints path. Before GPU work,
run_amp verifies the pinned Qwen cache, the configured amp.model_id as a
complete direct-local model or Hugging Face snapshot, and
facebook/sam2.1-hiera-large/sam2.1_hiera_large.pt; a separately mounted SAM2
file does not satisfy
the native runtime contract. The selected platform must honor the declared
checkpoint_root.container_path; the leaf rejects a different mount point.
Finalize the saved output in that persistent
result root:
bashscripts/finalize_anomalygennext_inputs.py --prepared-root /existing/result/root
The finalizer writes pair status, selected pairs, copied aligned masks, per-dataset testcase and provenance JSONL, and a generation plan plus integrity manifest. A clean image is unique only within one FN; separate FNs may reuse it. Platform skills own staging and cache placement.
Gates
- Preserve each box-level FN as a distinct
fn_id. - Produce exactly two masks per FN: isolated FN and deterministic same-type.
- Skip one invalid FN without aborting other eligible FNs.
- Embed a repeated source image once while preserving every FN query row.
- Require successful, nonempty, non-full-image aligned masks for both branches.
- Never infer an anomaly type or placement prompt.
- Refuse output reuse and never mutate a training pool.
- Platform skills own transient staging, caches, and copy-back.
Read references/input-contract.md when authoring the normalized parquet or
dataset mapping.
