The editing tasks all share one shape: a live-action plate goes in, a specific, well-defined change comes out, and everything the edit shouldn’t touch is checked against a real second take of the same shot rather than against a model’s opinion of the result.
Remove a person or object from a live-action plate. Ground truth is a real second take of the same shot without them.
Removal in reverse: whether the inserted element belongs. Locked-off counterfactual shoot, plus an influence mask for its shadow and reflections.
read the spec ↗Comp-ready alpha: keying, hair, transparency, despill. Stratified by difficulty and never averaged into one number.
read the spec ↗Scene balancing across a sequence of shots. Perturb-and-restore objective core, plus the benchmark's first expert gate.
read the spec ↗
VFXBench