SceneMemBench

A Benchmark for Scene Memory
in Interactive Video World Models

When a scene leaves the view, does the world remember it?

01

Out of sight.
Back in memory?

Watch the camera explore. Then see the scene return.

A familiar scene, seen again.

Camera route
First-person view
00:0000:29

Route details
History Revisit


02

Two ways to test scene memory.

Four camera paths. The same question: is the scene still there?

Explore Revisit

Return to a Seen View

The camera recovers a previously observed view.

Reversed Rotation

Observe

Turn away, then reverse the rotation to recover the same view.

Full Rotation

Observe

Rotate through a complete circle and face the starting direction again.

Return to a Novel View

The camera sees familiar content from a new position.

Forward and Look Back

Observe

Pass through a doorway, then turn around to see the other side of the surrounding scene.

New-Viewpoint Revisit

Observe

Start facing the target, explore elsewhere, then face the same target from a new viewpoint.

600 controlled trajectories across 33 UE scenes, plus 60 Full Rollout inputs.

Get the dataset on Hugging Face ↗
03

What do the models remember?

Compare generated revisits with the same ground-truth reference.

Reversed Rotation

Ground truth

0.00 s3.50 s
Playback details

Explore this route ↗