Midcentury · datasets

Dataset · sample viewer

Spatiotemporal Gameplay

Real licensed gameplay, captured at the engine level — press play, then switch tabs to watch camera trajectory, keyboard, mouse, and depth.

Contact us
Clips
10 samples
Resolution
up to 4K
Frame rate
60 fps
Modalities
RGB · audio · inputs · camera
Format
MP4 + JSON
Usage
Research preview
Overview

Pristine gameplay at up to 4K/60fps, with HUD, menus, and UI stripped at the engine level before recording — models train on the raw 3D world, not screen capture. Long, uncut sessions preserve spatial layout and temporal dynamics across long horizons, and every recording ships with synchronized engine-level signals rather than pixels alone.

Annotations

AI-generated scene labels across 1,000+ activity types — each segment tagged with what is happening, where, and when — alongside per-frame camera pose, raw input, and physics/game state as synchronized JSON.

Provenance

Real, licensed gameplay captured with consent; HUD and UI removed at the engine level; no screen capture. Licensable for research use.

Captured per recording
Video

Pristine gameplay up to 4K/60fps. HUD, menus, and UI stripped at the engine level before recording — the raw 3D world, not screen capture.

Audio

In-game audio as separate tracks — dialogue, environmental sound, and effects at full fidelity.

Human inputs

Raw keyboard and mouse from hardware: exact key sequences, mouse deltas, and timing. Not inferred from video.

Camera & spatial telemetry

3D camera position, rotation, field of view, and velocity, extracted directly from the game engine.

Physics & game state

Engine-level physics — object positions, collisions, velocities, and environmental state — as synchronized JSON.

Scene annotations

AI-generated labels across 1,000+ activity types. Each segment tagged with what is happening, where, and when.

Sample Viewer

10 of 10 clips

The clip you're viewing — pick another from the library below.

Type
Now viewing2560×1440 · 0:12
Open WorldAdventure
View

Sample 01

PLACEHOLDER — third-person traversal through a stylized environment.

Placeholder — sample footage coming soon
2560×1440 · 60fps
0:12 preview2560×144060 fps55 MB29.2k events
Details
Frames
8,627
Avg FPS
41.5
FOV
85°
Camera pose
6-DoF
Input events
29,164
0.0s
elapsed
0.0k
events
22/s
rate
top-down · FOV 85°
-139.5°
yaw
-0.9°
pitch
0.2°
roll
-0.08
pos x
1.60
pos y
-0.10
pos z

Camera pose (position + rotation), trajectory, and FOV — a first-class geometric signal for action control and long-horizon 3D consistency. Intrinsics / extrinsics available in the raw feed.

Browse

Clip Library

10 of 10 clips