SMI / VIDEO WORLD MODELS

Spatial Memory Intelligence

Endowing World Models with Understanding-Driven Long-Term Memory

GitHub
Explore SMI
01 / THE BIG PICTURE

Spatial Memory Intelligence

Comparison of existing memory-management methods and SMI, illustrating memory sparsification, spatial consistency, and generation stability.
THE IDEA

Memory management,
with understanding.

As historical memory grows, managing spatial memory becomes increasingly complex, requiring coordinated organization, maintenance, sparsification, and retrieval. This calls for a more intelligent and comprehensive memory-management approach.

We propose Spatial Memory Intelligence (SMI), the first understanding-driven unified spatial-memory manager. Four coordinated atomic operations bring semantic and spatial reasoning into the memory-management pipeline, achieving comprehensive improvements in memory sparsity, spatial consistency, and generation stability across multiple baselines, benchmarks, and world-model backbones.

02 / THE FRAMEWORK

Method

SMI architecture: an understanding model coordinates spatial clustering, within-cluster sparsification, action-aware retrieval, and reliability-aware filtering around persistent spatial memory.
01ORGANIZE

Spatial
clustering

Group spatially related observations into coherent memory clusters.

02CONSOLIDATE

Within-cluster
sparsification

Remove redundant observations while retaining useful spatial evidence.

03RETRIEVE

Action-aware
retrieval

Select memories using recent context and the action that comes next.

04MAINTAIN

Reliability-aware
filtering

Keep unreliable generated observations from entering persistent memory.

03 / VIDEO COMPARISONS

Video comparisons

Side-by-side, in sync.

Red boxes mark selected spatial and structural inconsistencies.

HY1.5

Wan2.2

Loading videos…

04 / EXPLORE FURTHER

Resources

01

Paper

The paper link will be added here.

Coming soon
02

GitHub

SMI code repository.

View repository
03

Model · Hugging Face

Model weights will be linked here.

Coming soon
04

Dataset

The dataset link will be added here.

Coming soon