WorldBench

Advancing research in 3D and 4D world modeling, embodied AI, and autonomous driving through benchmarks, evaluation frameworks, and open-source tools.

16+
Projects
45+
Researchers
5
Benchmarks
10+
Open-Source Repos
Contributing Institutions
NUS NTU HUST HKUST ZJU CNRS-IPAL SenseTime Salesforce

About WorldBench

An open research initiative building the evaluation infrastructure for generative world models — from 3D scene understanding to closed-loop autonomous driving.

Benchmarks

Full-spectrum evaluation frameworks that go beyond perceptual metrics to assess geometry, physics, and behavioral realism.

World Modeling

Research on 3D/4D generative models, LiDAR synthesis, occupancy prediction, and future scene forecasting.

Autonomous Driving

Vision-language-action architectures, trajectory planning, and safety evaluation for real-world deployment.

Projects

A growing collection of benchmarks, surveys, models, and toolkits advancing world modeling research.

Flagship Benchmark

WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World

A unified benchmark evaluating how well a model builds, understands, and behaves within its generated world — spanning generation, reconstruction, action-following, downstream tasks, and human preference.

Comprehensive Survey

3D and 4D World Modeling: A Survey

A systematic survey covering the landscape of 3D and 4D generative world models — from video generation and scene reconstruction to occupancy prediction and LiDAR synthesis.

Surveys

3D and 4D World Modeling: A Survey

VLA for Autonomous Driving: Past, Present, and Future

Benchmarks & Evaluation

WorldLens: Full-Spectrum Evaluations of Driving World Models

VBench: Benchmark Suite for Video Generative Models

VBench++: Versatile Video Generation Benchmark

DriveBench: Are VLMs Ready for Autonomous Driving?

Pi3DET: Perspective-Invariant 3D Object Detection

World Modeling & Generation

DynamicCity: Large-Scale 4D Occupancy Generation

LiDARCrafter: Dynamic 4D World Modeling from LiDAR

SPIRAL: Semantic-Aware Progressive LiDAR Generation

See4D: Pose-Free 4D Generation via Auto-Regressive Inpainting

U4D: Uncertainty-Aware 4D World Modeling

AD-R1: Closed-Loop E2E Driving with World Models

Perception & Understanding

3EED: Ground Everything Everywhere in 3D

LaserMix: Multi-Modal 3D Scene Understanding

LargeAD: Large-Scale Data Pretraining for Autonomous Driving

Planning & Reasoning

OneVL: One-Step Latent Reasoning and Planning

Team

A growing community of researchers across institutions and industry labs worldwide.

Lingdong Kong
Lingdong Kong
Ao Liang
Ao Liang
Tianyi Yan
Tianyi Yan
Hongsi Liu
Hongsi Liu
Dekai Zhu
Dekai Zhu
Dongyue Lu
Dongyue Lu
Wei Yin
Wei Yin
Xiaoshuai Hao
Xiaoshuai Hao
Xiaotao Hu
Xiaotao Hu
Youquan Liu
Youquan Liu
Ziqi Huang
Ziqi Huang
Guoyang Zhao
Guoyang Zhao
Jianbiao Mei
Jianbiao Mei
Junyuan Deng
Junyuan Deng
Kaiwen Zhang
Kaiwen Zhang
Mingkai Jia
Mingkai Jia
Jialong Zuo
Jialong Zuo
Yixuan Hu
Yixuan Hu
Guangfeng Jiang
Guangfeng Jiang
Linfeng Li
Linfeng Li
Xiangtai Li
Xiangtai Li
Long Zhuo
Long Zhuo
Song Wang
Song Wang
Hang Song
Hang Song
Zeying Gong
Zeying Gong
Zhiyu Huang
Zhiyu Huang
Jun Cen
Jun Cen
Yang Wu
Yang Wu
Yu Yang
Yu Yang
Shenyuan Gao
Shenyuan Gao
Tianshuai Hu
Tianshuai Hu
Yiyao Zhu
Yiyao Zhu
Xiaolu Liu
Xiaolu Liu
Yong Liu
Yong Liu
Lai Xing Ng
Lai Xing Ng
Benoit R. Cottereau
Benoit R. Cottereau
Changxin Gao
Changxin Gao
Liang Pan
Liang Pan
Jun Ma
Jun Ma
Jianke Zhu
Jianke Zhu
Shaojie Shen
Shaojie Shen
Junwei Liang
Junwei Liang
Steven C.H. Hoi
Steven C.H. Hoi
Wei Tsang Ooi
Wei Tsang Ooi
Dacheng Tao
Dacheng Tao
Ziwei Liu
Ziwei Liu