DENG LAB · SJTU

Efficient AI,
across modalities.

School of Computer ScienceShanghai Jiao Tong University

We develop methods and theory for efficient, effective, reliable, and trustworthy generative AI.

Our work spans unified multimodal models, world models and VLA, efficient architectures, and training, inference and RL infrastructure.

DENG Lab members gathered around a conference table at Shanghai Jiao Tong University.
DENG Lab, Shanghai · 2025

Selected research

All publications
CLLMs global consistency objective mapping intermediate states on a Jacobi decoding trajectory directly to the converged token sequence.

CLLMs

ICML 2024

Consistency training turns pretrained language models into fast parallel decoders without extra draft models.

D2F overview: block-wise causal diffusion training aligned with a pretrained bidirectional diffusion model.

D2F

ICLR 2026

Discrete diffusion forcing enables KV caching and pipelined parallel decoding for faster diffusion language models.

Orthus architecture with text and image embeddings, a shared autoregressive transformer, and language and diffusion output heads.

Orthus

ICML 2025

A shared autoregressive transformer generates interleaved text and images through modality-specific heads.

Mantis paper teaser showing its human-video, robot-demonstration and multimodal data sources, disentangled visual foresight, adaptive temporal ensemble, and embodied reasoning examples.

Mantis

CVPR 2026

A vision–language–action model uses disentangled visual foresight to connect prediction and action.

  1. LatentUM is accepted by NeurIPS 2026 as an Oral paper! 🎉
  2. MBD-LMs is accepted as an Oral paper at EMNLP 2026, and CForce is also accepted by EMNLP 2026! 🎉
  3. World-Language-Action Model is accepted by CoRL 2026! 🎉
  4. MirrorPPR is accepted by ECCV 2026! 🎉

Sponsors & Collaborators

National Natural Science Foundation of China
Shanghai Municipal Science and Technology Commission
Sharpa
OPPO
Kuaishou
Huawei
Tsinghua University
Zhipu AI
Alimama
Ant Group
Transsion
Shanghai Innovation Institute

Join our lab

Interested in fundamental AI research? We would love to hear from you.

Get in touch

Research figure