Yichen Guo

Yichen Guo

AI Research

Nanyang Technological University

Seeking PhD · Spring / Fall 2027

← Back to Selected Work

CoRL 2026 · Accepted

SafeDojo

Safe Reinforcement Learning for VLA via Interactive World Model

Kai Tang, Peidong Jia, Zhong Chu, Jixian Wu, Rui Ma, Jiajun Cao, Fangyuan Zhao, Sixiang Chen, Yichen Guo, Xiaowei Chi, Chun-Kai Fan, Kevin Zhang, Jinchang Xu, Fubing Yang, Weishi Mi, Xiaozhu Ju, Jian Tang, Shanghang Zhang

Yichen Guo · Co-author

A project overview on Yichen Guo's research homepage, based on the linked paper.

Overview

SafeDojo studies how vision-language-action policies can learn safer robot behavior by exploring imagined futures. An interactive world model supplies feedback on both task progress and collision risk, allowing policy optimization to consider these objectives separately.

SafeDojo overview: world-model-based reward and cost evaluation supports safer VLA policy learning.
An overview of SafeDojo, reproduced from Figure 1 of the paper. Full text and figures

How it works

  1. Imagine action-conditioned futures

    A VLA policy proposes action chunks. An interactive video world model rolls them forward into predicted observations and latent dynamics.

  2. Evaluate progress and safety separately

    A task-success classifier scores imagined frames, while a safety head estimates collision costs from latent context and proposed actions.

  3. Update the policy under a safety constraint

    A Lagrangian-based constrained GRPO objective combines the reward and cost signals to improve task completion while controlling safety risk.

SafeDojo pipeline: imagined rollouts, separate task reward and safety cost estimation, and constrained GRPO updates.
The training pipeline, reproduced from Figure 2 of the paper. Full text and figures

Evaluation

The paper evaluates task completion, collision-free completion, and execution efficiency on SafeLIBERO with two obstacle settings, and tests transfer on five real-world Franka tasks. The linked paper provides the full protocols, comparisons, and limitations.

Paper and resources

SafeDojo: Safe Reinforcement Learning for VLA via Interactive World Model
arXiv:2606.20698

Figures and technical descriptions are based on the linked paper. The original author list and publication status are shown above.

Powered by Jekyll and the Minimal Light theme.

Research figure

Scroll to inspect the full figure. Press Escape to close.