ROCKET-1: Master Open-World Interaction with Visual-Temporal Context Prompting

Shaofei Cai, Zihao Wang, Kewei Lian, Zhancun Mu, Xiaojian Ma, Anji Liu, Yitao Liang

NeurIPS 2024 Open-World Agent Workshop | Paper | Cite | Code | Page

GROOT: Learning to Follow Instructions by Watching Gameplay Videos

Shaofei Cai, Bowei Zhang, Zihao Wang, Xiaojian Ma, Anji Liu, Yitao Liang

Spotlight Presentation (Top-5%)

ICLR 2024 | Paper | Cite | Code | Page | Twitter

Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction

Shaofei Cai, Zihao Wang, Xiaojian Ma, Anji Liu, Yitao Liang

CVPR 2023 | Paper | Cite | Code

OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents

Zihao Wang, Shaofei Cai, Zhancun Mu, Haowei Lin, Ceyao Zhang, Xueije Liu, Qing Li, Anji Liu, Xiaojian Ma, Yitao Liang

NeurIPS 2024 | Paper | Twitter | Page

JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models

Zihao Wang, Shaofei Cai, Anji Liu, Yonggang Jin, Jinbing Hou, Bowei Zhang, Haowei Lin, Zhaofeng He, Zilong Zheng, Yaodong Yang, Xiaojian Ma, Yitao Liang

arxiv | Paper | Cite | Code | Page | Twitter

Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

Zihao Wang, Shaofei Cai, Xiaojian Ma, Anji Liu, Yitao Liang

ICML 2023 TEACH Workshop Best Paper Award

Neurips 2023 | Paper | Cite | Code

Automatic Relation-aware Graph Network Proliferation

Shaofei Cai, Liang Li, Xinzhe Han, Jiebo Luo, Zheng-jun Zha, Qingming Huang

Oral Presentation (Top-4%)

CVPR 2022 | Paper | Cite | Code | Video | Poster

Rethinking Graph Neural Architecture Search from Message-Passing

Shaofei Cai, Liang Li, Jincan Deng, Beichen Zhang, Zheng-Jun Zha, Li Su, Qingming Huang

CVPR 2021 | Paper | Cite | Code

Semantic and Correlation Disentangled Graph Propagation for Multi-label Image Recognition

Shaofei Cai, Liang Li, Xinzhe Han, Qi Tian, Qingming Huang

IEEE Trans. Neural Netw. Learn. Syst. (TNNLS 2023) | Paper | Cite

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

Bingchuan Li*, Shaofei Cai*, Wei Liu, Peng Zhang, Miao Hua, Qian He, Zili Yi

WACV 2023 | Paper | Cite | Code

IR-GAN: Image Manipulation with Linguistic Instruction by Increment Reasoning

Zhenhuan Liu, Jincan Deng, Liang Li, Shaofei Cai, Qianqian Xu, Shuhui Wang, Qingming Huang

Oral Presentation

ACM MM 2020 | Paper | Cite

Edge-featured Graph Neural Architecture Search

Shaofei Cai, Liang Li, Xinzhe Han, Zheng-jun Zha, Qingming Huang

arxiv | Paper | Cite