Yi Li at University of Washington

Biography

I am actively seeking career opportunities.

I am a final-year Ph.D. student at the University of Washington, advised by Prof. Dieter Fox. My research focuses on robot learning, multimodal AI, and embodied intelligence, spanning areas such as Vision-Language-Action (VLA) models, perception, and generalizable manipulation policies.

I interned at NVIDIA Seattle Robotics Lab, where I worked on three projects under the mentorship of Dr. Ankit Goyal, Dr. Kaichun Mo, and Dr. Arsalan Mousavian. My work contributed to robotic skill learning, multimodal reasoning, and policy generalization.

Previously, I received my M.S. in Control Science and Technology from Tsinghua University, advised by Prof. Xiangyang Ji, and my B.S. in Automation from Tsinghua University. I also collaborated with Dr. Jifeng Dai and Dr. Kaiming He on deep learning and computer vision research.

I am passionate about foundation models, multimodal AI, and robotics, and I am looking for opportunities in robotics and multimodal agents.

News

Invited to give a talk at OpenAI, Google DeepMind and Bytedance Seed for our project HAMSTER.
Invited speaker on humanoid robot cognition, hosted by Bernstein.
Our paper HAMSTER has been accepted by ICLR 2025! Check our paper, demo and more details on the Project Page. Code and dataset will be released soon!
Our paper STOW has been accepted by CoRL 2023! Code and dataset is released on Github.!
Our paper DeepIM has been accepted by ECCV 2018 as oral! Code is released on Github. DeepIM was also selected as one of the 12 best papers at ECCV 2018, with an extended version published in IJCV.
Our paper Deformable ConvNets has been accepted by ICCV 2017. Code is released on Github. There is also a cool third-party improvement showing the best single-model performance on COCO dataset.
Awarded Summa Cum Laude in Beijing (top 2% at Tsinghua University).
Our paper FCIS has been accepted by the CVPR 2017 as spotlight! Check out the code on Github
We won first prize in MS COCO segmentation challenge 2016.
Our paper R-FCN has been accepted by the NeurIPS 2016 conference, and code is released on Github.
Our paper Inst-FCN has been accepted by the ECCV 2016 conference.
Awarded the National Scholarship (top 0.5% nationwide).

Selected Publications

(⁺ indicates co-first author)

HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation
Yi Li*, Yuquan Deng*, Jesse Zhang*, Joel Jang, Marius Memmel, Caelan Garrett, Fabio Ramos, Dieter Fox, Anqi Li, Abhishek Gupta, Ankit Goyal
International Conference on Learning Representations (ICLR), 2025
PDF, Bibtex, Project Page, Demo

@article{li2025hamster,
  title={HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation},
  author={Li, Yi and Deng, Yuquan and Zhang, Jesse and Jang, Joel and Memme, Marius and Yu, Raymond and Garrett, Caelan Reed and Ramos, Fabio and Fox, Dieter and Li, Anqi and others},
  journal={arXiv preprint arXiv:2502.05485},
  year={2025}
}

STOW: Discrete-Frame Segmentation and Tracking of Unseen Objects for Warehouse Picking Robots
Yi Li, Muru Zhang, Markus Grotz, Kaichun Mo, Dieter Fox
In Conference on Robot Learning (CoRL), 2023
PDF, Bibtex, Poster, Spotlight Video, Project Page

@inproceedings{
  li2023stow,
  title={{STOW}: Discrete-Frame Segmentation and Tracking of Unseen Objects for Warehouse Picking Robots},
  author={Yi Li and Muru Zhang and Markus Grotz and Kaichun Mo and Dieter Fox},
  booktitle={7th Annual Conference on Robot Learning},
  year={2023},
  url={https://openreview.net/forum?id=48qUHKUEdBf}
  }

DeepIM: Deep Iterative Matching for 6D Pose Estimation
Yi Li, Gu Wang, Xiangyang Ji, Yu Xiang, Dieter Fox
In International Journal of Computer Vision (IJCV), 2020
In European Conference on Computer Vision (ECCV), 2018 (oral).
PDF, Bibtex, Code Poster Slides Project Page IJCV PDF

@article{li2020deepim,
  title={DeepIM: Deep Iterative Matching for 6D Pose Estimation},
  author={Li, Yi and Wang, Gu and Ji, Xiangyang and Xiang, Yu and Fox, Dieter},
  journal={International Journal of Computer Vision},
  volume={128},
  number={3},
  pages={657--678},
  year={2020},
  publisher={Springer}
}

Deformable Convolutional Networks
Jifeng Dai⁺, Haozhi Qi⁺, Yuwen Xiong⁺, Yi Li⁺, Guodong Zhang⁺, Han Hu, and Yichen Wei
In International Conference on Computer Vision (ICCV), 2017 (oral).
PDF, Bibtex, Code

@inproceedings{dai2017deformable,
  title={Deformable convolutional networks},
  author={Dai, Jifeng and Qi, Haozhi and Xiong, Yuwen and Li, Yi and Zhang, Guodong and Hu, Han and Wei, Yichen},
  booktitle={Proceedings of the IEEE international conference on computer vision},
  pages={764--773},
  year={2017}
}

Fully Convolutional Instance-aware Semantic Segmentation
Yi Li⁺, Haozhi Qi⁺, Jifeng Dai, Xiangyang Ji, and Yichen Wei
In Computer Vision and Patter Recognition (CVPR), 2017 (spotlight)
PDF, Bibtex, Code Visualize Results, Slides

@inproceedings{li2017fully,
  title={Fully convolutional instance-aware semantic segmentation},
  author={Li, Yi and Qi, Haozhi and Dai, Jifeng and Ji, Xiangyang and Wei, Yichen},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={2359--2367},
  year={2017}
}

R-fcn: Object detection via region-based fully convolutional networks
Jifeng Dai, Yi Li, Kaiming He, Jian Sun
In Advances in Neural Information Processing Systems (NeurIPS), 2016
PDF, Bibtex, Code, Poster

@inproceedings{dai2016r,
  title={R-fcn: Object detection via region-based fully convolutional networks},
  author={Dai, Jifeng and Li, Yi and He, Kaiming and Sun, Jian},
  booktitle={Advances in Neural Information Processing Systems},
  pages={379--387},

year={2016}
}

Instance-sensitive fully convolutional networks
Jifeng Dai, Kaiming He, Yi Li, Shaoqing Ren, Jian Sun
In European Conference on Computer Vision (ECCV), 2016
PDF, Bibtex, Poster


@inproceedings{dai2016instance,
title={Instance-sensitive fully convolutional networks},
author={Dai, Jifeng and He, Kaiming and Li, Yi and Ren, Shaoqing and Sun, Jian},
booktitle={European Conference on Computer Vision},
pages={534--549},
year={2016},
organization={Springer International Publishing}
}

Honor and Awards

Reviewer ofAAAI, ICCV, CVPR, ECCV, ICRA, IROS, ICLR, RA-L since 2018

Outstanding 2017 Master's Thesis by the Chinese Institute of Electronics (ranked 10th in China)

Outstanding 2017 Graduate Student in Beijing

Outstanding 2016 Intern in MSRA

2013 National Scholarship

2012 Tsinghua Alumni Zheng Geru Scholarship