Yi Li at University of Washington

Biography

I am currently a final year PhD student at the University of Washington advised by Prof. Dieter Fox.

Before that, I received my M.S. degree in Control Science and Technology from Tsinghua University advised by Prof. Xiangyang Ji and my bachelor's degree in Automation from Tsinghua University. I also worked with Dr. Jifeng Dai as a research intern at Microsoft Research Asia.

My research focuses on perception and reasoning in robotics.

News

Our paper HAMSTER has been submitted to ICLR 2025! Paper, code and dataset will be released soon!
Our paper STOW has been accepted by CoRL 2023! Code and dataset is coming!
Our paper DeepIM has been accepted by ECCV 2018 as oral! Code is released on Github and award one of the 12 best papers in ECCV 2018. An extended version is published on IJCV.
Our paper Deformable ConvNets has been accepted by ICCV 2017. Code is released on Github. There is also a cool third-party improvement showing the best single-model performance on COCO dataset.
Awarded Excellent Graduates of Beijing.
Our paper FCIS has been accepted by the CVPR 2017 as spotlight! Check out the code on Github
We won first prize in MS COCO segmentation challenge 2016.
Our paper R-FCN has been accepted by the NeurIPS 2016 conference, and code is released on Github.
Our paper Inst-FCN has been accepted by the ECCV 2016 conference.

Selected Publications

(⁺ indicates co-first author)

HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation
Yi Li*, Yuquan Deng*, Jesse Zhang*, Joel Jang, Marius Memmel, Caelan Garrett, Fabio Ramos, Dieter Fox, Anqi Li, Abhishek Gupta, Ankit Goyal
International Conference on Learning Representations (ICLR), 2025 Under Review
PDF Project Page

@inproceedings{
  }

STOW: Discrete-Frame Segmentation and Tracking of Unseen Objects for Warehouse Picking Robots
Yi Li, Muru Zhang, Markus Grotz, Kaichun Mo, Dieter Fox
In Conference on Robot Learning (CoRL), 2023
PDF, Bibtex, Poster, Spotlight Video, Project Page

@inproceedings{
  li2023stow,
  title={{STOW}: Discrete-Frame Segmentation and Tracking of Unseen Objects for Warehouse Picking Robots},
  author={Yi Li and Muru Zhang and Markus Grotz and Kaichun Mo and Dieter Fox},
  booktitle={7th Annual Conference on Robot Learning},
  year={2023},
  url={https://openreview.net/forum?id=48qUHKUEdBf}
  }

DeepIM: Deep Iterative Matching for 6D Pose Estimation
Yi Li, Gu Wang, Xiangyang Ji, Yu Xiang, Dieter Fox
In International Journal of Computer Vision (IJCV), 2020
In European Conference on Computer Vision (ECCV), 2018 (oral).
PDF, Bibtex, Code Poster Slides Project Page IJCV PDF

@article{li2020deepim,
  title={DeepIM: Deep Iterative Matching for 6D Pose Estimation},
  author={Li, Yi and Wang, Gu and Ji, Xiangyang and Xiang, Yu and Fox, Dieter},
  journal={International Journal of Computer Vision},
  volume={128},
  number={3},
  pages={657--678},
  year={2020},
  publisher={Springer}
}

Deformable Convolutional Networks
Jifeng Dai⁺, Haozhi Qi⁺, Yuwen Xiong⁺, Yi Li⁺, Guodong Zhang⁺, Han Hu, and Yichen Wei
In International Conference on Computer Vision (ICCV), 2017 (oral).
PDF, Bibtex, Code

@inproceedings{dai2017deformable,
  title={Deformable convolutional networks},
  author={Dai, Jifeng and Qi, Haozhi and Xiong, Yuwen and Li, Yi and Zhang, Guodong and Hu, Han and Wei, Yichen},
  booktitle={Proceedings of the IEEE international conference on computer vision},
  pages={764--773},
  year={2017}
}

Fully Convolutional Instance-aware Semantic Segmentation
Yi Li⁺, Haozhi Qi⁺, Jifeng Dai, Xiangyang Ji, and Yichen Wei
In Computer Vision and Patter Recognition (CVPR), 2017 (spotlight)
PDF, Bibtex, Code Visualize Results, Slides

@inproceedings{li2017fully,
  title={Fully convolutional instance-aware semantic segmentation},
  author={Li, Yi and Qi, Haozhi and Dai, Jifeng and Ji, Xiangyang and Wei, Yichen},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={2359--2367},
  year={2017}
}

R-fcn: Object detection via region-based fully convolutional networks
Jifeng Dai, Yi Li, Kaiming He, Jian Sun
In Advances in Neural Information Processing Systems (NeurIPS), 2016
PDF, Bibtex, Code, Poster

@inproceedings{dai2016r,
  title={R-fcn: Object detection via region-based fully convolutional networks},
  author={Dai, Jifeng and Li, Yi and He, Kaiming and Sun, Jian},
  booktitle={Advances in Neural Information Processing Systems},
  pages={379--387},

year={2016}
}

Instance-sensitive fully convolutional networks
Jifeng Dai, Kaiming He, Yi Li, Shaoqing Ren, Jian Sun
In European Conference on Computer Vision (ECCV), 2016
PDF, Bibtex, Poster


@inproceedings{dai2016instance,
title={Instance-sensitive fully convolutional networks},
author={Dai, Jifeng and He, Kaiming and Li, Yi and Ren, Shaoqing and Sun, Jian},
booktitle={European Conference on Computer Vision},
pages={534--549},
year={2016},
organization={Springer International Publishing}
}

Honor and Awards

Reviewer ofAAAI, ICCV, CVPR, ECCV, ICRA, IROS, ICLR, RA-L since 2018

Outstanding 2017 Master's Thesis by the Chinese Institute of Electronics (ranked 10th in China)

Outstanding 2017 Graduate Student in Beijing

Outstanding 2016 Intern in MSRA

2013 National Scholarship

2012 Tsinghua Alumni Zheng Geru Scholarship