Ph.D. candidate · Computer vision and Deep learning

Hi there! I am a Ph.D. candidate at Penn State University and advised by Dr. Sharon Huang. I received my B.S. and M.S. at Tsinghua University. My research interest lies in computer vision, deep learning, robotics, and human-centered AI.


Cascade Transformers for End-to-End Person Search

Rui Yu, Dawei Du, Rodney LaLonde, Daniel Davila, Christopher Funk, Anthony Hoogs, Brian Clipp
IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[pdf] [code]

Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps

Jingyi Xie*, Rui Yu*, Sooyeon Lee, Yao Lyu, Syed Masum Billah, John M. Carroll
ACM SIGCHI Conference on Designing Interactive Systems (DIS), 2022
[pdf] [video] *Equal contribution

Opportunities for Human-AI Collaboration in Remote Sighted Assistance

Sooyeon Lee*, Rui Yu*, Jingyi Xie, Syed Masum Billah, John M. Carroll
ACM International Conference on Intelligent User Interfaces (IUI), 2022
[pdf] [video] [PSU News] *Equal contribution

Towards Robust Human Trajectory Prediction in Raw Videos

Rui Yu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021
[pdf] [code]

Data-Driven Distributed State Estimation and Behavior Modeling in Sensor Networks

Rui Yu, Zhenyuan Yuan, Minghui Zhu, Zihan Zhou
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020

Deep-Person: Learning Discriminative Deep Features for Person Re-Identification

Xiang Bai, Mingkun Yang, Tengteng Huang, Zhiyong Dou, Rui Yu, Yongchao Xu
Pattern Recognition (PR), 2020
[pdf] [code]

Hard-Aware Point-to-Set Deep Metric for Person Re-identification

Rui Yu, Zhiyong Dou, Song Bai, Zhaoxiang Zhang, Yongchao Xu, Xiang Bai
European Conference on Computer Vision (ECCV), 2018

Divide and Fuse: A Re-ranking Approach for Person Re-identification

Rui Yu, Zhichao Zhou, Song Bai, Xiang Bai
British Machine Vision Conference (BMVC), 2017


Pennsylvania State University

Research Assistant

Committee: Sharon Huang, Zihan Zhou, John M. Carroll, Syed Billah, Minghui Zhu

  • Vision-based Pedestrian Tracking and Trajectory Prediction
  • Distributed State Estimation and Behavior Modeling
  • Computer Vision for Remote Sighted Assistance
Aug. 2018 - Present

Snap Inc. 

Research Intern

Mentor: Yicheng Wu; Manager: Guru Krishnan; Director: Shree Nayar

  • Face Analysis with Multi-Camera Smartphone
May 2022 - Aug. 2022

Kitware Inc. 

Research Intern

Mentor: Dawei Du; Manager: Brian Clipp

  • End-to-end Person Search and Video-based Person Re-identification
May 2021 - Aug. 2021

Toyota Research Institute 

Research Intern

Mentor: Guy Rosman, Brandon Northcutt; Manager: Luke Fletcher

  • Vision-based Pedestrian Trajectory Prediction for Automated Driving
Jun. 2020 - Aug. 2020

Huazhong University of Science and Technology

Research Engineer

Supervisor: Xiang Bai

  • Person Re-identification and Visual Retrieval
Jul. 2016 - Jul. 2018