Currently I'm a PhD candidate in the College of Information Science and Technology, Pennsylvania State University. Advised by Dr. Zhenhui (Jessie) Li, I'm mainly interested in the field of Data Mining (especially spatio-temporal data mining) and Reinforcement Learning. Before joining Penn State in 2017, I received my master and bachelor degree from Beihang University (BUAA) majoring in Computer Science, working with Prof. Jinpeng Huai and Dr. Tianyu Wo.
I've always been excited about real-world applications in industry. I interned at DiDi Research for 9 months working with Dr. Pinghua Gong and Prof. Jieping Ye on building online and offline models for carpooling recommendation, payment habits prediction and subsidy optimization. I also interned at Microsoft Asia-Pacific Research & Development Group as an intern working on integrating knowledge-based question answering methods into Microsoft's chatbot - XiaoIce. Supervised by Yue Liu, I also work with Dr. Nan Duan in MSRA on end-to-end answer prediction.
Last year, I had an exciting internship in Hangzhou City Brain Research with my advisor, working on intelligent transportation, epscially using reinforcement learning for traffic signal control.
[11/11/2019] Our paper "Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control" is accepted to AAAI 2020.
[11/03/2019] I'll serve as the session chair of "Urban Computing I" at CIKM 2019.
[09/15/2019] Paper, codes and posts for CoLight are available now.
[08/09/2019] Two papers about RL-based traffic signal control are accepted as full paper in CIKM 2019 Research track. See you in Beijing!
[08/04/2019] Our paper "A Unified Framework with Multi-source Data for Predicting Passenger Demands of Ride Services" is accepted to TKDD.
[06/17/2019] Paper, codes and demo for PressLight are available now.
[05/14/2019] I'll join JD Security Research Center in Silicon Valley for summer intern.
[05/01/2019] Our paper "PressLight: Learning Max Pressure Control to Coordinate Traffic Signals in Arterial Network" is accepted to the Research Track of KDD 2019! See you in Alaska!
[11/08/2018] I did my dissertation proposal on "Reinforcement Learning for Traffic Signal Control". Shout out to my committe members: Dr. C. Lee Giles, Dr. Xiang Zhang, Dr. Vikash V. Gayah and Dr. Zhenhui (Jessie) Li.
Office: E342 Westgate Building. University Park, PA 16802
Email: hzw77 at psu dot edu