Xinran Liang

I am a first year Ph.D. student in Computer Science at Princeton University.

Previously, I received bachelor degree in Data Science and Applied Math from UC Berkeley. I was an undergraduate researcher at Robot Learning Lab as part of Berkeley Artificial Intelligence Research, where I was fortunate to be advised by Kimin Lee, Aditi Raghunathan, and Pieter Abbeel.

Email  /  Resume  /  Google Scholar  /  LinkedIn  /  Twitter  /  Github

profile photo
  • [Apr 2022] Starting Fall 2022, I will join Princeton University as a Ph.D. student in Computer Science!

I'm interested in computer vision and reinforcement learning.

Reward Uncertainty for Exploration in Preference-based Reinforcement Learning
Xinran Liang, Katherine Shu, Kimin Lee*, Pieter Abbeel*
International Conference on Learning Representations (ICLR), 2022
NeurIPS Deep Reinforcement Learning Workshop, 2021
paper / code

We propose a simple and efficient human-guided exploration method by measuring uncertainty in human instructions as intrinsic rewards.

Honors and Awards

Data 140: Probability for Data Science
Head Undergraduate Student Instructor: Spring 2022, Fall 2021, Spring 2021
Undergraduate Student Instructor: Fall 2020
Group Tutor: Spring 2020


Data 100: Principles and Techniques of Data Science
Undergraduate Student Instructor: Summer 2020

Redesigned from Jon Barron's source code.