Qian Lin

About

I am currently a first-year Ph.D. student in Computer Science at the Kahlert School of Computing, advised by Dr. Daniel S. Brown. Previously, I earned my master’s degree from Sun Yat-sen University in China. My research focuses on reinforcement learning, with an emphasis on learning from offline data and human feedback, safe and constrained decision-making, and multi-objective optimization. More recently, I have been working on model interpretability in human feedback alignment systems.

Recent Updates

[Jun, 2026] Presented a poster on Implicit Safety Alignment from Crowd Preferences at Utah AI Convergence 2026; the poster was selected for a Lightning Talk.
[May, 2026] Implicit Safety Alignment from Crowd Preferences accepted by ICML 2026.
[May, 2026] Multi-Modal, Multi-Environment Machine Teaching for Robust Reward Learning accepted by RLC 2026.
[May, 2026] Understanding the Effects of Neuron Dominance in Deep Reinforcement Learning accepted by TMLR.

Publications

Implicit Safety Alignment from Crowd Preferences

Qian Lin, Daniel S. Brown

ICML 2026.

[Paper]

Multi-Modal, Multi-Environment Machine Teaching for Robust Reward Learning

Ali Larian, Qian Lin, Chang Zong Wu, Daniel S. Brown

RLC 2026.

[Paper]

Understanding the Effects of Neuron Dominance in Deep Reinforcement Learning

Zifan Wu, Qian Lin, Blake Lawlor, Haijun Zhao, Daniel S. Brown

TMLR.

[Paper]

Reliability-Guaranteed and Reward-Seeking Sequence Modeling for Model-Based Offline Reinforcement Learning

Shenghong He, Chao Yu, Qian Lin, Yile Liang, Donghui Li, Xuetao Ding

AAAI 2026.

[Paper]

Conservative Offline Goal-Conditioned Implicit V-Learning

Kaiqiang Ke, Qian Lin, Zongkai Liu, Shenghong He, Chao Yu

ICML 2025.

[Paper]

Offline Multi-Agent Reinforcement Learning via In-Sample Sequential Policy Optimization

Zongkai Liu, Qian Lin, Chao Yu, Xiawei WU, Yile Liang, Donghui Li, Xuetao Ding

AAAI 2025.

[Paper]

An Offline Adaptation Framework for Constrained Multi-Objective Reinforcement Learning

Qian Lin, Zongkai Liu, Danying Mo, Chao Yu

NeurIPS 2024.

[Paper]

Off-Policy Primal-Dual Safe Reinforcement Learning

Zifan Wu, Bo Tang*, Qian Lin*, Chao Yu, Shangqin Mao, Qianlong Xie, Xingxing Wang, Dong Wang

ICLR 2024.

[Paper] [Code]

Policy-regularized Offline Multi-objective Reinforcement Learning

Qian Lin, Chao Yu, Zifan Wu, Zongkai Liu

AAMAS 2024.

[Paper] [Code]

Safe Offline Reinforcement Learning with Real-Time Budget Constraints

Qian Lin, Bo Tang*, Zifan Wu*, Chao Yu, Shangqin Mao, Qianlong Xie, Xingxing Wang, Dong Wang

ICML 2023.

[Paper] [Code]

Selected Awards

Outstanding Graduate Thesis Award, 2025.
Chinese National Scholarship, 2024.
Xiaomi Scholarship, 2023.
First Prize of Sun Yat-sen University Graduate Scholarship and Grant, 2022–2024.
Grant Prize at the RoboMaster Sim2Real Challenge (2022 IEEE Conference on Games), 2022.

Miscellaneous

The pronunciation of my name, Qian Lin, is "chee-an leen".

I like electric guitar, movies, Chinese chess and table tennis.

I have been a member of the Duxing Volunteer Service Team since 2019, where I participate in animal rescue activities to assist stray cats and dogs.