Ziniu Li

Ph.D. student, School of Data Science, The Chinese University of Hong Kong, Shenzhen Email: ziniuli@link.cuhk.edu.cn [Twitter] [Zhihu]

About me

I am a Ph.D. student at The Chinese University of Hong Kong, Shenzhen (CUHKSZ), advised by Prof. Zhi-Quan (Tom) Luo.

My research interest is reinforcement learning theory, algorithms, and applications.

I have worked/interned at Tencent, Nanjing University, Cardinal Operations, etc.

My curriculum vitae can be downloaded from here.

Selective Work

*: indicating equal contribution or alphabetic ordering.

• Understanding Adversarial Imitation Learning in Small Sample Regime: A Stage-coupled Analysis
  Tian Xu*, Ziniu Li* , Yang Yu, Zhi-Quan Luo
  arXiv:2208.01899
  (This work presents the first horizon-free sample complexity bound of adversarial imitation learning (AIL),
  providing an answer to the open question –why does AIL outperform BC by a wide margin, particularly in the low data regime ? –
  raised in CoRL 2019 best paper by Ghasemipour et al.)

• Rethinking ValueDice: Does It Really Improve Performance?
  Ziniu Li* , Tian Xu*, Yang Yu, Zhi-Quan Luo
  In Proceedings of the 10th International Conference on Learning Representations (ICLR) (Blog Track), 2022
  (This work presents the first reduction of offline AIL to BC, showing that AIL is no better than BC in the offline setting)

• HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning
  Ziniu Li, Yingru Li, Yushun Zhang, Tong Zhang, Zhi-Quan Luo
  In Proceedings of the 10th International Conference on Learning Representations (ICLR), 2022
  (This work is selected as an oral presentation at Workshop on Ecological Theory of Reinforcement Learning at NeurIPS, 2021)

Service

Reviewer

NeurIPS’2022 (Top Reviewer), ICML’2022 (Outstanding Award), ICLR’2022 (Highlighted Award), DAI’2020.

Teaching Assistant

• CSC4120: Design and Analysis of Algorithms. 2022 Fall, CUHKSZ.

• DDA6111: Discrete Optimization. 2022 Spring, CUHKSZ.

• CSC4120: Design and Analysis of Algorithms. 2021 Fall, CUHKSZ.

• FTE4560: Basic Machine Learning. 2021 Spring, CUHKSZ.

• MAT3007: Introduction to Optimization. 2020 Fall, CUHKSZ.

Lecturer

• Machine Learning (Summer Course for Senior High School Students) @ X ACADEMY 2022 TechX.

Award

• [2021-04] Best oral presentation award at the first doctoral and postdoctoral forum of Shenzhen Research Institute of Big Data.