Jiaye Teng

Jiaye Teng
Email: tjy20 [at] mails.tsinghua.edu.cn
Research interests: generalization theory, machine learning and statistics

About Me

I am a Ph.D. student at Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University, and also an incoming tenure-track assistant professor at School of Statistics and Management, Shanghai University of Finance and Economics. I am very fortunate to have Professor Yang Yuan as my Ph.D. advisor. Previously, I visited Princeton University in 2023, advised by Professor Sanjeev Arora. I did my undergraduate at Shanghai University of Finance and Economics, advised by Professor Yang Bai.

Research Interests

My research interests lie in the machine learning theory, especially in the generalization of neural networks. I am also interested in statistical learning theory, including conformal inference and causal inference.
If you want to have a chat, always feel free to contact me through Email!

Recruitment for Ph.D. Students / Interns

I am happy to host remote graduate / undergraduate visitors and actively looking for Ph.D. students.

If you are interested, please read the guidelines and contact me!

News

I am going to join School of Statistics and Management, Shanghai University of Finance and Economics as a tenure-track assistance professor.

We are organizing a workshop in ICLR 2024 named "Bridging the Gap Between Practice and Theory in Deep Learning", please refer to here

Publications

When do Models Generalize? A Perspective from Data-Algorithm Compatibility [arxiv]
Jing Xu* , Jiaye Teng* , Yang Yuan, Andrew Chi-Chih Yao
Conference on Neural Information Processing Systems (NeurIPS) 2023

Finding Generalization Measures by Contrasting Signal and Noise [paper]
Jiaye Teng*, Bohang Zhang*, Ruichen Li*, Haowei He*, Yequan Wang, Yan Tian, Yang Yuan International Conference on Machine Learning (ICML) 2023

On Uni-Modal Feature Learning in Supervised Multi-Modal Learning [arxiv]
Chenzhuang Du*, Jiaye Teng*, Tingle Li, Yichen Liu, Tianyuan Yuan, Yue Wang, Yang Yuan, Hang Zhao
International Conference on Machine Learning (ICML) 2023

Predictive Inference with Feature Conformal Prediction [arxiv]
Jiaye Teng*, Chuan Wen*, Dinghuai Zhang*, Yoshua Bengio, Yang Gao, Yang Yuan
International Conference on Learning Representations (ICLR) 2023

Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models [arxiv]
Kaiyue Wen*, Jiaye Teng*, Jingzhao Zhang
International Conference on Learning Representations (ICLR) 2023

Fighting Fire with Fire: Avoiding DNN Shortcuts through Priming [arxiv] [paper]
Chuan Wen, Jianing Qian, Jierui Lin, Jiaye Teng, Dinesh Jayaraman, Yang Gao
International Conference on Machine Learning (ICML) 2022

Towards Understanding Generalization via Decomposing Excess Risk Dynamics [arxiv] [paper]
Jiaye Teng* , Jianhao Ma* , Yang Yuan
International Conference on Learning Representations (ICLR) 2022

Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis [arxiv]
Jiaye Teng* , Weiran Huang* , Haowei He*
International Conference on Artificial Intelligence and Statistics (AISTATS) 2022

T-SCI: A Two-Stage Conformal Inference Algorithm with Guaranteed Coverage for Cox-MLP [arxiv] [paper]
Jiaye Teng* , Zeren Tan* , Yang Yuan
International Conference on Machine Learning (ICML) 2021

Academic Service

Workshop Organizer : BGPT @ICLR 2024
Seminar Organizer (Chinese): International Seminar on Foundational Artificial Intelligence (FAI-Seminar)
Seminar Organizer: Foundations Of Data Science (FODS)
Reviewer: ICML, NeurIPS, ICLR, AISTATS, T-PAMI

Honors

2023 Wang Dazhong Scholarship at Tsinghua University
2022 National Scholarship at Tsinghua University
Top Reviewer in NeurIPS 2022
2020 Excellent Graduates in Shanghai
2018 National Scholarship at Shanghai University of Finance and Economics