A Theory of Feature Learning in Kernel Models

发布者:梁慧丽发布时间:2026-03-19浏览次数:10

主讲人

Feng Ruan

Northwestern University

时间

2026年3月19日 星期四

下午 14:00-15:00

地点

上财计算机与人工智能学院104会议室


Abstract


We study feature learning in a compositional variant of kernel ridge regression in which the predictor is applied to a learnable linear transformation of the input. When the response depends on the input only through a low-dimensional predictive subspace, we show that all global minimizers of the population objective for the linear transformation annihilate directions orthogonal to this subspace, and in certain regimes, exactly identify the subspace. Moreover, we show that global minimizers of the finite-sample objective inherit the exact same low-dimensional structure with high probability, even without any explicit penalization on the linear transformation.

Biography


图片

Feng Ruan is an Assistant Professor in the Department of Statistics and Data Science at Northwestern University. His research lies at the intersection of machine learning, statistics, and optimization. He works broadly on two themes: representation learning, particularly how models discover low-dimensional predictive structure in data; and the variational and algorithmic foundations of nonsmooth and nonconvex optimization problems arising in statistical learning.

搜索
您想要找的