1. Generalization Bounds for Contextual Stochastic Optimization using Kernel Regression
- Author
-
Wang, Yijie, Hanasusanto, Grani A., and Ho, Chin Pang
- Subjects
Mathematics - Optimization and Control - Abstract
In this paper, we consider contextual stochastic optimization using Nadaraya-Watson kernel regression, which is one of the most common approaches in nonparametric regression. Recent studies have explored the asymptotic convergence behavior of using Nadaraya-Watson kernel regression in contextual stochastic optimization; however, the performance guarantee under finite samples remains an open question. This paper derives a finite-sample generalization bound of the Nadaraya-Watson estimator with a spherical kernel under a generic loss function. Based on the generalization bound, we further establish a suboptimality bound for the solution of the Nadaraya-Watson approximation problem relative to the optimal solution. Finally, we derive the optimal kernel bandwidth and provide a sample complexity analysis of the Nadaraya-Watson approximation problem.
- Published
- 2024