Back to Search Start Over

Nonparametric Mixture MLEs Under Gaussian-Smoothed Optimal Transport Distance

Authors :
Han, Fang
Miao, Zhen
Shen, Yandi
Source :
IEEE Transactions on Information Theory; December 2023, Vol. 69 Issue: 12 p7823-7835, 13p
Publication Year :
2023

Abstract

The Gaussian-smoothed optimal transport (GOT) framework, pioneered by Goldfeld et al. and followed up by a series of subsequent papers, has quickly caught attention among researchers in statistics, machine learning, information theory, and related fields. One key observation made therein is that, by adapting to the GOT framework instead of its unsmoothed counterpart, the curse of dimensionality for using the empirical measure to approximate the true data generating distribution can be lifted. The current paper shows that a related observation applies to the estimation of nonparametric mixing distributions in discrete exponential family models, where under the GOT cost the estimation accuracy of the nonparametric MLE can be accelerated to a polynomial rate. This is in sharp contrast to the classical sub-polynomial rates based on unsmoothed metrics, which cannot be improved from an information-theoretical perspective. A key step in our analysis is the establishment of a new Jackson-type approximation bound of Gaussian-smoothed Lipschitz functions. This insight bridges existing techniques of analyzing the nonparametric MLEs and the new GOT framework.

Details

Language :
English
ISSN :
00189448 and 15579654
Volume :
69
Issue :
12
Database :
Supplemental Index
Journal :
IEEE Transactions on Information Theory
Publication Type :
Periodical
Accession number :
ejs64725162
Full Text :
https://doi.org/10.1109/TIT.2023.3296380