论文标题

概率分布的广义切片距离

Generalized Sliced Distances for Probability Distributions

论文作者

Kolouri, Soheil, Nadjahi, Kimia, Simsekli, Umut, Shahrampour, Shahin

论文摘要

概率指标已成为现代统计和机器学习的必不可少的一部分,并且它们在各种应用中起着典型的作用,包括统计假设测试和生成建模。但是,在实际情况下,除了一些具体情况外,在这些距离上构建的算法的收敛行为尚未得到很好的确定。在本文中,我们引入了一个广泛的概率指标家族,这些指标被认为是一般切片概率指标(GSPM),这些指标深深植根于广义ra transform。我们首先验证GSPM是指标。然后,我们确定具有新型正定核的最大平均差异(MMD)等效的GSPM的子集,这些核具有独特的几何解释。最后,通过利用这种连接,我们将基于GSPM的梯度流进行生成建模应用,并表明在轻度假设下,梯度流将其收敛到全局最佳。我们说明了在真实和合成问题上的方法的实用性。

Probability metrics have become an indispensable part of modern statistics and machine learning, and they play a quintessential role in various applications, including statistical hypothesis testing and generative modeling. However, in a practical setting, the convergence behavior of the algorithms built upon these distances have not been well established, except for a few specific cases. In this paper, we introduce a broad family of probability metrics, coined as Generalized Sliced Probability Metrics (GSPMs), that are deeply rooted in the generalized Radon transform. We first verify that GSPMs are metrics. Then, we identify a subset of GSPMs that are equivalent to maximum mean discrepancy (MMD) with novel positive definite kernels, which come with a unique geometric interpretation. Finally, by exploiting this connection, we consider GSPM-based gradient flows for generative modeling applications and show that under mild assumptions, the gradient flow converges to the global optimum. We illustrate the utility of our approach on both real and synthetic problems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源