Search

MiS Preprint Repository

We have decided to discontinue the publication of preprints on our preprint server as of 1 March 2024. The publication culture within mathematics has changed so much due to the rise of repositories such as ArXiV (www.arxiv.org) that we are encouraging all institute members to make their preprints available there. An institute's repository in its previous form is, therefore, unnecessary. The preprints published to date will remain available here, but we will not add any new preprints here.

MiS Preprint
13/2019

Wasserstein of Wasserstein Loss for Learning Generative Models

Yonatan Dukler, Wuchen Li, Alex Tong Lin and Guido Montúfar

Abstract

The Wasserstein distance serves as a loss function for unsupervised learning which depends on the choice of a ground metric on sample space. We propose to use a Wasserstein distance as the ground metric on the sample space of images. This ground metric is known as an effective distance for image retrieval, since it correlates with human perception. We derive the Wasserstein ground metric on image space and define a Riemannian Wasserstein gradient penalty to be used in the Wasserstein Generative Adversarial Network (WGAN) framework. The new gradient penalty is computed efficiently via convolutions on the L2 (Euclidean) gradients with negligible additional computational cost. The new formulation is more robust to the natural variability of images and provides for a more continuous discriminator in sample space.

Received:
Jan 29, 2019
Published:
Jan 30, 2019
Keywords:
Wasserstein metric, GAN, statistical manifold

Related publications

inBook
2019 Journal Open Access
Yonatan Dukler, Wuchen Li, Alex Tong Lin and Guido Montúfar

Wasserstein of Wasserstein loss for learning generative models

In: Proceedings of the 36th international conference on machine learning, 9-15 June 2019, Long Beach, California, USA / Kamalika Chaudhuri (ed.)
Long Beach, California : PMLR, 2019. - pp. 1716-1725
(Proceedings of machine learning research ; 97)
Preprint
2020 Repository Open Access
Yonatan Dukler, Wuchen Li, Alex Tong Lin and Guido Montúfar

Wasserstein of Wasserstein loss for generative models - WWGAN [Computer code]