WIAS Preprint No. 2688, (2020)

Gradient methods for problems with inexact model of the objective



Authors

  • Stonyakin, Fedor
  • Dvinskikh, Darina
  • Dvurechensky, Pavel
    ORCID: 0000-0003-1201-2343
  • Kroshnin, Alexey
  • Kuznetsova, Olesya
  • Agafonov, Artem
  • Gasnikov, Alexander
  • Tyurin, Alexander
  • Uribe, Cesar A.
  • Pasechnyuk, Dmitry
  • Artamonov, Sergei

2010 Mathematics Subject Classification

  • 90C30 90C25 68Q25

Keywords

  • Gradient method, inexact oracle, strong convexity, relative smoothness, Bregman divergence

DOI

10.20347/WIAS.PREPRINT.2688

Abstract

We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes inexact oracle [19] and relative smoothness condition [43]. We analyze gradient method which uses this inexact model and obtain convergence rates for convex and strongly convex problems. To show potential applications of our general framework we consider three particular problems. The first one is clustering by electorial model introduced in [49]. The second one is approximating optimal transport distance, for which we propose a Proximal Sinkhorn algorithm. The third one is devoted to approximating optimal transport barycenter and we propose a Proximal Iterative Bregman Projections algorithm. We also illustrate the practical performance of our algorithms by numerical experiments.

Appeared in

  • Proceedings of the 18th International Conference on Mathematical Optimization Theory and Operations Research (MOTOR 2019), M. Khachay, Y. Kochetov, P. Pardalos, eds., vol. 11548 of Lecture Notes in Computer Science, Springer Nature Switzerland AG 2019, Cham, Switzerland, 2019, pp. 97--114, DOI 10.1007/978-3-030-22629-9_8 .

Download Documents