Proximity Function Minimization Using Multiple Bregman Projections, with Applications to Split Feasibility and Kullback-Leibler Distance Minimization

Charles Byrne, Yair Censor

Research output: Contribution to journalArticlepeer-review

Abstract

Problems in signal detection and image recovery can sometimes be formulated as a convex feasibility problem (CFP) of finding a vector in the intersection of a finite family of closed convex sets. Algorithms for this purpose typically employ orthogonal or generalized projections onto the individual convex sets. The simultaneous multiprojection algorithm of Censor and Elfving for solving the CFP, in which different generalized projections may be used at the same time, has been shown to converge for the case of nonempty intersection; still open is the question of its convergence when the intersection of the closed convex sets is empty. Motivated by the geometric alternating minimization approach of Csiszár and Tusnády and the product space formulation of Pierra, we derive a new simultaneous multiprojection algorithm that employs generalized projections of Bregman to solve the convex feasibility problem or, in the inconsistent case, to minimize a proximity function that measures the average distance from a point to all convex sets. We assume that the Bregman distances involved are jointly convex, so that the proximity function itself is convex. When the intersection of the convex sets is empty, but the closure of the proximity function has a unique global minimizer, the sequence of iterates converges to this unique minimizer. Special cases of this algorithm include the "Expectation Maximization Maximum Likelihood" (EMML) method in emission tomography and a new convergence result for an algorithm that solves the split feasibility problem.

Original languageEnglish
Pages (from-to)77-98
Number of pages22
JournalAnnals of Operations Research
Volume105
Issue number1-4
DOIs
StatePublished - 2001

Bibliographical note

Funding Information:
We thank our colleagues Paul Eggermont, Tommy Elfving and Simeon Reich for enlightening discussions on this research, and two anonymous referees for constructive comments which helped us revise this paper. The work of Y. Censor was partially supported by grants 293/97 and 592/00 of the Israel Science Foundation founded by The Israel Academy of Sciences and Humanities and by NIH grant HL-28438 at the Medical Image Processing Group (MIPG), Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA. Part of this work was done during visits of Y. Censor at the Department of Mathematics of the University of Linköping in Sweden. The support and hospitality of Professor Åke Björck, head of the Numerical Analysis Group there, are gratefully acknowledged.

Keywords

  • Bregman projections
  • Convex feasibility problem
  • Kullback-Leibler distance
  • Product space
  • Proximity function

ASJC Scopus subject areas

  • General Decision Sciences
  • Management Science and Operations Research

Fingerprint

Dive into the research topics of 'Proximity Function Minimization Using Multiple Bregman Projections, with Applications to Split Feasibility and Kullback-Leibler Distance Minimization'. Together they form a unique fingerprint.

Cite this