Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems

Howard Heaton, Yair Censor

Research output: Contribution to journalArticlepeer-review

Abstract

The common fixed points problem requires finding a point in the intersection of fixed points sets of a finite collection of operators. Quickly solving problems of this sort is of great practical importance for engineering and scientific tasks (e.g., for computed tomography). Iterative methods for solving these problems often employ a Krasnosel’skiĭ–Mann type iteration. We present an asynchronous sequential inertial (ASI) algorithmic framework in a Hilbert space to solve common fixed points problems with a collection of nonexpansive operators. Our scheme allows use of out-of-date iterates when generating updates, thereby enabling processing nodes to work simultaneously and without synchronization. This method also includes inertial type extrapolation terms to increase the speed of convergence. In particular, we extend the application of the recent “ARock algorithm” (Peng et al. in SIAM J Sci Comput 38:A2851–A2879, 2016) in the context of convex feasibility problems. Convergence of the ASI algorithm is proven with no assumption on the distribution of delays, except that they be uniformly bounded. Discussion is provided along with a computational example showing the performance of the ASI algorithm applied in conjunction with a diagonally relaxed orthogonal projections (DROP) algorithm for estimating solutions to large linear systems.

Original languageEnglish
Pages (from-to)95-119
Number of pages25
JournalJournal of Global Optimization
Volume74
Issue number1
DOIs
StatePublished - 15 May 2019

Bibliographical note

Funding Information:
Acknowledgements We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author’s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author’s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF).

Funding Information:
We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author?s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author?s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF).

Publisher Copyright:
© 2019, Springer Science+Business Media, LLC, part of Springer Nature.

Keywords

  • Asynchronous sequential iterations
  • Convex feasibility problem
  • DROP algorithm
  • Fixed point iteration
  • Kaczmarz method
  • Nonexpansive operator

ASJC Scopus subject areas

  • Computer Science Applications
  • Management Science and Operations Research
  • Control and Optimization
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems'. Together they form a unique fingerprint.

Cite this