Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems

Howard Heaton; Yair Censor

doi:10.1007/s10898-019-00747-4

Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems

Howard Heaton, Yair Censor

Department of Mathematics

Research output: Contribution to journal › Article › peer-review

Abstract

The common fixed points problem requires finding a point in the intersection of fixed points sets of a finite collection of operators. Quickly solving problems of this sort is of great practical importance for engineering and scientific tasks (e.g., for computed tomography). Iterative methods for solving these problems often employ a Krasnosel’skiĭ–Mann type iteration. We present an asynchronous sequential inertial (ASI) algorithmic framework in a Hilbert space to solve common fixed points problems with a collection of nonexpansive operators. Our scheme allows use of out-of-date iterates when generating updates, thereby enabling processing nodes to work simultaneously and without synchronization. This method also includes inertial type extrapolation terms to increase the speed of convergence. In particular, we extend the application of the recent “ARock algorithm” (Peng et al. in SIAM J Sci Comput 38:A2851–A2879, 2016) in the context of convex feasibility problems. Convergence of the ASI algorithm is proven with no assumption on the distribution of delays, except that they be uniformly bounded. Discussion is provided along with a computational example showing the performance of the ASI algorithm applied in conjunction with a diagonally relaxed orthogonal projections (DROP) algorithm for estimating solutions to large linear systems.

Original language	English
Pages (from-to)	95-119
Number of pages	25
Journal	Journal of Global Optimization
Volume	74
Issue number	1
DOIs	https://doi.org/10.1007/s10898-019-00747-4
State	Published - 15 May 2019

Bibliographical note

Funding Information:
Acknowledgements We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author’s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author’s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF).

Funding Information:
We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author?s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author?s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF).

Publisher Copyright:
© 2019, Springer Science+Business Media, LLC, part of Springer Nature.

Keywords

Asynchronous sequential iterations
Convex feasibility problem
DROP algorithm
Fixed point iteration
Kaczmarz method
Nonexpansive operator

ASJC Scopus subject areas

Computer Science Applications
Management Science and Operations Research
Control and Optimization
Applied Mathematics

Access to Document

10.1007/s10898-019-00747-4

Cite this

@article{026d8d8c8245489fb068d053d5bf1e9a,

title = "Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems",

abstract = "The common fixed points problem requires finding a point in the intersection of fixed points sets of a finite collection of operators. Quickly solving problems of this sort is of great practical importance for engineering and scientific tasks (e.g., for computed tomography). Iterative methods for solving these problems often employ a Krasnosel{\textquoteright}skiĭ–Mann type iteration. We present an asynchronous sequential inertial (ASI) algorithmic framework in a Hilbert space to solve common fixed points problems with a collection of nonexpansive operators. Our scheme allows use of out-of-date iterates when generating updates, thereby enabling processing nodes to work simultaneously and without synchronization. This method also includes inertial type extrapolation terms to increase the speed of convergence. In particular, we extend the application of the recent “ARock algorithm” (Peng et al. in SIAM J Sci Comput 38:A2851–A2879, 2016) in the context of convex feasibility problems. Convergence of the ASI algorithm is proven with no assumption on the distribution of delays, except that they be uniformly bounded. Discussion is provided along with a computational example showing the performance of the ASI algorithm applied in conjunction with a diagonally relaxed orthogonal projections (DROP) algorithm for estimating solutions to large linear systems.",

keywords = "Asynchronous sequential iterations, Convex feasibility problem, DROP algorithm, Fixed point iteration, Kaczmarz method, Nonexpansive operator",

author = "Howard Heaton and Yair Censor",

note = "Funding Information: Acknowledgements We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author{\textquoteright}s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author{\textquoteright}s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF). Funding Information: We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author?s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author?s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF). Publisher Copyright: {\textcopyright} 2019, Springer Science+Business Media, LLC, part of Springer Nature.",

year = "2019",

month = may,

day = "15",

doi = "10.1007/s10898-019-00747-4",

language = "English",

volume = "74",

pages = "95--119",

journal = "Journal of Global Optimization",

issn = "0925-5001",

publisher = "Springer Netherlands",

number = "1",

}

TY - JOUR

T1 - Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems

AU - Heaton, Howard

AU - Censor, Yair

N1 - Funding Information: Acknowledgements We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author’s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author’s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF). Funding Information: We thank Prof. Reinhard Schulte from Loma Linda Univeristy for valuable discussions and insights regarding the advantage of an asynchronous approach to large scale problems in proton CT (pCT) image reconstruction and Intensity-Modulated Proton Therapy (IMPT). We appreciate constructive comments received from Prof. Ernesto Gomez from California State University San Bernardino and Prof. Keith Schubert from Baylor University. We thank the anonymous reviewers for their constructive comments. We are indebted to Patrick Combettes, Jonathan Eckstein, Dan Gordon and Simeon Reich for valuable feedback on the earlier version of this work that was posted on arXiv. The first author?s work is supported by the National Science Foundation Graduate Research Fellowship under Grant No. DGE-1650604. Any opinion, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. The second author?s work was supported by research Grant No. 2013003 of the United States-Israel Binational Science Foundation (BSF). Publisher Copyright: © 2019, Springer Science+Business Media, LLC, part of Springer Nature.

PY - 2019/5/15

Y1 - 2019/5/15

N2 - The common fixed points problem requires finding a point in the intersection of fixed points sets of a finite collection of operators. Quickly solving problems of this sort is of great practical importance for engineering and scientific tasks (e.g., for computed tomography). Iterative methods for solving these problems often employ a Krasnosel’skiĭ–Mann type iteration. We present an asynchronous sequential inertial (ASI) algorithmic framework in a Hilbert space to solve common fixed points problems with a collection of nonexpansive operators. Our scheme allows use of out-of-date iterates when generating updates, thereby enabling processing nodes to work simultaneously and without synchronization. This method also includes inertial type extrapolation terms to increase the speed of convergence. In particular, we extend the application of the recent “ARock algorithm” (Peng et al. in SIAM J Sci Comput 38:A2851–A2879, 2016) in the context of convex feasibility problems. Convergence of the ASI algorithm is proven with no assumption on the distribution of delays, except that they be uniformly bounded. Discussion is provided along with a computational example showing the performance of the ASI algorithm applied in conjunction with a diagonally relaxed orthogonal projections (DROP) algorithm for estimating solutions to large linear systems.

AB - The common fixed points problem requires finding a point in the intersection of fixed points sets of a finite collection of operators. Quickly solving problems of this sort is of great practical importance for engineering and scientific tasks (e.g., for computed tomography). Iterative methods for solving these problems often employ a Krasnosel’skiĭ–Mann type iteration. We present an asynchronous sequential inertial (ASI) algorithmic framework in a Hilbert space to solve common fixed points problems with a collection of nonexpansive operators. Our scheme allows use of out-of-date iterates when generating updates, thereby enabling processing nodes to work simultaneously and without synchronization. This method also includes inertial type extrapolation terms to increase the speed of convergence. In particular, we extend the application of the recent “ARock algorithm” (Peng et al. in SIAM J Sci Comput 38:A2851–A2879, 2016) in the context of convex feasibility problems. Convergence of the ASI algorithm is proven with no assumption on the distribution of delays, except that they be uniformly bounded. Discussion is provided along with a computational example showing the performance of the ASI algorithm applied in conjunction with a diagonally relaxed orthogonal projections (DROP) algorithm for estimating solutions to large linear systems.

KW - Asynchronous sequential iterations

KW - Convex feasibility problem

KW - DROP algorithm

KW - Fixed point iteration

KW - Kaczmarz method

KW - Nonexpansive operator

UR - http://www.scopus.com/inward/record.url?scp=85061584856&partnerID=8YFLogxK

U2 - 10.1007/s10898-019-00747-4

DO - 10.1007/s10898-019-00747-4

M3 - Article

AN - SCOPUS:85061584856

SN - 0925-5001

VL - 74

SP - 95

EP - 119

JO - Journal of Global Optimization

JF - Journal of Global Optimization

IS - 1

ER -

Asynchronous sequential inertial iterations for common fixed points problems with an application to linear systems

Abstract

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this