Solving large linear least squares problems with linear equality constraints

Scott, J. ORCID: https://orcid.org/0000-0003-2130-1091 and Tůma, M. (2022) Solving large linear least squares problems with linear equality constraints. BIT Numerical Mathematics, 62. pp. 1765-1787. ISSN 1572-9125 doi: 10.1007/s10543-022-00930-2

Abstract/Summary

We consider the problem of solving large-scale linear least squares problems that have one or more linear constraints that must be satisfied exactly. While some classical approaches are theoretically well founded, they can face difficulties when the matrix of constraints contains dense rows or if an algorithmic transformation used in the solution process results in a modified problem that is much denser than the original one. We propose modifications with an emphasis on requiring that the constraints be satisfied with a small residual. We examine combining the null-space method with our recently developed algorithm for computing a null-space basis matrix for a ``wide'' matrix. We further show that a direct elimination approach enhanced by careful pivoting can be effective in transforming the problem to an unconstrained sparse-dense least squares problem that can be solved with existing direct or iterative methods. We also present a number of solution variants that employ an augmented system formulation, which can be attractive for solving a sequence of related problems. Numerical experiments on problems coming from practical applications are used throughout to demonstrate the effectiveness of the different approaches.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/105891
Item Type	Article
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Mathematics and Statistics
Publisher	Springer
Download/View statistics	View download statistics for this item