## Abstract

We consider the problem of approximating a set P of n points in ℝ^{d} by a j-dimensional subspace under the ℓ_{p}, measure, in which we wish to minimize the sum of ℓ_{p}, distances from each point of P to this subspace. More generally, the F_{q} (ℓ_{p})-subspace approximation problem asks for a j-subspace that minimizes the sum of qth powers of ℓ_{p}-distances to this subspace, up to a multiplicative factor of (1 + ∈e). We develop techniques for subspace approximation, regression, and matrix approximation that can be used to deal with massive data sets in high dimensional spaces. In particular, we develop coresets and sketches, i.e. small space representations that approximate the input point set P with respect to the subspace approximation problem. Our results are: • A dimensionality reduction method that can be applied to F_{q} (ℓp)-clustering and shape fitting problems, such as those in [8, 15]. • The first strong coreset for F_{1} (ℓ_{2})- subspace approximation in high-dimensional spaces, i.e. of size polynomial in the dimension of the space. This coreset approximates the distances to any j-subspace (not just the optimal one). • A (1 + ∈)-approximation algorithm for the j-dimensional F_{1} (ℓ_{2})-subspace approximation problem with running time nd(j/∈)^{O(1)} + (n + d)2^{poly(j/∈}). • A streaming algorithm that maintains a coreset for the F_{1} (ℓ_{2})-subspace approximation problem and uses a space of d (2√log n/∈^{2})^{poly(j)} (weighted) points. • Streaming algorithms for the above problems with bounded precision in the turnstile model, i.e, when coordinates appear in an arbitrary order and undergo multiple updates. We show that bounded precision can lead to further improvements. We extend results of [7] for approximate linear regression, distances to subspace approximation, and optimal rank-j approximation, to error measures other than the Frobenius norm.

Original language | English |
---|---|

Title of host publication | Proceedings of the 21st Annual ACM-SIAM Symposium on Discrete Algorithms |

Publisher | Association for Computing Machinery (ACM) |

Pages | 630-649 |

Number of pages | 20 |

ISBN (Print) | 9780898717013 |

DOIs | |

State | Published - 2010 |

Externally published | Yes |

Event | 21st Annual ACM-SIAM Symposium on Discrete Algorithms - Austin, TX, United States Duration: 17 Jan 2010 → 19 Jan 2010 |

### Publication series

Name | Proceedings of the Annual ACM-SIAM Symposium on Discrete Algorithms |
---|

### Conference

Conference | 21st Annual ACM-SIAM Symposium on Discrete Algorithms |
---|---|

Country/Territory | United States |

City | Austin, TX |

Period | 17/01/10 → 19/01/10 |

## ASJC Scopus subject areas

- Software
- Mathematics (all)