Random access to grammar-compressed strings and trees

Philip Bille, Gad M. Landau, Rajeev Raman, Kunihiko Sadakane, Srinivasa Rao Satti, Oren Weimann

Research output: Contribution to journalArticlepeer-review

Abstract

Grammar-based compression, where one replaces a long string by a small context-free grammar that generates the string, is a simple and powerful paradigm that captures (sometimes with slight reduction in efficiency) many of the popular compression schemes, including the Lempel-Ziv family, run-length encoding, byte-pair encoding, Sequitur, and Re-Pair. In this paper, we present a novel grammar representation that allows efficient random access to any character or substring without decompressing the string. Let S be a string of length N compressed into a context-free grammar S of size n. We present two representations of S achieving O(logN) random access time, and either O(ν · ακ(n)) construction time and space on the pointer machine model, or O(n) construction time and space on the RAM. Here, ak(n) is the inverse of the kth row of Ackermann's function. Our representations also efficiently support decompression of any substring in S: we can decompress any substring of length m in the same complexity as a single random access query and additional O(m) time. Combining these results with fast algorithms for uncompressed approximate string matching leads to several efficient algorithms for approximate string matching on grammar-compressed strings without decompression. For instance, we can find all approximate occurrences of a pattern P with at most k errors in time O(n(min{|P|κ, κ4 + |P|} + logN) + occ), where occ is the number of occurrences of P in S. Finally, we generalize our results to navigation and other operations on grammar-compressed ordered trees. All of the above bounds significantly improve the currently best known results. To achieve these bounds, we introduce several new techniques and data structures of independent interest, including a predecessor data structure, two "biased" weighted ancestor data structures, and a compact representation of heavy paths in grammars.

Original languageEnglish
Pages (from-to)513-539
Number of pages27
JournalSIAM Journal on Computing
Volume44
Issue number3
DOIs
StatePublished - 2015

Bibliographical note

Publisher Copyright:
© 2015 Society for Industrial and Applied Mathematics.

Keywords

  • Approximate string matching
  • Grammar-based compression
  • Straight-line program
  • Tree compression

ASJC Scopus subject areas

  • General Computer Science
  • General Mathematics

Fingerprint

Dive into the research topics of 'Random access to grammar-compressed strings and trees'. Together they form a unique fingerprint.

Cite this