Rxivist logo

A space and time-efficient index for the compacted colored de Bruijn graph

By Fatemeh Almodaresi, Hirak Sarkar, Rob Patro

Posted 21 Sep 2017
bioRxiv DOI: 10.1101/191874 (published DOI: 10.1093/bioinformatics/bty292)

We present a novel data structure for representing and indexing the compacted colored de Bruijn graph, which allows for efficient pattern matching and retrieval of the reference information associated with each k-mer. As the popularity of the de Bruijn graph as an index has increased over the past few years, so have the number of proposed representations of this structure. Existing structures typically fall into two categories; those that are hashing-based and provide very fast access to the underlying k-mer information, and those that are space-frugal and provide asymptotically efficient but practically slower pattern search. Our representation achieves a compromise between these two extremes. By building upon minimum perfect hashing, carefully organizing our data structure, and making use of succinct representations where applicable, our data structure provides practically fast k-mer lookup while greatly reducing the space compared to traditional hashing-based implementations. Further, we describe a sampling scheme built on the same underlying representation, which provides the ability to trade off k-mer query speed for a reduction in the de Bruijn graph index size. We believe this representation strikes a desirable balance between speed and space usage, and it will allow for fast search on large reference sequences. Pufferfish is developed in C++11, is open source (GPL v3), and is available at https://github.com/COMBINE-lab/pufferfish. The scripts used to generate the results in this manuscript are available at https://github.com/COMBINE-lab/pufferfish_experiments.

Download data

  • Downloaded 886 times
  • Download rankings, all-time:
    • Site-wide: 12,786 out of 83,503
    • In bioinformatics: 2,062 out of 8,009
  • Year to date:
    • Site-wide: 55,302 out of 83,503
  • Since beginning of last month:
    • Site-wide: 59,701 out of 83,503

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide


Sign up for the Rxivist weekly newsletter! (Click here for more details.)