BdBG: a bucket-based method for compressing genome sequencing data with dynamic de Bruijn graphs

PeerJ. 2018 Oct 19:6:e5611. doi: 10.7717/peerj.5611. eCollection 2018.

Abstract

Dramatic increases in data produced by next-generation sequencing (NGS) technologies demand data compression tools for saving storage space. However, effective and efficient data compression for genome sequencing data has remained an unresolved challenge in NGS data studies. In this paper, we propose a novel alignment-free and reference-free compression method, BdBG, which is the first to compress genome sequencing data with dynamic de Bruijn graphs based on the data after bucketing. Compared with existing de Bruijn graph methods, BdBG only stored a list of bucket indexes and bifurcations for the raw read sequences, and this feature can effectively reduce storage space. Experimental results on several genome sequencing datasets show the effectiveness of BdBG over three state-of-the-art methods. BdBG is written in python and it is an open source software distributed under the MIT license, available for download at https://github.com/rongjiewang/BdBG.

Keywords: Bucket-based; Compression; Dynamic de Bruijn graph; Next-generation sequencing.

Grants and funding

This work was supported by the National Key Research and Development Programs (Nos.: 2016YFC0901605, 2016YFC1201702), and the Natural High-Tech R&D Programs (863) of China (Nos.: 2015AA020101, 2015AA020108, 2014AA021505, 2012AA02A604). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.