Back to Search
Start Over
DNA short read alignment on apache spark
- Source :
- Applied Computing and Informatics, Vol 19, Iss 1/2, Pp 64-81 (2023)
- Publication Year :
- 2023
- Publisher :
- Emerald Publishing, 2023.
-
Abstract
- The evolution of technologies has unleashed a wealth of challenges by generating massive amount of data. Recently, biological data has increased exponentially, which has introduced several computational challenges. DNA short read alignment is an important problem in bioinformatics. The exponential growth in the number of short reads has increased the need for an ideal platform to accelerate the alignment process. Apache Spark is a cluster-computing framework that involves data parallelism and fault tolerance. In this article, we proposed a Spark-based algorithm to accelerate DNA short reads alignment problem, and it is called Spark-DNAligning. Spark-DNAligning exploits Apache Spark ’s performance optimizations such as broadcast variable, join after partitioning, caching, and in-memory computations. Spark-DNAligning is evaluated in term of performance by comparing it with SparkBWA tool and a MapReduce based algorithm called CloudBurst. All the experiments are conducted on Amazon Web Services (AWS). Results demonstrate that Spark-DNAligning outperforms both tools by providing a speedup in the range of 101–702 in aligning gigabytes of short reads to the human genome. Empirical evaluation reveals that Apache Spark offers promising solutions to DNA short reads alignment problem.
- Subjects :
- Cloud
Cluster
DNA
MapReduce
Spark
Information technology
T58.5-58.64
Subjects
Details
- Language :
- English
- ISSN :
- 22108327 and 26341964
- Volume :
- 19
- Issue :
- 1/2
- Database :
- Directory of Open Access Journals
- Journal :
- Applied Computing and Informatics
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.fbdb0059ee4981aae771116ab8ce4b
- Document Type :
- article
- Full Text :
- https://doi.org/10.1016/j.aci.2019.04.002/full/pdf