SeqPig: Simple and scalable scripting for large sequencing data sets in hadoop

61Citations
Citations of this article
101Readers
Mendeley users who have this article in their library.

Abstract

Summary: Hadoop MapReduce-based approaches have become increasingly popular due to their scalability in processing large sequencing datasets. However, as these methods typically require in-depth expertise in Hadoop and Java, they are still out of reach of many bioinformaticians. To solve this problem, we have created SeqPig, a library and a collection of tools to manipulate, analyze and query sequencing datasets in a scalable and simple manner. SeqPigscripts use the Hadoop-based distributed scripting engine Apache Pig, which automatically parallelizes and distributes data processing tasks. We demonstrate SeqPig's scalability over many computing nodes and illustrate its use with example scripts.Availability and Implementation: Available under the open source MIT license at http://sourceforge.net/projects/seqpig/Contact: Supplementary information: Supplementary data are available at Bioinformatics online. © 2013 The Author .

Cite

CITATION STYLE

APA

Schumacher, A., Pireddu, L., Niemenmaa, M., Kallio, A., Korpelainen, E., Zanetti, G., & Heljanko, K. (2014). SeqPig: Simple and scalable scripting for large sequencing data sets in hadoop. Bioinformatics, 30(1), 119–120. https://doi.org/10.1093/bioinformatics/btt601

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free