annotate README.rst @ 6:773b3a97d43c

Uploaded
author cshl-bsr
date Tue, 29 Mar 2016 16:51:06 -0400
parents
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
1 =======
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
2 ezBAMQC
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
3 =======
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
4
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
5 *"ezBAMQC, a tool to check the quality of mapped next generation sequencing files."*
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
6
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
7 :Codeology Icon:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
8
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
9 .. image:: https://raw.githubusercontent.com/mhammell-laboratory/bamqc/master/doc/bamqc-icon.gif
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
10 :alt: generated at codeology.braintreepayments.com/mhammell-laboratory/bamqc
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
11 :align: right
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
12 :target: http://codeology.braintreepayments.com/mhammell-laboratory/bamqc
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
13
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
14 :Description:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
15
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
16 ezBAMQC is a tool to check the quality of either one or many mapped next-generation-sequencing datasets. It conducts comprehensive evaluations of aligned sequencing data from multiple aspects including: clipping profile, mapping quality distribution, mapped read length distribution, genomic/transcriptomic mapping distribution, inner distance distribution (for paired-end reads), ribosomal RNA contamination, transcript 5’ and 3’ end bias, transcription dropout rate, sample correlations, sample reproducibility, sample variations. It outputs a set of tables and plots and one HTML page that contains a summary of the results. Many metrics are designed for RNA-seq data specifically, but ezBAMQC can be applied to any mapped sequencing dataset such as RNA-seq, CLIP-seq, GRO-seq, ChIP-seq, DNA-seq and so on.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
17
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
18 :Links:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
19
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
20 `Github Page <https://github.com/mhammell-laboratory/bamqc>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
21
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
22 `Pypi Page <https://pypi.python.org/pypi/ezBAMQC>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
23
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
24 `MHammell Lab <http://hammelllab.labsites.cshl.edu/software>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
25
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
26 :Authors:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
27 Ying Jin, David Molik, and Molly Hammell
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
28
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
29 :Version: 0.6.7
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
30
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
31 :Contact:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
32 Ying Jin (yjin@cshl.edu)
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
33
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
34 Installation guide for ezBAMQC for from source installs
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
35 =======================================================
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
36
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
37 When installing ezBAMQC there are several options, but the main point is: since ezBAMQC uses C++ STD 11 you'll need a version of GCC that can support that, this useally means 4.8 or 4.9. beyond that, you'll need Python, R and Corrplot for interfacing with the C code.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
38
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
39 :Intallation:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
40 `Source Code <https://github.com/mhammell-laboratory/ezBAMQC/releases>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
41
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
42 `Pypi <https://pypi.python.org/pypi?:action=display&name=ezBAMQC>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
43
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
44 :Prerequisites:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
45 * `python2.7 <https://www.python.org/download/releases/2.7/>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
46 * `R <https://www.r-project.org/>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
47 * `corrplot <https://cran.r-project.org/web/packages/corrplot/>`_
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
48 * `GCC 4.8.1 or greater <https://gcc.gnu.org/gcc-4.8/>`_ GCC 4.9.1 or greater is recomended for PyPi install
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
49
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
50 :Notes:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
51 * While there are multiple methods of installing the prerequistes it may help to look at (if using a yum based linux distro):*
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
52 * `Devtoolset-3 <https://access.redhat.com/documentation/en-US/Red_Hat_Developer_Toolset/3/html/User_Guide/sect-Red_Hat_Developer_Toolset-Install.html>`_ for GCC compilers
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
53 * `IUS <https://ius.io/>`_ for Python2.7
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
54 * `Software Collections <https://www.softwarecollections.org/>`_ for collections of software (like devtoolset 3 or python)
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
55 * `rpmfinder <https://www.rpmfind.net/>`_ for searching rpms across mutliple systems
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
56
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
57 Setup
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
58 =====
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
59
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
60 1) Make sure that the GCC comiler is in your PATH:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
61
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
62 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
63
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
64 export PATH=/path/to/gcc:$PATH
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
65
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
66 2) Make sure that python2.7 is in your PYTHONPATH:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
67
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
68 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
69
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
70 export PYTHONPATH=/path/to/python2.7/site-packages:$PYTHONPATH
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
71
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
72 3) There are three methods of installation of ezBAMQC, from source, from setup.py, and from pypi, once prequistes are setup.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
73
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
74 From Source
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
75 ~~~~~~~~~~~
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
76
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
77 1) Download source
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
78
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
79 2) Unpack tarball and go to the directory of the package:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
80
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
81 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
82
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
83 tar xvfz bamqc-0.6.7.tar.gz
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
84
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
85 cd bamqc-0.6.7
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
86
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
87 3) Run make:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
88
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
89 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
90
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
91 make
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
92
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
93 From Setup.py
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
94 ~~~~~~~~~~~~~
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
95
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
96 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
97
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
98 python2.7 setup.py install
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
99
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
100 From Pypi
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
101 ~~~~~~~~~
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
102
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
103 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
104
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
105 pip2.7 install BAMqc
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
106
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
107 Usage
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
108 =====
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
109
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
110 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
111
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
112 ezBAMQC [-h] -i alignment_files [alignment_files ...] -r [refgene]
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
113 [-f [attrID]] [--rRNA [rRNA]] -o [dir] [--stranded [stranded]]
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
114 [-q [mapq]] [-l labels [labels ...]] [-t NUMTHREADS]
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
115
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
116 optional arguments:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
117
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
118 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
119
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
120 -h, --help show this help message and exit.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
121 -i, --inputFile alignment files. Could be multiple SAM/BAM files separated by space. Required.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
122 -r, --refgene gene annotation file in GTF format. Required
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
123 -f the read summation at which feature level in the GTF file. DEFAULT: gene_id.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
124 --rRNA rRNA coordinates in BED format.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
125 -o, --outputDir output directory. Required.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
126 --stranded strandness of the library?
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
127 yes : sense stranded
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
128 reverse : reverse stranded
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
129 no : not stranded
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
130 DEFAULT: yes.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
131 -q, --mapq Minimum mapping quality (phred scaled) for an alignment to be called uniquely mapped. DEFAULT:30
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
132 -l, --label Labels of input files. DEFAULT:smp1 smp2 ...
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
133 -t, --threads Number of threads to use. DEFAULT:1
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
134
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
135 Example:
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
136
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
137 ::
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
138
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
139 ezBAMQC -i test-data/exp_data/treat1.bam test-data/exp_data/treat2.bam test-data/exp_data/treat3.bam -r test-data/exp_data/hg9_refGene.gtf -q 30 --rRNA test-data/exp_data/hg19_rRNA.bed -o exp_output2
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
140
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
141 Please find the example output from folder test-data.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
142
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
143 FAQ
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
144 ===
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
145 Q: Why use ezBAMQC?
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
146
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
147 A: ezBAMQC is efficient and easy to use. With one command line, it reports a comprehensive evaluation of the data with a set of plots and tables.The ability to assess multiple samples together with high efficiency make it especially useful in cases where there are a large number of samples from the same condition, genotype, or treatment. ezBAMQC was written in C++ and supports multithreading. A mouse RNA-seq sample with 120M alignments can be done in 8 minutes with 5 threads.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
148
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
149 Q: Why the total number of reads reported by ezBAMQC does not match with samtools flagstat?
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
150
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
151 A: The difference is because of non-uniquely mapped reads or multiply aligned reads (multi-reads). Samtools flagstat counts each multiple aligment as a different reads, but ezBAMQC counts reads accoriding to the read ID, i.e., each individual read will be counted once no matter that it is a uniquely mapped read or multi-read.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
152
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
153 Q: What is "Low Quality Reads" ?
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
154
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
155 A: Reads marked as qc fail accoriding to SAM format or reads with mapping quality lower than the value set by the option -q will be considered as "Low Quality Reads".
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
156
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
157 Q: How the setting of option -q alter the results?
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
158
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
159 A: Reads with low quality, i.e., did not pass -q cutoff, are only counted in Total Reads, Mapped Reads, and Mappability by mapping quality plot. The rest of the report does not include low quality reads.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
160
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
161 Q: Do multi-reads (non-uniquely mapped reads) have been considered in Read distribution and gene quantification?
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
162
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
163 A: No. Only uniquely mapped reads were counted.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
164
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
165
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
166 Acknowledgements
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
167 ================
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
168
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
169 #) Samtools contributors
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
170 #) Users' valuable feedback
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
171
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
172 Copying & Distribution
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
173 ======================
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
174
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
175 ezBAMQC is free software: you can redistribute it and/or modify
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
176 it under the terms of the GNU General Public License as published by
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
177 the Free Software Foundation, either version 3 of the License, or
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
178 (at your option) any later version.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
179
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
180 This program is distributed in the hope that it will be useful,
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
181 but *WITHOUT ANY WARRANTY*; without even the implied warranty of
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
182 *MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE*. See the
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
183 GNU General Public License for more details.
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
184
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
185 You should have received a copy of the GNU General Public License
773b3a97d43c Uploaded
cshl-bsr
parents:
diff changeset
186 along with ezBAMQC. If not, see `this website <http://www.gnu.org/licenses/>`_