view lib/documentation.html @ 0:1d1b9e1b2e2f draft

Uploaded
author petr-novak
date Thu, 19 Dec 2019 10:24:45 -0500
parents
children
line wrap: on
line source

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<!-- 2019-12-09 Po 07:55 -->
<meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<title>RepeatExplorer documentation</title>
<meta name="generator" content="Org mode" />
<meta name="author" content="petr" />
<style type="text/css">
 <!--/*--><![CDATA[/*><!--*/
  .title  { text-align: center;
             margin-bottom: .2em; }
  .subtitle { text-align: center;
              font-size: medium;
              font-weight: bold;
              margin-top:0; }
  .todo   { font-family: monospace; color: red; }
  .done   { font-family: monospace; color: green; }
  .priority { font-family: monospace; color: orange; }
  .tag    { background-color: #eee; font-family: monospace;
            padding: 2px; font-size: 80%; font-weight: normal; }
  .timestamp { color: #bebebe; }
  .timestamp-kwd { color: #5f9ea0; }
  .org-right  { margin-left: auto; margin-right: 0px;  text-align: right; }
  .org-left   { margin-left: 0px;  margin-right: auto; text-align: left; }
  .org-center { margin-left: auto; margin-right: auto; text-align: center; }
  .underline { text-decoration: underline; }
  #postamble p, #preamble p { font-size: 90%; margin: .2em; }
  p.verse { margin-left: 3%; }
  pre {
    border: 1px solid #ccc;
    box-shadow: 3px 3px 3px #eee;
    padding: 8pt;
    font-family: monospace;
    overflow: auto;
    margin: 1.2em;
  }
  pre.src {
    position: relative;
    overflow: visible;
    padding-top: 1.2em;
  }
  pre.src:before {
    display: none;
    position: absolute;
    background-color: white;
    top: -10px;
    right: 10px;
    padding: 3px;
    border: 1px solid black;
  }
  pre.src:hover:before { display: inline;}
  /* Languages per Org manual */
  pre.src-asymptote:before { content: 'Asymptote'; }
  pre.src-awk:before { content: 'Awk'; }
  pre.src-C:before { content: 'C'; }
  /* pre.src-C++ doesn't work in CSS */
  pre.src-clojure:before { content: 'Clojure'; }
  pre.src-css:before { content: 'CSS'; }
  pre.src-D:before { content: 'D'; }
  pre.src-ditaa:before { content: 'ditaa'; }
  pre.src-dot:before { content: 'Graphviz'; }
  pre.src-calc:before { content: 'Emacs Calc'; }
  pre.src-emacs-lisp:before { content: 'Emacs Lisp'; }
  pre.src-fortran:before { content: 'Fortran'; }
  pre.src-gnuplot:before { content: 'gnuplot'; }
  pre.src-haskell:before { content: 'Haskell'; }
  pre.src-hledger:before { content: 'hledger'; }
  pre.src-java:before { content: 'Java'; }
  pre.src-js:before { content: 'Javascript'; }
  pre.src-latex:before { content: 'LaTeX'; }
  pre.src-ledger:before { content: 'Ledger'; }
  pre.src-lisp:before { content: 'Lisp'; }
  pre.src-lilypond:before { content: 'Lilypond'; }
  pre.src-lua:before { content: 'Lua'; }
  pre.src-matlab:before { content: 'MATLAB'; }
  pre.src-mscgen:before { content: 'Mscgen'; }
  pre.src-ocaml:before { content: 'Objective Caml'; }
  pre.src-octave:before { content: 'Octave'; }
  pre.src-org:before { content: 'Org mode'; }
  pre.src-oz:before { content: 'OZ'; }
  pre.src-plantuml:before { content: 'Plantuml'; }
  pre.src-processing:before { content: 'Processing.js'; }
  pre.src-python:before { content: 'Python'; }
  pre.src-R:before { content: 'R'; }
  pre.src-ruby:before { content: 'Ruby'; }
  pre.src-sass:before { content: 'Sass'; }
  pre.src-scheme:before { content: 'Scheme'; }
  pre.src-screen:before { content: 'Gnu Screen'; }
  pre.src-sed:before { content: 'Sed'; }
  pre.src-sh:before { content: 'shell'; }
  pre.src-sql:before { content: 'SQL'; }
  pre.src-sqlite:before { content: 'SQLite'; }
  /* additional languages in org.el's org-babel-load-languages alist */
  pre.src-forth:before { content: 'Forth'; }
  pre.src-io:before { content: 'IO'; }
  pre.src-J:before { content: 'J'; }
  pre.src-makefile:before { content: 'Makefile'; }
  pre.src-maxima:before { content: 'Maxima'; }
  pre.src-perl:before { content: 'Perl'; }
  pre.src-picolisp:before { content: 'Pico Lisp'; }
  pre.src-scala:before { content: 'Scala'; }
  pre.src-shell:before { content: 'Shell Script'; }
  pre.src-ebnf2ps:before { content: 'ebfn2ps'; }
  /* additional language identifiers per "defun org-babel-execute"
       in ob-*.el */
  pre.src-cpp:before  { content: 'C++'; }
  pre.src-abc:before  { content: 'ABC'; }
  pre.src-coq:before  { content: 'Coq'; }
  pre.src-groovy:before  { content: 'Groovy'; }
  /* additional language identifiers from org-babel-shell-names in
     ob-shell.el: ob-shell is the only babel language using a lambda to put
     the execution function name together. */
  pre.src-bash:before  { content: 'bash'; }
  pre.src-csh:before  { content: 'csh'; }
  pre.src-ash:before  { content: 'ash'; }
  pre.src-dash:before  { content: 'dash'; }
  pre.src-ksh:before  { content: 'ksh'; }
  pre.src-mksh:before  { content: 'mksh'; }
  pre.src-posh:before  { content: 'posh'; }
  /* Additional Emacs modes also supported by the LaTeX listings package */
  pre.src-ada:before { content: 'Ada'; }
  pre.src-asm:before { content: 'Assembler'; }
  pre.src-caml:before { content: 'Caml'; }
  pre.src-delphi:before { content: 'Delphi'; }
  pre.src-html:before { content: 'HTML'; }
  pre.src-idl:before { content: 'IDL'; }
  pre.src-mercury:before { content: 'Mercury'; }
  pre.src-metapost:before { content: 'MetaPost'; }
  pre.src-modula-2:before { content: 'Modula-2'; }
  pre.src-pascal:before { content: 'Pascal'; }
  pre.src-ps:before { content: 'PostScript'; }
  pre.src-prolog:before { content: 'Prolog'; }
  pre.src-simula:before { content: 'Simula'; }
  pre.src-tcl:before { content: 'tcl'; }
  pre.src-tex:before { content: 'TeX'; }
  pre.src-plain-tex:before { content: 'Plain TeX'; }
  pre.src-verilog:before { content: 'Verilog'; }
  pre.src-vhdl:before { content: 'VHDL'; }
  pre.src-xml:before { content: 'XML'; }
  pre.src-nxml:before { content: 'XML'; }
  /* add a generic configuration mode; LaTeX export needs an additional
     (add-to-list 'org-latex-listings-langs '(conf " ")) in .emacs */
  pre.src-conf:before { content: 'Configuration File'; }

  table { border-collapse:collapse; }
  caption.t-above { caption-side: top; }
  caption.t-bottom { caption-side: bottom; }
  td, th { vertical-align:top;  }
  th.org-right  { text-align: center;  }
  th.org-left   { text-align: center;   }
  th.org-center { text-align: center; }
  td.org-right  { text-align: right;  }
  td.org-left   { text-align: left;   }
  td.org-center { text-align: center; }
  dt { font-weight: bold; }
  .footpara { display: inline; }
  .footdef  { margin-bottom: 1em; }
  .figure { padding: 1em; }
  .figure p { text-align: center; }
  .equation-container {
    display: table;
    text-align: center;
    width: 100%;
  }
  .equation {
    vertical-align: middle;
  }
  .equation-label {
    display: table-cell;
    text-align: right;
    vertical-align: middle;
  }
  .inlinetask {
    padding: 10px;
    border: 2px solid gray;
    margin: 10px;
    background: #ffffcc;
  }
  #org-div-home-and-up
   { text-align: right; font-size: 70%; white-space: nowrap; }
  textarea { overflow-x: auto; }
  .linenr { font-size: smaller }
  .code-highlighted { background-color: #ffff00; }
  .org-info-js_info-navigation { border-style: none; }
  #org-info-js_console-label
    { font-size: 10px; font-weight: bold; white-space: nowrap; }
  .org-info-js_search-highlight
    { background-color: #ffff00; color: #000000; font-weight: bold; }
  .org-svg { width: 90%; }
  /*]]>*/-->
</style>
<link rel="stylesheet" type="text/css" href="style1.css" />
<script type="text/javascript">
/*
@licstart  The following is the entire license notice for the
JavaScript code in this tag.

Copyright (C) 2012-2019 Free Software Foundation, Inc.

The JavaScript code in this tag is free software: you can
redistribute it and/or modify it under the terms of the GNU
General Public License (GNU GPL) as published by the Free Software
Foundation, either version 3 of the License, or (at your option)
any later version.  The code is distributed WITHOUT ANY WARRANTY;
without even the implied warranty of MERCHANTABILITY or FITNESS
FOR A PARTICULAR PURPOSE.  See the GNU GPL for more details.

As additional permission under GNU GPL version 3 section 7, you
may distribute non-source (e.g., minimized or compacted) forms of
that code without the copy of the GNU GPL normally required by
section 4, provided you include this license notice and a URL
through which recipients can access the Corresponding Source.


@licend  The above is the entire license notice
for the JavaScript code in this tag.
*/
<!--/*--><![CDATA[/*><!--*/
 function CodeHighlightOn(elem, id)
 {
   var target = document.getElementById(id);
   if(null != target) {
     elem.cacheClassElem = elem.className;
     elem.cacheClassTarget = target.className;
     target.className = "code-highlighted";
     elem.className   = "code-highlighted";
   }
 }
 function CodeHighlightOff(elem, id)
 {
   var target = document.getElementById(id);
   if(elem.cacheClassElem)
     elem.className = elem.cacheClassElem;
   if(elem.cacheClassTarget)
     target.className = elem.cacheClassTarget;
 }
/*]]>*///-->
</script>
</head>
<body>
<div id="content">
<h1 class="title">RepeatExplorer documentation</h1>
<h1 id="clust"> Cluster annotation table </h1>

<dl class="org-dl">
<dt>Cluster</dt><dd>cluster index, contain link to individual cluster report</dd>
<dt>Supercluster</dt><dd>Supercluster index, contains link inf individual supercluster report</dd>
<dt>Proportion<code>[%]</code></dt><dd>Proportion of the reads in the cluster with respect to the amount of number of analyzed sequence.</dd>
<dt>Proportions adjusted<code>[%]</code></dt><dd>Adjusted genome proportion can differ from unadjusted value if the Perform automatic filtering of abundant satellite repeats was on. Sequences belonging to high abundance satellites were partially removed from all-to-all comparison and clustering. This causes that the Genome proportion estimate for these satellite is underestimated. Adjusted Genome proportion provide corrected estimate of ‘real’ genomic proportion for particular satellite repeat.</dd>
<dt>Number of reads</dt><dd>number of reads in the cluster</dd>
<dt>Graph layout</dt><dd>Preview of graph based visualization of sequence reads cluster. More detailed graph layout can be foun in individual cluster reports</dd>
<dt>Similarity hits</dt><dd>summarize the proportion of reads in the clusters with similarity to REXdb or DNA reference databases. Only hits with proportion above 0.1% are shown</dd>
<dt>LTR detection </dt><dd>Show if the LTR with primer binding site was detected on contig assembly and what type of tRNA is used for priming.</dd>
<dt>Satellite probability</dt><dd>provide empirical probability that cluster represent satellite</dd>
<dt>TAREAN classification </dt><dd>TAREAN divides clusters into five categories described in box 9.</dd>
<dt>Consensus length</dt><dd>For clusters analyzed by TAREAN module, the best estimate of monomer length is shown.</dd>
<dt>Consensus</dt><dd>The best consensus estimate reconstructed by TAREAN module</dd>
<dt>Kmer analysis</dt><dd>if cluster was analyzed by TAREAN, this field contains the link to the detailed TAREAN kmer analysis (box 10)</dd>
<dt>Connected component index C,  Pair completeness index P, Kmer coverage</dt><dd>statistics reported by TAREAN module</dd>
<dt>|V| </dt><dd>Number of vertices of the graph</dd>
<dt>|E| </dt><dd>Number of edges of the graph</dd>
</dl>


<h1 id="superclust"> Supercluster annotation table </h1>

<dl class="org-dl">
<dt>Supercluster</dt><dd>supercluster index</dd>
<dt>Reads</dt><dd>number of reads in supercluster</dd>
<dt>Automatic classification</dt><dd>Result of automatic supercluster classification</dd>
<dt>Similarity hits</dt><dd>Number similarity hits against REXdb and DNA database are shown in the classification tree structure together with the number of reads assigned to putative satellite cluster  and information about detection of LTR/PBS. The parts of the tree without any evidences are pruned off.</dd>
<dt>TAREAN annotation</dt><dd>Clusters which are part of supercluster and classified by TAREAN as putative satellite are listed here</dd>
<dt>Clusters</dt><dd>hyperlinked list of clusters which are part of the superclusters.</dd>
</dl>

<h1 id="tra"> Tandem repeat analysis </h1>

<p>
TAREAN divides clusters into five categories with corresponding files in the
archive:
</p>

<ul class="org-ul">
<li>High confidence satellites with consensus sequences in file <code>TR_consensus_rank_1_.fasta</code></li>
<li>Low confidence satellites with consensus sequences in file <code>TR_consensus_rank_2_.fasta</code></li>
<li>Putative LTR element with consensus sequences in file <code>TR_consensus_rank_3_.fasta</code></li>
<li>rDNA with consensus in <code>TR_consensus_rank_4_.fasta</code></li>
<li>other clusters – these clusters are not reconstructed by TAREAN because no potential tandem like structure was found.</li>
</ul>

<p>
Summary tables from TAREAN html report include following information:
</p>

<dl class="org-dl">
<dt>Cluster</dt><dd>cluster identifier</dd>
<dt>Proportion<code>[%]</code></dt><dd>(Number of sequences in cluster/Number of sequences in clustering) x 100%</dd>
<dt>Proportion adjusted<code>[%]</code></dt><dd></dd>

<dt>Number of reads</dt><dd>Number of reads in the cluster</dd>
<dt>Satellite probability</dt><dd>Empirical probability estimate that cluster sequences are derived from satellite repeat. This estimate is based on analysis of  manually anotated and experimentaly validated satellite repeats</dd>
<dt>Consensus length</dt><dd></dd>

<dt>Consensus</dt><dd>Consensus sequence is outcome of kmer-based analysis and represents the most probable satellite monomer sequence, other alternative consensus sequences are included in individual cluster reports</dd>
<dt>Graph layout</dt><dd>Graph-based visualization of similarities among sequence reads</dd>
<dt>Kmer analysis</dt><dd>hyperlink to Individual clusters TAREAN kmer report (fig X, box 10)</dd>
<dt>Connected component index C</dt><dd>Proportion of nodes of the graph which are part of the the largest strongly connected component</dd>
<dt>Pair completeness index P</dt><dd>Proportion of reads with available mate-pair within the same cluster</dd>
<dt>Kmer coverage</dt><dd>Sum of relative frequencies of all kmers used for consensus sequence reconstruction</dd>
<dt>|V|</dt><dd>Number of vertices of the graph</dd>
<dt>|E|</dt><dd>Number of edges of the graph</dd>
<dt>PBS score</dt><dd>Primer binding site detection score</dd>
<dt>Similarity hits</dt><dd>similarity hits based on the search using blastn/blastx against built-in databases of known  sequences. By default, this will contain similarity hits to built in database which include rDNA sequences, plastid and mitochondrial sequences. If TAREAN was run within RepeatExplorer2 pipeline, it will also contain information about similarity hist against REXdb database.</dd>
</dl>

<p>
In individual clusters TAREAN report contain other variant of consensus
sequences sorted by kmer coverage score. For each consensus, corresponding
de-Bruijn graph representation and corresponding sequence logo is shown.
</p>

<h1 id="kmer"> TAREAN k-mer analysis report </h1>

<p>
TAREAN module generates kmer analysis report for each cluster assigned to a putative satellite, rDNA or a putative LTR category. Monomer sequences  of putative tandem repeats  are reconstructed using k-mer based method using the most frequent k-mers. Several k-mer lengths are evaluated and the best estimated of monomer consensus sequence are reported. Kmer analysis summary contain the following information:
</p>
<dl class="org-dl">
<dt>k-mer length</dt><dd>length of the k-mer used for monomer reconstruction</dd>
<dt>Variant index</dt><dd>Each kmer of given length can yield multiple consensus variant. Variants are indexed</dd>
<dt>k-mer coverage score </dt><dd>is sum of proportions of all k-mer used for reconstruction of particular monomer. If the value is 1 then all kmers from corresponding cluster were used for reconstruction of monomer meaning that there is no variability. The more variable the monomer, the lower the k-mer coverage score.</dd>
<dt>Consensus length</dt><dd>length of estimated monomer</dd>
<dt>Consensus</dt><dd>consensus sequence shows the consensus sequence extracted from position probability matrix.</dd>
<dt>k-mer bases graph</dt><dd>the visualization of de-Bruijn graph. Each vertex corespond to single k-mer. Size of vertex is proportional to the kmer frequency. Path which was used to reconstruct monomer sequence is grey out.</dd>
<dt>Sequence logo </dt><dd>visualization of position probability matrices for corresponding consensus variant.</dd>
</dl>
</div>
</body>
</html>