Mercurial > repos > iuc > multiqc
view test-data/megahit.txt @ 27:7591bce96601 draft
planemo upload for repository https://github.com/galaxyproject/tools-iuc/tree/master/tools/multiqc commit 327834d2ea9b16f0f0264fa4e9b675a2277f2fee
author | iuc |
---|---|
date | Tue, 18 Feb 2025 23:18:25 +0000 |
parents | |
children |
line wrap: on
line source
2025-02-13 13:23:44 - MEGAHIT v1.2.9 2025-02-13 13:23:44 - Using megahit_core with POPCNT and BMI2 support 2025-02-13 13:23:44 - Convert reads to binary library 2025-02-13 13:23:44 - command /usr/local/tools/_conda/envs/__megahit@1.2.9/bin/megahit_core buildlib /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/reads.lib /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/reads.lib 2025-02-13 13:23:44 - b'INFO sequence/io/sequence_lib.cpp : 75 - Lib 0 (/data/dnb10/galaxy_db/files/c/5/2/dataset_c52c6559-228d-4131-9eec-f5b8d04f08c8.dat): se, 1 reads, 1232 max length' 2025-02-13 13:23:44 - b'INFO utils/utils.h : 152 - Real: 0.2031\tuser: 0.0028\tsys: 0.0074\tmaxrss: 14696' 2025-02-13 13:23:44 - Start assembly. Number of CPU threads 10 2025-02-13 13:23:44 - k list: 21,29,39,59,79,99,119,141 2025-02-13 13:23:44 - Memory used: 83886080 2025-02-13 13:23:44 - Extract solid (k+1)-mers for k = 21 2025-02-13 13:23:44 - command /usr/local/tools/_conda/envs/__megahit@1.2.9/bin/megahit_core count -k 21 -m 2 --host_mem 83886080 --mem_flag 1 --output_prefix /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/k21/21 --num_cpu_threads 10 --read_lib_file /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/reads.lib 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-02-13 13:23:44 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 324' 2025-02-13 13:23:44 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 324' 2025-02-13 13:23:44 - b'INFO sorting/kmer_counter.cpp : 76 - 1 reads, 1232 max read length' 2025-02-13 13:23:44 - b'INFO sorting/kmer_counter.cpp : 82 - 2 words per substring, 2 words per edge' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.0209' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 5243336 bytes' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 161, Lv2 items: 30' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 5243252, Memory for Lv1+Lv2: 1124' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.0257' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 120' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0003' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0022' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 120 to 361' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0001' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0001' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 361 to 602' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0001' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0001' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 602 to 843' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0001' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0002' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 843 to 1084' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0001' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0002' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1084 to 65536' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0027' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0031' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 0.0096' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-02-13 13:23:44 - b'INFO sorting/kmer_counter.cpp : 405 - Total number of candidate reads: 1 (1)' 2025-02-13 13:23:44 - b'INFO sorting/kmer_counter.cpp : 407 - Total number of solid edges: 26' 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0595' 2025-02-13 13:23:44 - b'INFO utils/utils.h : 152 - Real: 0.1204\tuser: 0.3707\tsys: 0.0656\tmaxrss: 30296' 2025-02-13 13:23:44 - Build graph for k = 21 2025-02-13 13:23:44 - command /usr/local/tools/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/k21/21 --num_cpu_threads 10 -k 21 --kmer_from 0 --input_prefix /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/k21/21 --need_mercy 2025-02-13 13:23:44 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 26' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 704, number contigs: 0, number multiplicity: 32' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 184, multiplicity vector: 32' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 26 edges.' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 184/26/572, multiplicity vector: 26/32' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 440 - Adding mercy edges...' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 1 reads to search for mercy k-mers' 2025-02-13 13:23:44 - b'INFO sorting/seq_to_sdbg.cpp : 355 - Number of reads: 1, Number of mercy edges: 529' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 444 - Done. Time elapsed: 0.2585' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 445 - After adding mercy, sizeof seq_package: 5640/555/12210, multiplicity vector: 555/555' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 5640/555/12210, multiplicity vector: 555/555' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.3852' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 7022 bytes' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 444, Lv2 items: 90' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 6870, Memory for Lv1+Lv2: 2496' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.0129' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 167' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0001' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0005' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 167 to 355' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0001' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0001' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 355 to 543' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0001' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 543 to 731' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0001' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 731 to 919' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0002' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 919 to 65536' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.0026' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0024' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 0.0066' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 0 253 302 302 253 0 0 0 0' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 1110' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 1110' 2025-02-13 13:23:45 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 0' 2025-02-13 13:23:45 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.1141' 2025-02-13 13:23:45 - b'INFO utils/utils.h : 152 - Real: 0.5262\tuser: 0.5163\tsys: 0.3042\tmaxrss: 269456' 2025-02-13 13:23:45 - Assemble contigs from SdBG for k = 21 2025-02-13 13:23:45 - command /usr/local/tools/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/k21/21 -o /data/jwd02f/main/079/102/79102477/working/megahit_out/intermediate_contigs/k21 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/k21/21Done. Time elapsed: 0.148410' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 133 - Number of Edges: 1110; K value: 21' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' 2025-02-13 13:23:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 0; time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 0; time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 0; time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 0; time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 0; time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 42; Accumulated tips removed: 0; time elapsed: 0.0000' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 0.002' 2025-02-13 13:23:45 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 0, palindrome: 0' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 166 - unitig graph size: 1, time for building: 0.002' 2025-02-13 13:23:45 - b'INFO assembly/contig_stat.h : 40 - Max: 576, Min: 576, N50: 576, number contigs: 1, number isolated: 1, number looped: 1, total size: 576,' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.000' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.000024' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.000' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' 2025-02-13 13:23:45 - b'INFO assembly/contig_stat.h : 40 - Max: 576, Min: 576, N50: 576, number contigs: 1, number isolated: 1, number looped: 1, total size: 576,' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 267 - Time to output: 0.000192' 2025-02-13 13:23:45 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 0, complex bubbles removed: 0, time: 0.000034' 2025-02-13 13:23:45 - b'INFO assembly/contig_stat.h : 40 - Max: 576, Min: 576, N50: 576, number contigs: 1, number isolated: 1, number looped: 1, total size: 576,' 2025-02-13 13:23:45 - b'INFO utils/utils.h : 152 - Real: 0.1675\tuser: 0.2808\tsys: 0.0330\tmaxrss: 22464' 2025-02-13 13:23:45 - Local assembly for k = 21 2025-02-13 13:23:45 - command /usr/local/tools/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /data/jwd02f/main/079/102/79102477/working/megahit_out/intermediate_contigs/k21.contigs.fa -l /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/reads.lib -t 10 -o /data/jwd02f/main/079/102/79102477/working/megahit_out/intermediate_contigs/k21.local.fa --kmax 29 2025-02-13 13:23:45 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 0, index size: 0' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 0.003884' 2025-02-13 13:23:45 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 324' 2025-02-13 13:23:45 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 324' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.001268' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.000001' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 1 reads, aligned 0, added 0 reads to local assembly' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 0.000047' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 0' 2025-02-13 13:23:45 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 0.004100' 2025-02-13 13:23:45 - b'INFO utils/utils.h : 152 - Real: 0.0094\tuser: 0.0553\tsys: 0.0074\tmaxrss: 14696' 2025-02-13 13:23:45 - Extract iterative edges from k = 21 to 29 2025-02-13 13:23:45 - command /usr/local/tools/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /data/jwd02f/main/079/102/79102477/working/megahit_out/intermediate_contigs/k21.contigs.fa -b /data/jwd02f/main/079/102/79102477/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa -t 10 -k 21 -s 8 -o /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/k29/29 -r /data/jwd02f/main/079/102/79102477/working/megahit_out/tmp/reads.lib.bin 2025-02-13 13:23:45 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 8' 2025-02-13 13:23:45 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 8' 2025-02-13 13:23:45 - b'INFO main_iterate.cpp : 138 - Processed: 1, aligned: 0. Iterative edges: 0' 2025-02-13 13:23:45 - b'INFO main_iterate.cpp : 142 - Total: 1, aligned: 0. Iterative edges: 0' 2025-02-13 13:23:45 - b'INFO utils/utils.h : 152 - Real: 0.0136\tuser: 0.0433\tsys: 0.0101\tmaxrss: 14696' 2025-02-13 13:23:45 - Merging to output final contigs 2025-02-13 13:23:45 - 1 contigs, total 576 bp, min 576 bp, max 576 bp, avg 576 bp, N50 576 bp 2025-02-13 13:23:45 - ALL DONE. Time elapsed: 1.490756 seconds