Mercurial > repos > iuc > tooldistillator_summarize
diff test-data/megahit/log.txt @ 7:7fe1fe92de41 draft
planemo upload for repository https://github.com/galaxyproject/tools-iuc/tree/master/tools/tooldistillator commit b14e0602e63d833befda354faa901e4b3e8d06fe
| author | iuc |
|---|---|
| date | Tue, 15 Jul 2025 09:51:56 +0000 |
| parents | |
| children |
line wrap: on
line diff
--- /dev/null Thu Jan 01 00:00:00 1970 +0000 +++ b/test-data/megahit/log.txt Tue Jul 15 09:51:56 2025 +0000 @@ -0,0 +1,2759 @@ +2025-05-06 15:55:42 - MEGAHIT v1.2.9 +2025-05-06 15:55:42 - Using megahit_core with POPCNT and BMI2 support +2025-05-06 15:55:42 - Convert reads to binary library +2025-05-06 15:55:42 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core buildlib /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib +2025-05-06 15:56:00 - b'INFO sequence/io/sequence_lib.cpp : 75 - Lib 0 (/shared/ifbstor1/galaxy/datasets2/f/2/7/dataset_f2732895-cf11-4caf-81a5-abff40998680.dat,/shared/ifbstor1/galaxy/datasets2/e/d/4/dataset_ed453ac0-01f0-49ac-850a-cc52bead832e.dat): pe, 13163984 reads, 101 max length' +2025-05-06 15:56:00 - b'INFO utils/utils.h : 152 - Real: 17.6387\tuser: 18.0141\tsys: 1.6238\tmaxrss: 278536' +2025-05-06 15:56:00 - Start assembly. Number of CPU threads 10 +2025-05-06 15:56:00 - k list: 21,29,39,59,79,99,119,141 +2025-05-06 15:56:00 - Memory used: 83886080 +2025-05-06 15:56:00 - Extract solid (k+1)-mers for k = 21 +2025-05-06 15:56:00 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core count -k 21 -m 2 --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 --num_cpu_threads 10 --read_lib_file /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib +2025-05-06 15:56:00 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 15:56:00 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 15:56:01 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 15:56:01 - b'INFO sorting/kmer_counter.cpp : 76 - 13163984 reads, 101 max read length' +2025-05-06 15:56:01 - b'INFO sorting/kmer_counter.cpp : 82 - 2 words per substring, 2 words per edge' +2025-05-06 15:56:01 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.8890' +2025-05-06 15:56:01 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 561884312 bytes' +2025-05-06 15:56:02 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 561884312), still trying to perform sorting' +2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 7346844, Lv2 items: 241796' +2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 528628200, Memory for Lv1+Lv2: 33256112' +2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 1.5723' +2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 15:56:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 8' +2025-05-06 15:56:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4914' +2025-05-06 15:56:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0903' +2025-05-06 15:56:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8 to 21' +2025-05-06 15:56:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4736' +2025-05-06 15:56:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0615' +2025-05-06 15:56:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21 to 42' +2025-05-06 15:56:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4851' +2025-05-06 15:56:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1414' +2025-05-06 15:56:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42 to 70' +2025-05-06 15:56:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4749' +2025-05-06 15:56:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0775' +2025-05-06 15:56:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 70 to 104' +2025-05-06 15:56:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4707' +2025-05-06 15:56:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0922' +2025-05-06 15:56:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 104 to 145' +2025-05-06 15:56:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4761' +2025-05-06 15:56:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1232' +2025-05-06 15:56:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 145 to 192' +2025-05-06 15:56:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4891' +2025-05-06 15:56:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1146' +2025-05-06 15:56:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 192 to 244' +2025-05-06 15:56:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4772' +2025-05-06 15:56:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1196' +2025-05-06 15:56:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 244 to 301' +2025-05-06 15:56:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4751' +2025-05-06 15:56:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1163' +2025-05-06 15:56:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 301 to 362' +2025-05-06 15:56:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4774' +2025-05-06 15:56:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1287' +2025-05-06 15:56:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 362 to 428' +2025-05-06 15:56:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4753' +2025-05-06 15:56:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1226' +2025-05-06 15:56:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 428 to 499' +2025-05-06 15:56:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4770' +2025-05-06 15:56:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1551' +2025-05-06 15:56:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 499 to 574' +2025-05-06 15:56:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4791' +2025-05-06 15:56:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1778' +2025-05-06 15:56:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 574 to 653' +2025-05-06 15:56:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4778' +2025-05-06 15:56:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1487' +2025-05-06 15:56:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 653 to 736' +2025-05-06 15:56:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4777' +2025-05-06 15:56:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1401' +2025-05-06 15:56:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 736 to 823' +2025-05-06 15:56:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4755' +2025-05-06 15:56:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1356' +2025-05-06 15:56:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 823 to 914' +2025-05-06 15:56:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4741' +2025-05-06 15:56:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1527' +2025-05-06 15:56:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 914 to 1009' +2025-05-06 15:56:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4783' +2025-05-06 15:56:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1483' +2025-05-06 15:56:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1009 to 1109' +2025-05-06 15:56:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4769' +2025-05-06 15:56:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1563' +2025-05-06 15:56:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1109 to 1213' +2025-05-06 15:56:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4778' +2025-05-06 15:56:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1535' +2025-05-06 15:56:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1213 to 1322' +2025-05-06 15:56:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' +2025-05-06 15:56:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1623' +2025-05-06 15:56:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1322 to 1435' +2025-05-06 15:56:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4796' +2025-05-06 15:56:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1575' +2025-05-06 15:56:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1435 to 1552' +2025-05-06 15:56:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4780' +2025-05-06 15:56:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1677' +2025-05-06 15:56:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1552 to 1672' +2025-05-06 15:56:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4868' +2025-05-06 15:56:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1816' +2025-05-06 15:56:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1672 to 1796' +2025-05-06 15:56:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4923' +2025-05-06 15:56:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1648' +2025-05-06 15:56:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1796 to 1924' +2025-05-06 15:56:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4782' +2025-05-06 15:56:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1774' +2025-05-06 15:56:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1924 to 2056' +2025-05-06 15:56:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4792' +2025-05-06 15:56:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1680' +2025-05-06 15:56:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2056 to 2192' +2025-05-06 15:56:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4770' +2025-05-06 15:56:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1692' +2025-05-06 15:56:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2192 to 2332' +2025-05-06 15:56:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4773' +2025-05-06 15:56:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1793' +2025-05-06 15:56:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2332 to 2475' +2025-05-06 15:56:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4780' +2025-05-06 15:56:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1712' +2025-05-06 15:56:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2475 to 2621' +2025-05-06 15:56:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4812' +2025-05-06 15:56:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1728' +2025-05-06 15:56:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2621 to 2771' +2025-05-06 15:56:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4781' +2025-05-06 15:56:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1783' +2025-05-06 15:56:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2771 to 2925' +2025-05-06 15:56:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4840' +2025-05-06 15:56:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1723' +2025-05-06 15:56:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2925 to 3082' +2025-05-06 15:56:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4810' +2025-05-06 15:56:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1830' +2025-05-06 15:56:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3082 to 3243' +2025-05-06 15:56:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4805' +2025-05-06 15:56:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1770' +2025-05-06 15:56:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3243 to 3409' +2025-05-06 15:57:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4795' +2025-05-06 15:57:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1858' +2025-05-06 15:57:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3409 to 3579' +2025-05-06 15:57:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' +2025-05-06 15:57:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1867' +2025-05-06 15:57:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3579 to 3752' +2025-05-06 15:57:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4814' +2025-05-06 15:57:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1819' +2025-05-06 15:57:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3752 to 3929' +2025-05-06 15:57:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4783' +2025-05-06 15:57:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1876' +2025-05-06 15:57:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3929 to 4109' +2025-05-06 15:57:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4806' +2025-05-06 15:57:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1856' +2025-05-06 15:57:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4109 to 4293' +2025-05-06 15:57:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4789' +2025-05-06 15:57:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1857' +2025-05-06 15:57:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4293 to 4481' +2025-05-06 15:57:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' +2025-05-06 15:57:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1923' +2025-05-06 15:57:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4481 to 4673' +2025-05-06 15:57:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4793' +2025-05-06 15:57:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1860' +2025-05-06 15:57:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4673 to 4869' +2025-05-06 15:57:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4786' +2025-05-06 15:57:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1965' +2025-05-06 15:57:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4869 to 5069' +2025-05-06 15:57:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4833' +2025-05-06 15:57:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1915' +2025-05-06 15:57:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5069 to 5273' +2025-05-06 15:57:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4799' +2025-05-06 15:57:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1897' +2025-05-06 15:57:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5273 to 5481' +2025-05-06 15:57:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4887' +2025-05-06 15:57:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2032' +2025-05-06 15:57:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5481 to 5693' +2025-05-06 15:57:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4864' +2025-05-06 15:57:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2289' +2025-05-06 15:57:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5693 to 5909' +2025-05-06 15:57:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4799' +2025-05-06 15:57:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2003' +2025-05-06 15:57:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5909 to 6129' +2025-05-06 15:57:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4838' +2025-05-06 15:57:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2016' +2025-05-06 15:57:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6129 to 6353' +2025-05-06 15:57:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4800' +2025-05-06 15:57:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1965' +2025-05-06 15:57:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6353 to 6581' +2025-05-06 15:57:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4797' +2025-05-06 15:57:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2005' +2025-05-06 15:57:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6581 to 6813' +2025-05-06 15:57:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4802' +2025-05-06 15:57:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1961' +2025-05-06 15:57:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6813 to 7050' +2025-05-06 15:57:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4795' +2025-05-06 15:57:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2028' +2025-05-06 15:57:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7050 to 7291' +2025-05-06 15:57:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4796' +2025-05-06 15:57:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1982' +2025-05-06 15:57:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7291 to 7536' +2025-05-06 15:57:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4806' +2025-05-06 15:57:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2012' +2025-05-06 15:57:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7536 to 7785' +2025-05-06 15:57:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4792' +2025-05-06 15:57:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2018' +2025-05-06 15:57:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7785 to 8039' +2025-05-06 15:57:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4809' +2025-05-06 15:57:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2039' +2025-05-06 15:57:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8039 to 8297' +2025-05-06 15:57:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4784' +2025-05-06 15:57:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2032' +2025-05-06 15:57:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8297 to 8560' +2025-05-06 15:57:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4815' +2025-05-06 15:57:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2000' +2025-05-06 15:57:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8560 to 8827' +2025-05-06 15:57:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4810' +2025-05-06 15:57:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2055' +2025-05-06 15:57:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8827 to 9098' +2025-05-06 15:57:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4802' +2025-05-06 15:57:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2039' +2025-05-06 15:57:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9098 to 9373' +2025-05-06 15:57:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' +2025-05-06 15:57:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2078' +2025-05-06 15:57:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9373 to 9653' +2025-05-06 15:57:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4798' +2025-05-06 15:57:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2049' +2025-05-06 15:57:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9653 to 9937' +2025-05-06 15:57:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4806' +2025-05-06 15:57:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2079' +2025-05-06 15:57:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9937 to 10226' +2025-05-06 15:57:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4804' +2025-05-06 15:57:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2073' +2025-05-06 15:57:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10226 to 10520' +2025-05-06 15:57:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4826' +2025-05-06 15:57:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2093' +2025-05-06 15:57:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10520 to 10819' +2025-05-06 15:57:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4803' +2025-05-06 15:57:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2068' +2025-05-06 15:57:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10819 to 11124' +2025-05-06 15:57:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4808' +2025-05-06 15:57:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2110' +2025-05-06 15:57:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11124 to 11434' +2025-05-06 15:57:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4821' +2025-05-06 15:57:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2081' +2025-05-06 15:57:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11434 to 11749' +2025-05-06 15:58:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4825' +2025-05-06 15:58:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2116' +2025-05-06 15:58:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11749 to 12070' +2025-05-06 15:58:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4810' +2025-05-06 15:58:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2075' +2025-05-06 15:58:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12070 to 12396' +2025-05-06 15:58:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4822' +2025-05-06 15:58:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2114' +2025-05-06 15:58:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12396 to 12727' +2025-05-06 15:58:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4818' +2025-05-06 15:58:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2079' +2025-05-06 15:58:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12727 to 13064' +2025-05-06 15:58:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4828' +2025-05-06 15:58:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2111' +2025-05-06 15:58:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13064 to 13407' +2025-05-06 15:58:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4830' +2025-05-06 15:58:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2102' +2025-05-06 15:58:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13407 to 13755' +2025-05-06 15:58:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4813' +2025-05-06 15:58:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2063' +2025-05-06 15:58:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13755 to 14109' +2025-05-06 15:58:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.8583' +2025-05-06 15:58:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2129' +2025-05-06 15:58:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14109 to 14469' +2025-05-06 15:58:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4853' +2025-05-06 15:58:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2061' +2025-05-06 15:58:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14469 to 14835' +2025-05-06 15:58:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4813' +2025-05-06 15:58:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2074' +2025-05-06 15:58:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14835 to 15207' +2025-05-06 15:58:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4811' +2025-05-06 15:58:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2095' +2025-05-06 15:58:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15207 to 15586' +2025-05-06 15:58:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4807' +2025-05-06 15:58:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2084' +2025-05-06 15:58:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15586 to 15971' +2025-05-06 15:58:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4812' +2025-05-06 15:58:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2086' +2025-05-06 15:58:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15971 to 16364' +2025-05-06 15:58:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' +2025-05-06 15:58:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2113' +2025-05-06 15:58:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16364 to 16764' +2025-05-06 15:58:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' +2025-05-06 15:58:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2096' +2025-05-06 15:58:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16764 to 17171' +2025-05-06 15:58:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4817' +2025-05-06 15:58:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2132' +2025-05-06 15:58:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17171 to 17585' +2025-05-06 15:58:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4818' +2025-05-06 15:58:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2137' +2025-05-06 15:58:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17585 to 18007' +2025-05-06 15:58:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4825' +2025-05-06 15:58:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2122' +2025-05-06 15:58:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18007 to 18436' +2025-05-06 15:58:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4826' +2025-05-06 15:58:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2220' +2025-05-06 15:58:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18436 to 18873' +2025-05-06 15:58:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4875' +2025-05-06 15:58:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2451' +2025-05-06 15:58:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18873 to 19318' +2025-05-06 15:58:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4869' +2025-05-06 15:58:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2158' +2025-05-06 15:58:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19318 to 19771' +2025-05-06 15:58:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4822' +2025-05-06 15:58:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2154' +2025-05-06 15:58:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19771 to 20233' +2025-05-06 15:58:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4828' +2025-05-06 15:58:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2156' +2025-05-06 15:58:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20233 to 20704' +2025-05-06 15:58:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4830' +2025-05-06 15:58:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2154' +2025-05-06 15:58:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20704 to 21185' +2025-05-06 15:58:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4819' +2025-05-06 15:58:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2157' +2025-05-06 15:58:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21185 to 21675' +2025-05-06 15:58:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4832' +2025-05-06 15:58:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2163' +2025-05-06 15:58:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21675 to 22174' +2025-05-06 15:58:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4832' +2025-05-06 15:58:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2168' +2025-05-06 15:58:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22174 to 22684' +2025-05-06 15:58:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4836' +2025-05-06 15:58:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2146' +2025-05-06 15:58:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22684 to 23204' +2025-05-06 15:58:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4833' +2025-05-06 15:58:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2166' +2025-05-06 15:58:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23204 to 23734' +2025-05-06 15:58:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4883' +2025-05-06 15:58:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2153' +2025-05-06 15:58:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23734 to 24276' +2025-05-06 15:58:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4834' +2025-05-06 15:58:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2137' +2025-05-06 15:58:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24276 to 24829' +2025-05-06 15:58:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4844' +2025-05-06 15:58:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2159' +2025-05-06 15:58:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24829 to 25394' +2025-05-06 15:58:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4849' +2025-05-06 15:58:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2158' +2025-05-06 15:58:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25394 to 25971' +2025-05-06 15:58:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4848' +2025-05-06 15:58:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2189' +2025-05-06 15:58:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25971 to 26561' +2025-05-06 15:58:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4861' +2025-05-06 15:58:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2150' +2025-05-06 15:58:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26561 to 27165' +2025-05-06 15:58:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4859' +2025-05-06 15:59:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2164' +2025-05-06 15:59:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27165 to 27783' +2025-05-06 15:59:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4851' +2025-05-06 15:59:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2200' +2025-05-06 15:59:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27783 to 28416' +2025-05-06 15:59:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 2.1820' +2025-05-06 15:59:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2197' +2025-05-06 15:59:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28416 to 29065' +2025-05-06 15:59:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4858' +2025-05-06 15:59:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2164' +2025-05-06 15:59:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29065 to 29730' +2025-05-06 15:59:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4870' +2025-05-06 15:59:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2176' +2025-05-06 15:59:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29730 to 30412' +2025-05-06 15:59:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4876' +2025-05-06 15:59:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2174' +2025-05-06 15:59:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30412 to 31111' +2025-05-06 15:59:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4870' +2025-05-06 15:59:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2191' +2025-05-06 15:59:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31111 to 31830' +2025-05-06 15:59:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4884' +2025-05-06 15:59:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2189' +2025-05-06 15:59:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31830 to 32571' +2025-05-06 15:59:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4872' +2025-05-06 15:59:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2199' +2025-05-06 15:59:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32571 to 33335' +2025-05-06 15:59:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4884' +2025-05-06 15:59:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2194' +2025-05-06 15:59:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33335 to 34122' +2025-05-06 15:59:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4886' +2025-05-06 15:59:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2201' +2025-05-06 15:59:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34122 to 34934' +2025-05-06 15:59:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4918' +2025-05-06 15:59:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2202' +2025-05-06 15:59:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34934 to 35775' +2025-05-06 15:59:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4899' +2025-05-06 15:59:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2201' +2025-05-06 15:59:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35775 to 36645' +2025-05-06 15:59:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4906' +2025-05-06 15:59:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2197' +2025-05-06 15:59:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36645 to 37547' +2025-05-06 15:59:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4916' +2025-05-06 15:59:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2221' +2025-05-06 15:59:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37547 to 38486' +2025-05-06 15:59:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4922' +2025-05-06 15:59:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2220' +2025-05-06 15:59:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38486 to 39466' +2025-05-06 15:59:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4939' +2025-05-06 15:59:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2228' +2025-05-06 15:59:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39466 to 40488' +2025-05-06 15:59:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4941' +2025-05-06 15:59:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2231' +2025-05-06 15:59:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40488 to 41561' +2025-05-06 15:59:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.4948' +2025-05-06 15:59:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2229' +2025-05-06 15:59:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41561 to 42693' +2025-05-06 15:59:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5038' +2025-05-06 15:59:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2266' +2025-05-06 15:59:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42693 to 43893' +2025-05-06 15:59:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5029' +2025-05-06 15:59:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2259' +2025-05-06 15:59:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43893 to 45170' +2025-05-06 15:59:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5013' +2025-05-06 15:59:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2288' +2025-05-06 15:59:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45170 to 46541' +2025-05-06 15:59:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5064' +2025-05-06 15:59:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2275' +2025-05-06 15:59:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46541 to 48029' +2025-05-06 15:59:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5056' +2025-05-06 15:59:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2275' +2025-05-06 15:59:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48029 to 49666' +2025-05-06 15:59:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5026' +2025-05-06 15:59:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2283' +2025-05-06 15:59:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49666 to 51507' +2025-05-06 15:59:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5086' +2025-05-06 15:59:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2291' +2025-05-06 15:59:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51507 to 53630' +2025-05-06 15:59:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5073' +2025-05-06 15:59:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2291' +2025-05-06 15:59:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53630 to 56208' +2025-05-06 15:59:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5075' +2025-05-06 15:59:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2305' +2025-05-06 15:59:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56208 to 59730' +2025-05-06 15:59:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5165' +2025-05-06 15:59:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2319' +2025-05-06 15:59:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59730 to 65536' +2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 1.5030' +2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1751' +2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 227.7403' +2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 15:59:50 - b'INFO sorting/kmer_counter.cpp : 405 - Total number of candidate reads: 163023 (920098)' +2025-05-06 15:59:50 - b'INFO sorting/kmer_counter.cpp : 407 - Total number of solid edges: 92664799' +2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.1896' +2025-05-06 15:59:50 - b'INFO utils/utils.h : 152 - Real: 230.4691\tuser: 2250.7830\tsys: 6.3315\tmaxrss: 574140' +2025-05-06 15:59:50 - Build graph for k = 21 +2025-05-06 15:59:50 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 --num_cpu_threads 10 -k 21 --kmer_from 0 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 --need_mercy +2025-05-06 15:59:50 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 15:59:51 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 92664799' +2025-05-06 15:59:51 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 2548281956, number contigs: 0, number multiplicity: 115830998' +2025-05-06 15:59:51 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 637070500, multiplicity vector: 115830998' +2025-05-06 15:59:53 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 92664799 edges.' +2025-05-06 15:59:53 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 637070500/92664799/2038625578, multiplicity vector: 92664799/115830998' +2025-05-06 15:59:53 - b'INFO sorting/seq_to_sdbg.cpp : 440 - Adding mercy edges...' +2025-05-06 15:59:54 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 65536 reads to search for mercy k-mers' +2025-05-06 15:59:55 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 65536 reads to search for mercy k-mers' +2025-05-06 15:59:55 - b'INFO sorting/seq_to_sdbg.cpp : 191 - Read 31951 reads to search for mercy k-mers' +2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 355 - Number of reads: 163023, Number of mercy edges: 2654870' +2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 444 - Done. Time elapsed: 2.8473' +2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 445 - After adding mercy, sizeof seq_package: 637070500/95319669/2097032718, multiplicity vector: 95319669/115830998' +2025-05-06 15:59:56 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 637070500/95319669/2097032718, multiplicity vector: 95319669/115830998' +2025-05-06 15:59:56 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 5.3960' +2025-05-06 15:59:56 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 903608516 bytes' +2025-05-06 15:59:57 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 903608516), still trying to perform sorting' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 4485631, Lv2 items: 68800' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 885115592, Memory for Lv1+Lv2: 18492924' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.9848' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 69' +2025-05-06 15:59:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5085' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2244' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 69 to 171' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2093' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0577' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 171 to 288' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2680' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0604' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 288 to 419' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2079' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0608' +2025-05-06 15:59:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 419 to 560' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2075' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0600' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 560 to 710' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2085' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0609' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 710 to 867' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2092' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0625' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 867 to 1031' +2025-05-06 15:59:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2092' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0629' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1031 to 1202' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2077' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0626' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1202 to 1379' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2119' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1379 to 1562' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2083' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0639' +2025-05-06 16:00:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1562 to 1750' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2107' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0709' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1750 to 1943' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2077' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0638' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1943 to 2142' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2090' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0641' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2142 to 2347' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2262' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' +2025-05-06 16:00:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2347 to 2557' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0641' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2557 to 2772' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2095' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0651' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2772 to 2992' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2254' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0675' +2025-05-06 16:00:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2992 to 3217' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2093' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0642' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3217 to 3447' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2093' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0649' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3447 to 3681' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0644' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3681 to 3920' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2109' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0657' +2025-05-06 16:00:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3920 to 4163' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2096' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0668' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4163 to 4410' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2101' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0659' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4410 to 4662' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2108' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0658' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4662 to 4918' +2025-05-06 16:00:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2094' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0652' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4918 to 5178' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2118' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0665' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5178 to 5442' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2123' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0655' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5442 to 5710' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2103' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0662' +2025-05-06 16:00:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5710 to 5982' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2118' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0660' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5982 to 6258' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2096' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0676' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6258 to 6537' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2100' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0673' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6537 to 6820' +2025-05-06 16:00:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2158' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0925' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6820 to 7107' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2123' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0661' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7107 to 7397' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2132' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0664' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7397 to 7691' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2165' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0819' +2025-05-06 16:00:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7691 to 7989' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2149' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0666' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7989 to 8292' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0668' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8292 to 8598' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2928' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0745' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8598 to 8908' +2025-05-06 16:00:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2098' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0659' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8908 to 9222' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2117' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0667' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9222 to 9540' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2367' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9540 to 9862' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2138' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0662' +2025-05-06 16:00:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9862 to 10188' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2136' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0671' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10188 to 10518' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2146' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0665' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10518 to 10852' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2131' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0669' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10852 to 11189' +2025-05-06 16:00:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2121' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0659' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11189 to 11530' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2135' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0671' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11530 to 11875' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2134' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11875 to 12224' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2173' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' +2025-05-06 16:00:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12224 to 12577' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2145' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0679' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12577 to 12934' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2128' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12934 to 13294' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2127' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0679' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13294 to 13658' +2025-05-06 16:00:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2117' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0675' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13658 to 14026' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2135' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14026 to 14398' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2130' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0697' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14398 to 14774' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2156' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0669' +2025-05-06 16:00:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14774 to 15154' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2149' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0688' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15154 to 15538' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2168' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0671' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15538 to 15926' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2177' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0676' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15926 to 16318' +2025-05-06 16:00:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2168' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16318 to 16714' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2169' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16714 to 17114' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2169' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1435' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17114 to 17519' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2225' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0679' +2025-05-06 16:00:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17519 to 17928' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2180' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0667' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17928 to 18341' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2166' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18341 to 18759' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2140' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0677' +2025-05-06 16:00:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18759 to 19181' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2147' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19181 to 19608' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2182' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0684' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19608 to 20040' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2182' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0675' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20040 to 20476' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2183' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0779' +2025-05-06 16:00:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20476 to 20917' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2192' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20917 to 21363' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2185' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0680' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21363 to 21814' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2185' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0774' +2025-05-06 16:00:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21814 to 22270' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.4154' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0720' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22270 to 22731' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2228' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0794' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22731 to 23197' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2194' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' +2025-05-06 16:00:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23197 to 23668' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2195' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0680' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23668 to 24144' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2192' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0689' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24144 to 24625' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2198' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0683' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24625 to 25111' +2025-05-06 16:00:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2177' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0777' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25111 to 25603' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2167' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25603 to 26100' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2197' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0681' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26100 to 26603' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2198' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' +2025-05-06 16:00:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26603 to 27111' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2211' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0706' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27111 to 27625' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2202' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0690' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27625 to 28145' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2207' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' +2025-05-06 16:00:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28145 to 28671' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2196' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0686' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28671 to 29203' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2209' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29203 to 29741' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2213' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0684' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29741 to 30286' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2206' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0682' +2025-05-06 16:00:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30286 to 30838' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2204' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30838 to 31396' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2174' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31396 to 31961' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2147' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' +2025-05-06 16:00:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31961 to 32533' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2147' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0685' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32533 to 33113' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2154' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0692' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33113 to 33700' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2148' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0692' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33700 to 34295' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2151' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' +2025-05-06 16:00:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34295 to 34898' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2343' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0713' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34898 to 35510' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2212' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0685' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35510 to 36131' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2199' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0688' +2025-05-06 16:00:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36131 to 36761' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2220' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0687' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36761 to 37400' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2169' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37400 to 38049' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2156' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38049 to 38709' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2154' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' +2025-05-06 16:00:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38709 to 39380' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2153' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39380 to 40062' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2158' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40062 to 40755' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2186' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0794' +2025-05-06 16:00:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40755 to 41460' +2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.4199' +2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0834' +2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41460 to 42178' +2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3866' +2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0725' +2025-05-06 16:00:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42178 to 42910' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2193' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0690' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42910 to 43657' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2218' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0699' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43657 to 44420' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2166' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0700' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 44420 to 45199' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2166' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' +2025-05-06 16:00:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45199 to 45996' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0699' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45996 to 46811' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46811 to 47647' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2159' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' +2025-05-06 16:00:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47647 to 48505' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0694' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48505 to 49385' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2162' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49385 to 50290' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2167' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0696' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50290 to 51224' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2167' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0703' +2025-05-06 16:00:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51224 to 52192' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2183' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0695' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52192 to 53197' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2231' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0696' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53197 to 54244' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2176' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0698' +2025-05-06 16:00:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 54244 to 55343' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2173' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0692' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55343 to 56504' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2224' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0795' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56504 to 57742' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3230' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0718' +2025-05-06 16:00:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 57742 to 59082' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2211' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59082 to 60575' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2241' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 60575 to 62347' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2183' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0685' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 62347 to 65536' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2189' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0636' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 38.6441' +2025-05-06 16:00:35 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 968795 51219806 44324149 44242015 51224080 141578 158697 156622 140646' +2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 192576388' +2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 191010050' +2025-05-06 16:00:36 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 968795' +2025-05-06 16:00:36 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0591' +2025-05-06 16:00:36 - b'INFO utils/utils.h : 152 - Real: 45.1308\tuser: 386.6365\tsys: 6.5397\tmaxrss: 1032000' +2025-05-06 16:00:36 - Assemble contigs from SdBG for k = 21 +2025-05-06 16:00:36 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble +2025-05-06 16:00:38 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k21/21Done. Time elapsed: 2.530597' +2025-05-06 16:00:38 - b'INFO main_assemble.cpp : 133 - Number of Edges: 192576388; K value: 21' +2025-05-06 16:00:38 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:00:41 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 22734; time elapsed: 0.2021' +2025-05-06 16:00:41 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 52171; time elapsed: 0.4023' +2025-05-06 16:00:42 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 97065; time elapsed: 0.8729' +2025-05-06 16:00:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 179073; time elapsed: 1.9333' +2025-05-06 16:00:48 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 306821; time elapsed: 3.7212' +2025-05-06 16:00:52 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 42; Accumulated tips removed: 407773; time elapsed: 4.4926' +2025-05-06 16:00:52 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 14.071' +2025-05-06 16:01:12 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 1016753, palindrome: 529' +2025-05-06 16:01:12 - b'INFO main_assemble.cpp : 166 - unitig graph size: 1016929, time for building: 19.572' +2025-05-06 16:01:15 - b'INFO assembly/contig_stat.h : 40 - Max: 11382, Min: 22, N50: 165, number contigs: 1016929, number isolated: 289308, number looped: 176, total size: 112740156,' +2025-05-06 16:01:15 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:01:16 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 40835, Time elapsed(sec): 1.520' +2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 9819, Time elapsed(sec): 0.699494' +2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 30916, time: 0.265' +2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 62, time: 0.162' +2025-05-06 16:01:17 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:01:18 - b'INFO main_assemble.cpp : 192 - Tips removed: 8436, time: 0.809' +2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 615, Time elapsed(sec): 0.269' +2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 235, Time elapsed(sec): 0.444457' +2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 287, time: 0.236' +2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.168' +2025-05-06 16:01:19 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:01:20 - b'INFO main_assemble.cpp : 192 - Tips removed: 96, time: 0.758' +2025-05-06 16:01:20 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.251' +2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 3, Time elapsed(sec): 0.443489' +2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 17, time: 0.225' +2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.039' +2025-05-06 16:01:21 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:01:22 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.731' +2025-05-06 16:01:22 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.240' +2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.435591' +2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 9, time: 0.232' +2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.033' +2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:01:23 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.707' +2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.236' +2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.422163' +2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 9, time: 0.216' +2025-05-06 16:01:24 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.033' +2025-05-06 16:01:27 - b'INFO assembly/contig_stat.h : 40 - Max: 31381, Min: 22, N50: 196, number contigs: 827315, number isolated: 302249, number looped: 90, total size: 107326489,' +2025-05-06 16:01:34 - b'INFO main_assemble.cpp : 267 - Time to output: 7.472257' +2025-05-06 16:01:41 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 16039, complex bubbles removed: 1073, time: 7.385293' +2025-05-06 16:01:43 - b'INFO assembly/contig_stat.h : 40 - Max: 34490, Min: 22, N50: 204, number contigs: 781125, number isolated: 302371, number looped: 91, total size: 106005456,' +2025-05-06 16:01:50 - b'INFO utils/utils.h : 152 - Real: 73.9337\tuser: 616.9657\tsys: 2.8704\tmaxrss: 454772' +2025-05-06 16:01:50 - Local assembly for k = 21 +2025-05-06 16:01:50 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.local.fa --kmax 29 +2025-05-06 16:01:54 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 99683, index size: 6321120' +2025-05-06 16:01:54 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 4.133395' +2025-05-06 16:01:54 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:01:55 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:01:55 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.716704' +2025-05-06 16:01:56 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 174.00 sd: 114.64' +2025-05-06 16:01:56 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.753277' +2025-05-06 16:02:04 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 8736916, added 1424390 reads to local assembly' +2025-05-06 16:02:04 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 8.076452' +2025-05-06 16:02:04 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:02:18 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 14.163707' +2025-05-06 16:02:18 - b'INFO utils/utils.h : 152 - Real: 27.9144\tuser: 225.4284\tsys: 1.5279\tmaxrss: 696940' +2025-05-06 16:02:18 - Extract iterative edges from k = 21 to 29 +2025-05-06 16:02:18 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa -t 10 -k 21 -s 8 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:02:18 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 8' +2025-05-06 16:02:18 - b'INFO main_iterate.cpp : 174 - Read 525066 contigs' +2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 1021006' +2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 174 - Read 107060 contigs' +2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 1181004' +2025-05-06 16:02:19 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 8' +2025-05-06 16:02:22 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 944610. Iterative edges: 3587266' +2025-05-06 16:02:25 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 1892328. Iterative edges: 4326289' +2025-05-06 16:02:27 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 2839663. Iterative edges: 4622084' +2025-05-06 16:02:27 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 2970005. Iterative edges: 4649513' +2025-05-06 16:02:28 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 2970005. Iterative edges: 4649513' +2025-05-06 16:02:28 - b'INFO utils/utils.h : 152 - Real: 10.0571\tuser: 70.4235\tsys: 1.1392\tmaxrss: 501728' +2025-05-06 16:02:28 - Build graph for k = 29 +2025-05-06 16:02:28 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 --num_cpu_threads 10 -k 29 --kmer_from 21 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa +2025-05-06 16:02:28 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 4649513' +2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 216390200, number contigs: 1074653, number multiplicity: 5724166' +2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 62694784, multiplicity vector: 5724166' +2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 4649513 edges.' +2025-05-06 16:02:28 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 62694784/4649513/139485390, multiplicity vector: 4649513/5724166' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 684048 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.contigs.fa.' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 116792336/5333561/243268884, multiplicity vector: 5333561/5724166' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 92193 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.bubble_seq.fa.' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 116792336/5425754/253844404, multiplicity vector: 5425754/5724166' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 19204 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.addi.fa.' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 116792336/5444958/258862158, multiplicity vector: 5444958/5724166' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 119515 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k21.local.fa.' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 116792336/5564473/309023104, multiplicity vector: 5564473/5724166' +2025-05-06 16:02:29 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 116792336/5564473/309023104, multiplicity vector: 5564473/5724166' +2025-05-06 16:02:29 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.8659' +2025-05-06 16:02:29 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 141083868 bytes' +2025-05-06 16:02:30 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 141083868), still trying to perform sorting' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 2490703, Lv2 items: 38843' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 130654940, Memory for Lv1+Lv2: 10428928' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.9688' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 54' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6086' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0407' +2025-05-06 16:02:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 54 to 142' +2025-05-06 16:02:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5952' +2025-05-06 16:02:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0399' +2025-05-06 16:02:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 142 to 245' +2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5957' +2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0412' +2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 245 to 362' +2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5960' +2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0415' +2025-05-06 16:02:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 362 to 491' +2025-05-06 16:02:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6017' +2025-05-06 16:02:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0457' +2025-05-06 16:02:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 491 to 628' +2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5971' +2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0561' +2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 628 to 772' +2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6073' +2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0487' +2025-05-06 16:02:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 772 to 923' +2025-05-06 16:02:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6031' +2025-05-06 16:02:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0470' +2025-05-06 16:02:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 923 to 1080' +2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5993' +2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0472' +2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1080 to 1243' +2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' +2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0606' +2025-05-06 16:02:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1243 to 1412' +2025-05-06 16:02:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6001' +2025-05-06 16:02:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0475' +2025-05-06 16:02:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1412 to 1587' +2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5980' +2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0480' +2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1587 to 1768' +2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6067' +2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0488' +2025-05-06 16:02:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1768 to 1953' +2025-05-06 16:02:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6052' +2025-05-06 16:02:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0485' +2025-05-06 16:02:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1953 to 2144' +2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6049' +2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0494' +2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2144 to 2340' +2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6192' +2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0555' +2025-05-06 16:02:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2340 to 2541' +2025-05-06 16:02:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5989' +2025-05-06 16:02:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0492' +2025-05-06 16:02:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2541 to 2748' +2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5991' +2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0494' +2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2748 to 2960' +2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6013' +2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0501' +2025-05-06 16:02:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2960 to 3176' +2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6011' +2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0649' +2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3176 to 3397' +2025-05-06 16:02:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5994' +2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0514' +2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3397 to 3623' +2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5983' +2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0505' +2025-05-06 16:02:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3623 to 3853' +2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5970' +2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0504' +2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3853 to 4087' +2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6138' +2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0568' +2025-05-06 16:02:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4087 to 4325' +2025-05-06 16:02:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6032' +2025-05-06 16:02:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0593' +2025-05-06 16:02:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4325 to 4567' +2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6051' +2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0574' +2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4567 to 4813' +2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6054' +2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0571' +2025-05-06 16:02:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4813 to 5064' +2025-05-06 16:02:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5980' +2025-05-06 16:02:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0512' +2025-05-06 16:02:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5064 to 5319' +2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6144' +2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' +2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5319 to 5578' +2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5990' +2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0512' +2025-05-06 16:02:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5578 to 5841' +2025-05-06 16:02:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6075' +2025-05-06 16:02:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0693' +2025-05-06 16:02:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5841 to 6107' +2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6016' +2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0524' +2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6107 to 6377' +2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6004' +2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0513' +2025-05-06 16:02:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6377 to 6651' +2025-05-06 16:02:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6001' +2025-05-06 16:02:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0528' +2025-05-06 16:02:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6651 to 6928' +2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6025' +2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0530' +2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6928 to 7209' +2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5999' +2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0516' +2025-05-06 16:02:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7209 to 7494' +2025-05-06 16:02:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6016' +2025-05-06 16:02:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0518' +2025-05-06 16:02:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7494 to 7783' +2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6024' +2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0545' +2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7783 to 8076' +2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5998' +2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' +2025-05-06 16:02:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8076 to 8372' +2025-05-06 16:02:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6050' +2025-05-06 16:02:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0691' +2025-05-06 16:02:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8372 to 8672' +2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6093' +2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0586' +2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8672 to 8976' +2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' +2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0575' +2025-05-06 16:02:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8976 to 9284' +2025-05-06 16:02:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6011' +2025-05-06 16:02:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0522' +2025-05-06 16:02:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9284 to 9596' +2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5994' +2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0532' +2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9596 to 9912' +2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5997' +2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0534' +2025-05-06 16:02:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9912 to 10232' +2025-05-06 16:03:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5975' +2025-05-06 16:03:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' +2025-05-06 16:03:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10232 to 10556' +2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6000' +2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0537' +2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10556 to 10883' +2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5996' +2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0527' +2025-05-06 16:03:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10883 to 11214' +2025-05-06 16:03:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5978' +2025-05-06 16:03:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0523' +2025-05-06 16:03:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11214 to 11549' +2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6035' +2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0537' +2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11549 to 11888' +2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6008' +2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0549' +2025-05-06 16:03:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11888 to 12231' +2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5993' +2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0530' +2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12231 to 12578' +2025-05-06 16:03:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6044' +2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0537' +2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12578 to 12929' +2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6021' +2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0533' +2025-05-06 16:03:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12929 to 13284' +2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6021' +2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0534' +2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13284 to 13643' +2025-05-06 16:03:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6010' +2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0530' +2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13643 to 14006' +2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5995' +2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0546' +2025-05-06 16:03:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14006 to 14373' +2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6020' +2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0531' +2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14373 to 14744' +2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5989' +2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0532' +2025-05-06 16:03:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14744 to 15119' +2025-05-06 16:03:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6014' +2025-05-06 16:03:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0533' +2025-05-06 16:03:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15119 to 15498' +2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6019' +2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0545' +2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15498 to 15881' +2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6025' +2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0524' +2025-05-06 16:03:10 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15881 to 16268' +2025-05-06 16:03:11 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' +2025-05-06 16:03:11 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0535' +2025-05-06 16:03:11 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16268 to 16659' +2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5998' +2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0532' +2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16659 to 17054' +2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6027' +2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0531' +2025-05-06 16:03:12 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17054 to 17454' +2025-05-06 16:03:13 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5989' +2025-05-06 16:03:13 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0529' +2025-05-06 16:03:13 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17454 to 17858' +2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6012' +2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0541' +2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17858 to 18267' +2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5994' +2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0540' +2025-05-06 16:03:14 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18267 to 18680' +2025-05-06 16:03:15 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5987' +2025-05-06 16:03:15 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0536' +2025-05-06 16:03:15 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18680 to 19098' +2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6107' +2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0619' +2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19098 to 19521' +2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6024' +2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0619' +2025-05-06 16:03:16 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19521 to 19949' +2025-05-06 16:03:17 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6010' +2025-05-06 16:03:17 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0591' +2025-05-06 16:03:17 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19949 to 20382' +2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5940' +2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0583' +2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20382 to 20820' +2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6184' +2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0551' +2025-05-06 16:03:18 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20820 to 21263' +2025-05-06 16:03:19 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6207' +2025-05-06 16:03:19 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0607' +2025-05-06 16:03:19 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21263 to 21711' +2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5943' +2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0582' +2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21711 to 22164' +2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5881' +2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0557' +2025-05-06 16:03:20 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22164 to 22622' +2025-05-06 16:03:21 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5879' +2025-05-06 16:03:21 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0557' +2025-05-06 16:03:21 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22622 to 23085' +2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5880' +2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0558' +2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23085 to 23553' +2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5888' +2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0602' +2025-05-06 16:03:22 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23553 to 24026' +2025-05-06 16:03:23 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5875' +2025-05-06 16:03:23 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0584' +2025-05-06 16:03:23 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24026 to 24504' +2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5884' +2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0610' +2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24504 to 24987' +2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5890' +2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0622' +2025-05-06 16:03:24 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24987 to 25476' +2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5895' +2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0580' +2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25476 to 25970' +2025-05-06 16:03:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5897' +2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0622' +2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25970 to 26470' +2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5896' +2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0656' +2025-05-06 16:03:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26470 to 26975' +2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5902' +2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0574' +2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26975 to 27486' +2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5877' +2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0580' +2025-05-06 16:03:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27486 to 28003' +2025-05-06 16:03:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5878' +2025-05-06 16:03:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0569' +2025-05-06 16:03:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28003 to 28527' +2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5885' +2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0588' +2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28527 to 29057' +2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5852' +2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0673' +2025-05-06 16:03:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29057 to 29593' +2025-05-06 16:03:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5947' +2025-05-06 16:03:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0650' +2025-05-06 16:03:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29593 to 30136' +2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5880' +2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0564' +2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30136 to 30686' +2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5879' +2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0568' +2025-05-06 16:03:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30686 to 31243' +2025-05-06 16:03:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5887' +2025-05-06 16:03:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0642' +2025-05-06 16:03:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31243 to 31806' +2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5891' +2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0628' +2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31806 to 32377' +2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5899' +2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0634' +2025-05-06 16:03:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32377 to 32956' +2025-05-06 16:03:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5902' +2025-05-06 16:03:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0585' +2025-05-06 16:03:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32956 to 33542' +2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5927' +2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0566' +2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33542 to 34137' +2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6025' +2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0724' +2025-05-06 16:03:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34137 to 34740' +2025-05-06 16:03:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5889' +2025-05-06 16:03:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0611' +2025-05-06 16:03:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34740 to 35351' +2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5936' +2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0570' +2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35351 to 35971' +2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5896' +2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0615' +2025-05-06 16:03:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35971 to 36600' +2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5950' +2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0560' +2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36600 to 37239' +2025-05-06 16:03:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5904' +2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0563' +2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37239 to 37888' +2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5910' +2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0577' +2025-05-06 16:03:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37888 to 38548' +2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5900' +2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0592' +2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38548 to 39219' +2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5919' +2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0610' +2025-05-06 16:03:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39219 to 39902' +2025-05-06 16:03:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5913' +2025-05-06 16:03:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0582' +2025-05-06 16:03:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39902 to 40598' +2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5912' +2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0634' +2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40598 to 41307' +2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6080' +2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0660' +2025-05-06 16:03:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41307 to 42030' +2025-05-06 16:03:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6046' +2025-05-06 16:03:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0669' +2025-05-06 16:03:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42030 to 42767' +2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6097' +2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0639' +2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42767 to 43520' +2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6099' +2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0664' +2025-05-06 16:03:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43520 to 44288' +2025-05-06 16:03:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6121' +2025-05-06 16:03:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' +2025-05-06 16:03:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 44288 to 45072' +2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6083' +2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0668' +2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45072 to 45876' +2025-05-06 16:03:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6105' +2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0667' +2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45876 to 46699' +2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6071' +2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0676' +2025-05-06 16:03:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46699 to 47543' +2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6083' +2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0592' +2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47543 to 48409' +2025-05-06 16:03:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5936' +2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0572' +2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48409 to 49300' +2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5952' +2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0587' +2025-05-06 16:03:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49300 to 50217' +2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5958' +2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0583' +2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50217 to 51166' +2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5973' +2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0585' +2025-05-06 16:03:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51166 to 52151' +2025-05-06 16:03:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5943' +2025-05-06 16:03:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0585' +2025-05-06 16:03:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52151 to 53173' +2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5986' +2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0602' +2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53173 to 54240' +2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6004' +2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0680' +2025-05-06 16:03:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 54240 to 55361' +2025-05-06 16:03:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5999' +2025-05-06 16:03:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0678' +2025-05-06 16:03:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55361 to 56549' +2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6009' +2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0674' +2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56549 to 57820' +2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6029' +2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0598' +2025-05-06 16:03:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 57820 to 59203' +2025-05-06 16:03:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6055' +2025-05-06 16:03:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0572' +2025-05-06 16:03:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59203 to 60751' +2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6083' +2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0605' +2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 60751 to 62628' +2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.6092' +2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0568' +2025-05-06 16:03:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 62628 to 65536' +2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.5984' +2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0461' +2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 87.2736' +2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 759694 48217857 41509540 41456316 48214387 57687 55289 45627 61938' +2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 180378335' +2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 179398100' +2025-05-06 16:03:57 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 759694' +2025-05-06 16:03:57 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0638' +2025-05-06 16:03:57 - b'INFO utils/utils.h : 152 - Real: 89.1820\tuser: 211.3668\tsys: 2.4769\tmaxrss: 147804' +2025-05-06 16:03:57 - Assemble contigs from SdBG for k = 29 +2025-05-06 16:03:57 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble +2025-05-06 16:04:00 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k29/29Done. Time elapsed: 2.494064' +2025-05-06 16:04:00 - b'INFO main_assemble.cpp : 133 - Number of Edges: 180378335; K value: 29' +2025-05-06 16:04:00 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:04:02 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 2988; time elapsed: 0.1919' +2025-05-06 16:04:03 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 8226; time elapsed: 0.3312' +2025-05-06 16:04:03 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 13554; time elapsed: 0.6646' +2025-05-06 16:04:05 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 20788; time elapsed: 1.5277' +2025-05-06 16:04:08 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 59237; time elapsed: 3.1862' +2025-05-06 16:04:13 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 58; Accumulated tips removed: 268180; time elapsed: 4.9964' +2025-05-06 16:04:13 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 13.184' +2025-05-06 16:04:29 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 533340, palindrome: 203' +2025-05-06 16:04:29 - b'INFO main_assemble.cpp : 166 - unitig graph size: 533474, time for building: 16.049' +2025-05-06 16:04:30 - b'INFO assembly/contig_stat.h : 40 - Max: 63463, Min: 30, N50: 314, number contigs: 533474, number isolated: 238899, number looped: 134, total size: 99670888,' +2025-05-06 16:04:30 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:04:30 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 21416, Time elapsed(sec): 0.437' +2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 7810, Time elapsed(sec): 0.455845' +2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 46016, time: 0.127' +2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 7983, time: 0.070' +2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:04:31 - b'INFO main_assemble.cpp : 192 - Tips removed: 16837, time: 0.277' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 279, Time elapsed(sec): 0.094' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 712, Time elapsed(sec): 0.192138' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 589, time: 0.084' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 150, time: 0.051' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 192 - Tips removed: 202, time: 0.253' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.084' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 10, Time elapsed(sec): 0.165256' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 23, time: 0.083' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 6, time: 0.049' +2025-05-06 16:04:32 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 3, time: 0.231' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.081' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.160315' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 8, time: 0.083' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 2, time: 0.050' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 1, time: 0.238' +2025-05-06 16:04:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.081' +2025-05-06 16:04:34 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.160943' +2025-05-06 16:04:34 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 5, time: 0.083' +2025-05-06 16:04:34 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.006' +2025-05-06 16:04:34 - b'INFO assembly/contig_stat.h : 40 - Max: 75508, Min: 30, N50: 433, number contigs: 379330, number isolated: 250939, number looped: 129, total size: 93879869,' +2025-05-06 16:04:40 - b'INFO main_assemble.cpp : 267 - Time to output: 5.926184' +2025-05-06 16:04:42 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 4827, complex bubbles removed: 184, time: 2.058557' +2025-05-06 16:04:43 - b'INFO assembly/contig_stat.h : 40 - Max: 95964, Min: 30, N50: 446, number contigs: 367513, number isolated: 251751, number looped: 131, total size: 93387611,' +2025-05-06 16:04:49 - b'INFO utils/utils.h : 152 - Real: 51.5173\tuser: 437.4020\tsys: 1.7851\tmaxrss: 409628' +2025-05-06 16:04:49 - Local assembly for k = 29 +2025-05-06 16:04:49 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.local.fa --kmax 39 +2025-05-06 16:05:07 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 87432, index size: 7485042' +2025-05-06 16:05:07 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 17.622944' +2025-05-06 16:05:07 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:05:07 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:05:07 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.709316' +2025-05-06 16:05:08 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 183.00 sd: 123.09' +2025-05-06 16:05:08 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.697406' +2025-05-06 16:05:18 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10303999, added 1005321 reads to local assembly' +2025-05-06 16:05:18 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.747103' +2025-05-06 16:05:18 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:05:30 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 12.398428' +2025-05-06 16:05:30 - b'INFO utils/utils.h : 152 - Real: 41.2621\tuser: 308.0859\tsys: 3.1803\tmaxrss: 822376' +2025-05-06 16:05:30 - Extract iterative edges from k = 29 to 39 +2025-05-06 16:05:30 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.bubble_seq.fa -t 10 -k 29 -s 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:05:30 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 8' +2025-05-06 16:05:30 - b'INFO main_iterate.cpp : 174 - Read 128391 contigs' +2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 255163' +2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 174 - Read 48695 contigs' +2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 333160' +2025-05-06 16:05:31 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 12' +2025-05-06 16:05:33 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 344732. Iterative edges: 1075926' +2025-05-06 16:05:35 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 691077. Iterative edges: 1321601' +2025-05-06 16:05:37 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 1038075. Iterative edges: 1426815' +2025-05-06 16:05:37 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 1085576. Iterative edges: 1436769' +2025-05-06 16:05:37 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 1085576. Iterative edges: 1436769' +2025-05-06 16:05:37 - b'INFO utils/utils.h : 152 - Real: 7.1443\tuser: 46.7362\tsys: 0.8244\tmaxrss: 350532' +2025-05-06 16:05:37 - Build graph for k = 39 +2025-05-06 16:05:37 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 --num_cpu_threads 10 -k 39 --kmer_from 29 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.bubble_seq.fa +2025-05-06 16:05:37 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 1436769' +2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 103800659, number contigs: 514262, number multiplicity: 1951031' +2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 30064272, multiplicity vector: 1951031' +2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 1436769 edges.' +2025-05-06 16:05:37 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 30064272/1436769/57470760, multiplicity vector: 1436769/1951031' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 366871 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.contigs.fa.' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 56014440/1803640/150918758, multiplicity vector: 1803640/1951031' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 42601 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.bubble_seq.fa.' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 56014440/1846241/157492011, multiplicity vector: 1846241/1951031' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 4550 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.addi.fa.' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 56014440/1850791/160761635, multiplicity vector: 1850791/1951031' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 81640 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k29.local.fa.' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 56014440/1932431/194978118, multiplicity vector: 1932431/1951031' +2025-05-06 16:05:38 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 56014440/1932431/194978118, multiplicity vector: 1932431/1951031' +2025-05-06 16:05:38 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.5683' +2025-05-06 16:05:38 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 69673350 bytes' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 5182018, Lv2 items: 107388' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 61439798, Memory for Lv1+Lv2: 22446280' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.6075' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 265' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3543' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0870' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 265 to 666' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3809' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1134' +2025-05-06 16:05:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 666 to 1131' +2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3506' +2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0997' +2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1131 to 1647' +2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3516' +2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1024' +2025-05-06 16:05:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1647 to 2209' +2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3513' +2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1029' +2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2209 to 2815' +2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3539' +2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1031' +2025-05-06 16:05:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2815 to 3462' +2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3534' +2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1053' +2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3462 to 4145' +2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3623' +2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1112' +2025-05-06 16:05:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4145 to 4861' +2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3578' +2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1075' +2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4861 to 5611' +2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3641' +2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1080' +2025-05-06 16:05:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5611 to 6392' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3618' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1273' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6392 to 7203' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3584' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1085' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7203 to 8045' +2025-05-06 16:05:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3610' +2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1078' +2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8045 to 8918' +2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3591' +2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1083' +2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8918 to 9822' +2025-05-06 16:05:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3589' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1072' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9822 to 10757' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3601' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1091' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10757 to 11723' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3643' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1221' +2025-05-06 16:05:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11723 to 12722' +2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3645' +2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1100' +2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12722 to 13751' +2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3643' +2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1095' +2025-05-06 16:05:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13751 to 14812' +2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3634' +2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1098' +2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14812 to 15906' +2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3633' +2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1098' +2025-05-06 16:05:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15906 to 17033' +2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3671' +2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1090' +2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17033 to 18194' +2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3673' +2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1116' +2025-05-06 16:05:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18194 to 19392' +2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3666' +2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1175' +2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19392 to 20628' +2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3718' +2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1092' +2025-05-06 16:05:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20628 to 21904' +2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3695' +2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1133' +2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21904 to 23219' +2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3709' +2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1109' +2025-05-06 16:05:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23219 to 24575' +2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3733' +2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1114' +2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24575 to 25972' +2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3701' +2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1116' +2025-05-06 16:05:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25972 to 27414' +2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3719' +2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1106' +2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27414 to 28903' +2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3737' +2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1133' +2025-05-06 16:05:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28903 to 30442' +2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3730' +2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1108' +2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30442 to 32035' +2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3808' +2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1210' +2025-05-06 16:05:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32035 to 33688' +2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3774' +2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1123' +2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33688 to 35405' +2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3756' +2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1122' +2025-05-06 16:05:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35405 to 37192' +2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3754' +2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1113' +2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37192 to 39059' +2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3785' +2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1131' +2025-05-06 16:05:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39059 to 41017' +2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3795' +2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1114' +2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41017 to 43081' +2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3869' +2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1164' +2025-05-06 16:05:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43081 to 45266' +2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3797' +2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1117' +2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45266 to 47597' +2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3825' +2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1141' +2025-05-06 16:05:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47597 to 50107' +2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3845' +2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1143' +2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50107 to 52854' +2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3832' +2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1132' +2025-05-06 16:05:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52854 to 55946' +2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3825' +2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1132' +2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55946 to 59658' +2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3898' +2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1152' +2025-05-06 16:06:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 59658 to 65536' +2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3834' +2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1171' +2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 22.0939' +2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 571526 44110831 37702980 37654025 44120496 16770 18428 18526 16947' +2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 164230529' +2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 163588332' +2025-05-06 16:06:01 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 571526' +2025-05-06 16:06:01 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0632' +2025-05-06 16:06:01 - b'INFO utils/utils.h : 152 - Real: 23.3406\tuser: 93.1432\tsys: 2.3035\tmaxrss: 121828' +2025-05-06 16:06:01 - Assemble contigs from SdBG for k = 39 +2025-05-06 16:06:01 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble +2025-05-06 16:06:03 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k39/39Done. Time elapsed: 2.192497' +2025-05-06 16:06:03 - b'INFO main_assemble.cpp : 133 - Number of Edges: 164230529; K value: 39' +2025-05-06 16:06:03 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:06:05 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 960; time elapsed: 0.1631' +2025-05-06 16:06:06 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 2682; time elapsed: 0.2668' +2025-05-06 16:06:06 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 4991; time elapsed: 0.5161' +2025-05-06 16:06:07 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 7679; time elapsed: 1.1512' +2025-05-06 16:06:10 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 18901; time elapsed: 2.3666' +2025-05-06 16:06:14 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 265868; time elapsed: 3.9327' +2025-05-06 16:06:17 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 78; Accumulated tips removed: 312203; time elapsed: 3.2628' +2025-05-06 16:06:17 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 13.901' +2025-05-06 16:06:30 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 219334, palindrome: 68' +2025-05-06 16:06:30 - b'INFO main_assemble.cpp : 166 - unitig graph size: 219475, time for building: 13.091' +2025-05-06 16:06:30 - b'INFO assembly/contig_stat.h : 40 - Max: 86032, Min: 40, N50: 860, number contigs: 219475, number isolated: 128393, number looped: 141, total size: 81397212,' +2025-05-06 16:06:30 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:06:30 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 7448, Time elapsed(sec): 0.176' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 4359, Time elapsed(sec): 0.288947' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 5391, time: 0.039' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1223, time: 0.026' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 192 - Tips removed: 2242, time: 0.130' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 53, Time elapsed(sec): 0.041' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 154, Time elapsed(sec): 0.102604' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 120, time: 0.033' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 36, time: 0.019' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 192 - Tips removed: 44, time: 0.121' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.032' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1, Time elapsed(sec): 0.080429' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 15, time: 0.036' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 5, time: 0.019' +2025-05-06 16:06:31 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.117' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.031' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.079786' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 3, time: 0.036' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.002' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.124' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.038' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.083874' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.036' +2025-05-06 16:06:32 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.002' +2025-05-06 16:06:32 - b'INFO assembly/contig_stat.h : 40 - Max: 86032, Min: 40, N50: 1134, number contigs: 173698, number isolated: 131632, number looped: 81, total size: 78917666,' +2025-05-06 16:06:38 - b'INFO main_assemble.cpp : 267 - Time to output: 5.657897' +2025-05-06 16:06:39 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 1521, complex bubbles removed: 80, time: 0.833683' +2025-05-06 16:06:39 - b'INFO assembly/contig_stat.h : 40 - Max: 95964, Min: 40, N50: 1162, number contigs: 169831, number isolated: 132031, number looped: 82, total size: 78708013,' +2025-05-06 16:06:45 - b'INFO utils/utils.h : 152 - Real: 43.7543\tuser: 355.1417\tsys: 1.3203\tmaxrss: 375628' +2025-05-06 16:06:45 - Local assembly for k = 39 +2025-05-06 16:06:45 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.local.fa --kmax 59 +2025-05-06 16:06:54 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 76139, index size: 7873666' +2025-05-06 16:06:54 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 9.163731' +2025-05-06 16:06:54 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:06:55 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:06:55 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.760834' +2025-05-06 16:06:56 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 188.00 sd: 126.72' +2025-05-06 16:06:56 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 1.376784' +2025-05-06 16:07:08 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10981391, added 710416 reads to local assembly' +2025-05-06 16:07:08 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 12.512106' +2025-05-06 16:07:08 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:07:22 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 13.106024' +2025-05-06 16:07:22 - b'INFO utils/utils.h : 152 - Real: 36.9918\tuser: 267.0140\tsys: 3.0394\tmaxrss: 808748' +2025-05-06 16:07:22 - Extract iterative edges from k = 39 to 59 +2025-05-06 16:07:22 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.bubble_seq.fa -t 10 -k 39 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 12' +2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 174 - Read 42066 contigs' +2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 83602' +2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 174 - Read 11202 contigs' +2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 101057' +2025-05-06 16:07:22 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 16' +2025-05-06 16:07:24 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 106356. Iterative edges: 531642' +2025-05-06 16:07:26 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 212400. Iterative edges: 679690' +2025-05-06 16:07:28 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 319159. Iterative edges: 749629' +2025-05-06 16:07:28 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 333768. Iterative edges: 756029' +2025-05-06 16:07:28 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 333768. Iterative edges: 756029' +2025-05-06 16:07:28 - b'INFO utils/utils.h : 152 - Real: 6.4318\tuser: 45.8938\tsys: 0.6275\tmaxrss: 328584' +2025-05-06 16:07:28 - Build graph for k = 59 +2025-05-06 16:07:28 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 --num_cpu_threads 10 -k 59 --kmer_from 39 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.bubble_seq.fa +2025-05-06 16:07:28 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 756029' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 72896007, number contigs: 240305, number multiplicity: 996334' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 20146452, multiplicity vector: 996334' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 756029 edges.' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 20146452/756029/45361740, multiplicity vector: 756029/996334' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 168136 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.contigs.fa.' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 38370456/924165/123978954, multiplicity vector: 924165/996334' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 9637 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.bubble_seq.fa.' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 38370456/933802/126923629, multiplicity vector: 933802/996334' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 1461 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.addi.fa.' +2025-05-06 16:07:28 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 38370456/935263/128831559, multiplicity vector: 935263/996334' +2025-05-06 16:07:29 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 53916 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k39.local.fa.' +2025-05-06 16:07:29 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 74818464/989179/151146934, multiplicity vector: 989179/996334' +2025-05-06 16:07:29 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 74818464/989179/151146934, multiplicity vector: 989179/996334' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.4105' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 84413552 bytes' +2025-05-06 16:07:29 - b'WARN sorting/base_engine.cpp : 83 - Memory available in less than memory required (83886080 < 84413552), still trying to perform sorting' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 1486489, Lv2 items: 23780' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 77991996, Memory for Lv1+Lv2: 6421556' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.4307' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 26' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2574' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0189' +2025-05-06 16:07:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26 to 81' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2550' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0224' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 81 to 156' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2622' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0268' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 156 to 243' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0247' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 243 to 342' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2624' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0264' +2025-05-06 16:07:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 342 to 451' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2588' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0260' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 451 to 569' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0284' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 569 to 695' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2581' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0277' +2025-05-06 16:07:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 695 to 826' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2590' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0288' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 826 to 963' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2604' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0281' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 963 to 1106' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0283' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1106 to 1254' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2606' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0285' +2025-05-06 16:07:32 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1254 to 1409' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2619' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0296' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1409 to 1569' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2600' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0296' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1569 to 1734' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2619' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0342' +2025-05-06 16:07:33 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1734 to 1904' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2575' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1904 to 2079' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2594' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0301' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2079 to 2260' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2530' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0291' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2260 to 2446' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2589' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' +2025-05-06 16:07:34 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2446 to 2637' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2571' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0313' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2637 to 2833' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2587' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0307' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2833 to 3033' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2695' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0323' +2025-05-06 16:07:35 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3033 to 3238' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2955' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0319' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3238 to 3448' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2853' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0309' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3448 to 3662' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2917' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' +2025-05-06 16:07:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3662 to 3880' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2897' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0341' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3880 to 4102' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2805' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0348' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4102 to 4328' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2726' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0347' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4328 to 4558' +2025-05-06 16:07:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2607' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0345' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4558 to 4792' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2628' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0347' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4792 to 5030' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2777' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0295' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5030 to 5272' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2658' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0289' +2025-05-06 16:07:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5272 to 5518' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2601' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0280' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5518 to 5768' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2608' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0278' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5768 to 6022' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2626' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0290' +2025-05-06 16:07:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6022 to 6279' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3024' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0281' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6279 to 6540' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3043' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0305' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6540 to 6805' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2964' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0309' +2025-05-06 16:07:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6805 to 7074' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2955' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0326' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7074 to 7347' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.3038' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0337' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7347 to 7624' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2649' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0307' +2025-05-06 16:07:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7624 to 7905' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2797' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0290' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 7905 to 8190' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2698' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8190 to 8478' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2781' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0290' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8478 to 8770' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2707' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0285' +2025-05-06 16:07:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8770 to 9066' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2993' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0285' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9066 to 9366' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2682' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0294' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9366 to 9670' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2621' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' +2025-05-06 16:07:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9670 to 9977' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2629' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9977 to 10289' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2610' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0295' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10289 to 10605' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2883' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0316' +2025-05-06 16:07:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10605 to 10924' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2741' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0308' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 10924 to 11247' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2614' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0294' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11247 to 11574' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2600' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0287' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11574 to 11905' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2628' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' +2025-05-06 16:07:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 11905 to 12240' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2676' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12240 to 12579' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2622' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12579 to 12922' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' +2025-05-06 16:07:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12922 to 13269' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2587' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13269 to 13620' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2615' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0293' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13620 to 13976' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2618' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0299' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13976 to 14335' +2025-05-06 16:07:47 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2621' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14335 to 14699' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2604' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0294' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 14699 to 15067' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2609' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15067 to 15439' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2603' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' +2025-05-06 16:07:48 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15439 to 15815' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 15815 to 16195' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2630' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16195 to 16580' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2588' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0291' +2025-05-06 16:07:49 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16580 to 16969' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2595' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16969 to 17362' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0302' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17362 to 17760' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2612' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0301' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 17760 to 18163' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2598' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:50 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18163 to 18570' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2611' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18570 to 18982' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0302' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18982 to 19398' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2597' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0300' +2025-05-06 16:07:51 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19398 to 19820' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2623' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 19820 to 20247' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2615' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0309' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20247 to 20678' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2592' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0321' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 20678 to 21114' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2602' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0298' +2025-05-06 16:07:52 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21114 to 21556' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2611' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21556 to 22003' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2597' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0303' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22003 to 22455' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0302' +2025-05-06 16:07:53 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22455 to 22912' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2613' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0349' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 22912 to 23375' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0343' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23375 to 23843' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2621' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0354' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 23843 to 24317' +2025-05-06 16:07:54 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2604' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0355' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24317 to 24796' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2661' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0350' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24796 to 25280' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2617' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0363' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25280 to 25770' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2679' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0341' +2025-05-06 16:07:55 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 25770 to 26265' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2622' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0312' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26265 to 26766' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2565' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0311' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26766 to 27273' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2555' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' +2025-05-06 16:07:56 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27273 to 27786' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2556' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 27786 to 28305' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2554' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28305 to 28830' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2535' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0312' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 28830 to 29361' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2560' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0317' +2025-05-06 16:07:57 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29361 to 29899' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2576' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0314' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 29899 to 30444' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2562' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0305' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30444 to 30996' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2564' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0314' +2025-05-06 16:07:58 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30996 to 31556' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2574' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0317' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31556 to 32123' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2578' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0311' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32123 to 32698' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2527' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 32698 to 33281' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2562' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0306' +2025-05-06 16:07:59 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33281 to 33872' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2548' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0313' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 33872 to 34472' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2578' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0315' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 34472 to 35081' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2563' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0308' +2025-05-06 16:08:00 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35081 to 35699' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2547' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35699 to 36326' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2547' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0314' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36326 to 36962' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2583' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 36962 to 37608' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2563' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0324' +2025-05-06 16:08:01 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 37608 to 38266' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2550' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38266 to 38935' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2584' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38935 to 39616' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2582' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0316' +2025-05-06 16:08:02 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39616 to 40309' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2548' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0315' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 40309 to 41016' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2573' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41016 to 41738' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2549' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0317' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 41738 to 42475' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2586' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0318' +2025-05-06 16:08:03 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 42475 to 43227' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2561' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0321' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43227 to 43995' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2553' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0321' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 43995 to 44780' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2571' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0325' +2025-05-06 16:08:04 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 44780 to 45583' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2570' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0316' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45583 to 46407' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2582' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0328' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 46407 to 47251' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2575' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0320' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47251 to 48119' +2025-05-06 16:08:05 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2563' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0325' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48119 to 49011' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2583' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0328' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49011 to 49931' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2599' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0358' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49931 to 50882' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2731' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0332' +2025-05-06 16:08:06 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 50882 to 51868' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2651' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0346' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 51868 to 52895' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2591' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 52895 to 53965' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2564' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' +2025-05-06 16:08:07 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 53965 to 55088' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2567' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0328' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55088 to 56281' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2631' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0342' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 56281 to 57557' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2602' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0329' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 57557 to 58941' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2583' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0327' +2025-05-06 16:08:08 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 58941 to 60483' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2612' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0337' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 60483 to 62328' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2650' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0340' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 62328 to 65536' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2609' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.0310' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 40.3727' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 295111 38189263 32322028 32289518 38204929 7507 6845 5789 8094' +2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 141329084' +2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 141005738' +2025-05-06 16:08:09 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 295111' +2025-05-06 16:08:09 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0577' +2025-05-06 16:08:09 - b'INFO utils/utils.h : 152 - Real: 41.2772\tuser: 127.7826\tsys: 1.5443\tmaxrss: 90848' +2025-05-06 16:08:09 - Assemble contigs from SdBG for k = 59 +2025-05-06 16:08:09 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble +2025-05-06 16:08:11 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k59/59Done. Time elapsed: 1.939633' +2025-05-06 16:08:11 - b'INFO main_assemble.cpp : 133 - Number of Edges: 141329084; K value: 59' +2025-05-06 16:08:11 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:08:13 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 726; time elapsed: 0.1143' +2025-05-06 16:08:14 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 1808; time elapsed: 0.1918' +2025-05-06 16:08:14 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 3926; time elapsed: 0.3170' +2025-05-06 16:08:15 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 7510; time elapsed: 0.6805' +2025-05-06 16:08:16 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 11250; time elapsed: 1.3694' +2025-05-06 16:08:19 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 34982; time elapsed: 2.6588' +2025-05-06 16:08:22 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 118; Accumulated tips removed: 153685; time elapsed: 3.1563' +2025-05-06 16:08:22 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 10.293' +2025-05-06 16:08:32 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 102654, palindrome: 13' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 166 - unitig graph size: 102742, time for building: 10.984' +2025-05-06 16:08:33 - b'INFO assembly/contig_stat.h : 40 - Max: 94498, Min: 60, N50: 2016, number contigs: 102742, number isolated: 72156, number looped: 88, total size: 70480343,' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 1424, Time elapsed(sec): 0.088' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1292, Time elapsed(sec): 0.153342' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 3384, time: 0.018' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 777, time: 0.013' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 799, time: 0.058' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 13, Time elapsed(sec): 0.022' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 74, Time elapsed(sec): 0.054730' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 148, time: 0.015' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 50, time: 0.009' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 192 - Tips removed: 49, time: 0.050' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.013' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1, Time elapsed(sec): 0.038041' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 18, time: 0.017' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 4, time: 0.008' +2025-05-06 16:08:33 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 192 - Tips removed: 4, time: 0.047' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.013' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.036741' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.014' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.009' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.045' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.013' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.040069' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.014' +2025-05-06 16:08:34 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.001' +2025-05-06 16:08:34 - b'INFO assembly/contig_stat.h : 40 - Max: 130201, Min: 60, N50: 2362, number contigs: 88444, number isolated: 73356, number looped: 91, total size: 69364315,' +2025-05-06 16:08:39 - b'INFO main_assemble.cpp : 267 - Time to output: 4.549319' +2025-05-06 16:08:39 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 805, complex bubbles removed: 25, time: 0.228630' +2025-05-06 16:08:39 - b'INFO assembly/contig_stat.h : 40 - Max: 130201, Min: 60, N50: 2393, number contigs: 86507, number isolated: 73658, number looped: 91, total size: 69210710,' +2025-05-06 16:08:44 - b'INFO utils/utils.h : 152 - Real: 34.0912\tuser: 272.8803\tsys: 0.9958\tmaxrss: 324248' +2025-05-06 16:08:44 - Local assembly for k = 59 +2025-05-06 16:08:44 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.local.fa --kmax 79 +2025-05-06 16:08:59 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 69562, index size: 8019088' +2025-05-06 16:08:59 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 15.404690' +2025-05-06 16:08:59 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:09:00 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:09:00 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.707533' +2025-05-06 16:09:00 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 190.00 sd: 128.68' +2025-05-06 16:09:00 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.632208' +2025-05-06 16:09:10 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 11205948, added 486448 reads to local assembly' +2025-05-06 16:09:10 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.997708' +2025-05-06 16:09:10 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:09:21 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 10.888542' +2025-05-06 16:09:21 - b'INFO utils/utils.h : 152 - Real: 37.7081\tuser: 272.1432\tsys: 1.6522\tmaxrss: 800120' +2025-05-06 16:09:21 - Extract iterative edges from k = 59 to 79 +2025-05-06 16:09:21 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.bubble_seq.fa -t 10 -k 59 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:09:21 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 16' +2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 174 - Read 15088 contigs' +2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 30026' +2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 174 - Read 2344 contigs' +2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 33815' +2025-05-06 16:09:22 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 20' +2025-05-06 16:09:23 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 24415. Iterative edges: 118804' +2025-05-06 16:09:23 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 48844. Iterative edges: 163065' +2025-05-06 16:09:24 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 73127. Iterative edges: 186588' +2025-05-06 16:09:24 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 76414. Iterative edges: 188756' +2025-05-06 16:09:24 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 76414. Iterative edges: 188756' +2025-05-06 16:09:24 - b'INFO utils/utils.h : 152 - Real: 2.5902\tuser: 18.9548\tsys: 0.4065\tmaxrss: 323236' +2025-05-06 16:09:24 - Build graph for k = 79 +2025-05-06 16:09:24 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 --num_cpu_threads 10 -k 79 --kmer_from 59 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.bubble_seq.fa +2025-05-06 16:09:24 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 188756' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 31394249, number contigs: 125461, number multiplicity: 314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 8852260, multiplicity vector: 314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 188756 edges.' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 8852260/188756/15100480, multiplicity vector: 188756/314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 86938 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.contigs.fa.' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 32397952/275694/84354802, multiplicity vector: 275694/314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 2158 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.bubble_seq.fa.' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 32397952/277852/85968971, multiplicity vector: 277852/314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 778 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.addi.fa.' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 32397952/278630/87598019, multiplicity vector: 278630/314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 33891 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k59.local.fa.' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 32397952/312521/101327828, multiplicity vector: 312521/314217' +2025-05-06 16:09:24 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 32397952/312521/101327828, multiplicity vector: 312521/314217' +2025-05-06 16:09:24 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2954' +2025-05-06 16:09:24 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 39134022 bytes' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 12113847, Lv2 items: 67194' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 33818034, Memory for Lv1+Lv2: 50068044' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.2977' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 1460' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2310' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1984' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1460 to 3681' +2025-05-06 16:09:25 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2531' +2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2128' +2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 3681 to 6385' +2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2639' +2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2095' +2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6385 to 9503' +2025-05-06 16:09:26 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2716' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2103' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 9503 to 13035' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2789' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2109' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13035 to 16990' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2822' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2185' +2025-05-06 16:09:27 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 16990 to 21401' +2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2872' +2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2197' +2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 21401 to 26327' +2025-05-06 16:09:28 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2887' +2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2583' +2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26327 to 31841' +2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2873' +2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2165' +2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31841 to 38118' +2025-05-06 16:09:29 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2889' +2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2248' +2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38118 to 45528' +2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2959' +2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2212' +2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 45528 to 55035' +2025-05-06 16:09:30 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2932' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2277' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 55035 to 65536' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.2296' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1400' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 6.3267' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 160234 34420688 28882691 28866054 34428757 3895 2662 3016 3477' +2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 126771474' +2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 126598190' +2025-05-06 16:09:31 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 160234' +2025-05-06 16:09:31 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0576' +2025-05-06 16:09:31 - b'INFO utils/utils.h : 152 - Real: 6.9835\tuser: 38.7237\tsys: 1.2927\tmaxrss: 119596' +2025-05-06 16:09:31 - Assemble contigs from SdBG for k = 79 +2025-05-06 16:09:31 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble +2025-05-06 16:09:33 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k79/79Done. Time elapsed: 1.718369' +2025-05-06 16:09:33 - b'INFO main_assemble.cpp : 133 - Number of Edges: 126771474; K value: 79' +2025-05-06 16:09:33 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 332; time elapsed: 0.0962' +2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 948; time elapsed: 0.1206' +2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 1964; time elapsed: 0.2011' +2025-05-06 16:09:35 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 3840; time elapsed: 0.3770' +2025-05-06 16:09:36 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 6356; time elapsed: 0.6926' +2025-05-06 16:09:37 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 9660; time elapsed: 1.3675' +2025-05-06 16:09:40 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 44124; time elapsed: 2.3939' +2025-05-06 16:09:42 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 158; Accumulated tips removed: 63812; time elapsed: 2.4291' +2025-05-06 16:09:42 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 9.290' +2025-05-06 16:09:52 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 62550, palindrome: 6' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 166 - unitig graph size: 62643, time for building: 9.738' +2025-05-06 16:09:52 - b'INFO assembly/contig_stat.h : 40 - Max: 165723, Min: 80, N50: 3260, number contigs: 62643, number isolated: 49149, number looped: 93, total size: 64789023,' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 427, Time elapsed(sec): 0.046' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 371, Time elapsed(sec): 0.172938' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1810, time: 0.011' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 418, time: 0.007' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 192 - Tips removed: 463, time: 0.039' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 3, Time elapsed(sec): 0.009' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 16, Time elapsed(sec): 0.051476' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 70, time: 0.010' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 13, time: 0.005' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 192 - Tips removed: 25, time: 0.035' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.008' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 1, Time elapsed(sec): 0.022605' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 9, time: 0.009' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 2, time: 0.005' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 192 - Tips removed: 4, time: 0.032' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.008' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.022206' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1, time: 0.009' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:09:52 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.031' +2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.008' +2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.021429' +2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1, time: 0.009' +2025-05-06 16:09:53 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:09:53 - b'INFO assembly/contig_stat.h : 40 - Max: 173318, Min: 80, N50: 3550, number contigs: 57028, number isolated: 49544, number looped: 36, total size: 64210124,' +2025-05-06 16:09:56 - b'INFO main_assemble.cpp : 267 - Time to output: 3.466998' +2025-05-06 16:09:56 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 412, complex bubbles removed: 8, time: 0.114352' +2025-05-06 16:09:56 - b'INFO assembly/contig_stat.h : 40 - Max: 173318, Min: 80, N50: 3587, number contigs: 56072, number isolated: 49726, number looped: 36, total size: 64108652,' +2025-05-06 16:10:00 - b'INFO utils/utils.h : 152 - Real: 28.8418\tuser: 242.0455\tsys: 1.3001\tmaxrss: 291428' +2025-05-06 16:10:00 - Local assembly for k = 79 +2025-05-06 16:10:00 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.local.fa --kmax 99 +2025-05-06 16:10:14 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 54644, index size: 7769107' +2025-05-06 16:10:14 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 14.023692' +2025-05-06 16:10:14 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:10:15 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:10:15 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.715935' +2025-05-06 16:10:16 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 191.00 sd: 129.86' +2025-05-06 16:10:16 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 1.103235' +2025-05-06 16:10:25 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 11037727, added 346196 reads to local assembly' +2025-05-06 16:10:25 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.531475' +2025-05-06 16:10:25 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:10:34 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 8.275738' +2025-05-06 16:10:34 - b'INFO utils/utils.h : 152 - Real: 33.7174\tuser: 242.0218\tsys: 1.5519\tmaxrss: 778468' +2025-05-06 16:10:34 - Extract iterative edges from k = 79 to 99 +2025-05-06 16:10:34 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.bubble_seq.fa -t 10 -k 79 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 20' +2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 174 - Read 7484 contigs' +2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 14870' +2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 174 - Read 705 contigs' +2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 16014' +2025-05-06 16:10:34 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 28' +2025-05-06 16:10:35 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 5564. Iterative edges: 8036' +2025-05-06 16:10:35 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 11005. Iterative edges: 13576' +2025-05-06 16:10:36 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 16577. Iterative edges: 17702' +2025-05-06 16:10:36 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 17330. Iterative edges: 18205' +2025-05-06 16:10:36 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 17330. Iterative edges: 18205' +2025-05-06 16:10:36 - b'INFO utils/utils.h : 152 - Real: 2.1713\tuser: 15.2928\tsys: 0.3914\tmaxrss: 319796' +2025-05-06 16:10:36 - Build graph for k = 99 +2025-05-06 16:10:36 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 --num_cpu_threads 10 -k 99 --kmer_from 79 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.bubble_seq.fa +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 18205' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 13182457, number contigs: 82028, number multiplicity: 100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 3951848, multiplicity vector: 100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 18205 edges.' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 3951848/18205/1820500, multiplicity vector: 18205/100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 56346 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.contigs.fa.' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 27021160/74551/65971284, multiplicity vector: 74551/100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 654 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.bubble_seq.fa.' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 27021160/75205/67122816, multiplicity vector: 75205/100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 386 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.addi.fa.' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 27021160/75591/68264046, multiplicity vector: 75591/100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 23904 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k79.local.fa.' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 27021160/99495/77998531, multiplicity vector: 99495/100233' +2025-05-06 16:10:36 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 27021160/99495/77998531, multiplicity vector: 99495/100233' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2502' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 32601562 bytes' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 13597671, Lv2 items: 59442' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 27831018, Memory for Lv1+Lv2: 56055060' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.1752' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:10:36 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 1975' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1293' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2073' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1975 to 5033' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1435' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2218' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 5033 to 8797' +2025-05-06 16:10:37 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1529' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2355' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8797 to 13222' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1578' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2285' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13222 to 18332' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1610' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2318' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18332 to 24210' +2025-05-06 16:10:38 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1651' +2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2323' +2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24210 to 30985' +2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1672' +2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2353' +2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 30985 to 38943' +2025-05-06 16:10:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1700' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2441' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 38943 to 48890' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1709' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2394' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 48890 to 65536' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1612' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2341' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 3.8941' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 107297 32200108 26879428 26866041 32210891 1672 1495 1526 1773' +2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 118270231' +2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 118156468' +2025-05-06 16:10:40 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 107297' +2025-05-06 16:10:40 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0594' +2025-05-06 16:10:40 - b'INFO utils/utils.h : 152 - Real: 4.3849\tuser: 32.4851\tsys: 1.1647\tmaxrss: 118224' +2025-05-06 16:10:40 - Assemble contigs from SdBG for k = 99 +2025-05-06 16:10:40 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len -1 --careful_bubble +2025-05-06 16:10:42 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k99/99Done. Time elapsed: 1.619685' +2025-05-06 16:10:42 - b'INFO main_assemble.cpp : 133 - Number of Edges: 118270231; K value: 99' +2025-05-06 16:10:42 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 264; time elapsed: 0.0838' +2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 1566; time elapsed: 0.0996' +2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 1938; time elapsed: 0.1483' +2025-05-06 16:10:44 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 2690; time elapsed: 0.2645' +2025-05-06 16:10:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 3922; time elapsed: 0.4764' +2025-05-06 16:10:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 5788; time elapsed: 0.9305' +2025-05-06 16:10:47 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 7269; time elapsed: 1.8029' +2025-05-06 16:10:50 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 198; Accumulated tips removed: 33877; time elapsed: 2.3510' +2025-05-06 16:10:50 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 7.659' +2025-05-06 16:10:59 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 43855, palindrome: 2' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 166 - unitig graph size: 43885, time for building: 9.038' +2025-05-06 16:10:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337872, Min: 100, N50: 4405, number contigs: 43885, number isolated: 37018, number looped: 30, total size: 61052170,' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 184, Time elapsed(sec): 0.027' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 156, Time elapsed(sec): 0.086933' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 984, time: 0.007' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 193, time: 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 199, time: 0.025' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 2, Time elapsed(sec): 0.010' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 2, Time elapsed(sec): 0.012787' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 30, time: 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 15, time: 0.004' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 6, time: 0.021' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012277' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 5, time: 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.003' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.020' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012133' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.019' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012113' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.005' +2025-05-06 16:10:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:10:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337934, Min: 100, N50: 4630, number contigs: 41258, number isolated: 37333, number looped: 34, total size: 60722196,' +2025-05-06 16:11:03 - b'INFO main_assemble.cpp : 267 - Time to output: 3.744675' +2025-05-06 16:11:03 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 215, complex bubbles removed: 7, time: 0.062233' +2025-05-06 16:11:03 - b'INFO assembly/contig_stat.h : 40 - Max: 337934, Min: 100, N50: 4675, number contigs: 40752, number isolated: 37431, number looped: 34, total size: 60654450,' +2025-05-06 16:11:07 - b'INFO utils/utils.h : 152 - Real: 26.4392\tuser: 214.5748\tsys: 0.8202\tmaxrss: 272912' +2025-05-06 16:11:07 - Local assembly for k = 99 +2025-05-06 16:11:07 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.local.fa --kmax 119 +2025-05-06 16:11:24 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 40227, index size: 7403870' +2025-05-06 16:11:24 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 16.969941' +2025-05-06 16:11:24 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:11:25 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:11:25 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.738825' +2025-05-06 16:11:26 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 192.00 sd: 130.73' +2025-05-06 16:11:26 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.873923' +2025-05-06 16:11:35 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10895260, added 253997 reads to local assembly' +2025-05-06 16:11:35 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 9.903153' +2025-05-06 16:11:35 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:11:41 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 6.011207' +2025-05-06 16:11:42 - b'INFO utils/utils.h : 152 - Real: 34.5659\tuser: 241.5755\tsys: 2.3682\tmaxrss: 757376' +2025-05-06 16:11:42 - Extract iterative edges from k = 99 to 119 +2025-05-06 16:11:42 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.bubble_seq.fa -t 10 -k 99 -s 20 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 28' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 174 - Read 3925 contigs' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 7825' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 174 - Read 279 contigs' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 8279' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 32' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 0. Iterative edges: 0' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 0. Iterative edges: 0' +2025-05-06 16:11:42 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 0. Iterative edges: 0' +2025-05-06 16:11:43 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 0. Iterative edges: 0' +2025-05-06 16:11:43 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 0. Iterative edges: 0' +2025-05-06 16:11:43 - b'INFO utils/utils.h : 152 - Real: 0.9760\tuser: 0.9500\tsys: 0.3598\tmaxrss: 318888' +2025-05-06 16:11:43 - Build graph for k = 119 +2025-05-06 16:11:43 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 --num_cpu_threads 10 -k 119 --kmer_from 99 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.bubble_seq.fa +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 0' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 8805574, number contigs: 60352, number multiplicity: 60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 2684220, multiplicity vector: 60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 0 edges.' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 2684220/0/0, multiplicity vector: 0/60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 41017 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.contigs.fa.' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 18093992/41017/60696350, multiplicity vector: 41017/60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 261 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.bubble_seq.fa.' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 18093992/41278/61087454, multiplicity vector: 41278/60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 204 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.addi.fa.' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 18093992/41482/61705027, multiplicity vector: 41482/60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 18611 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k99.local.fa.' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 18093992/60093/69341853, multiplicity vector: 60093/60352' +2025-05-06 16:11:43 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 18093992/60093/69341853, multiplicity vector: 60093/60352' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2170' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 23230176 bytes' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 15794714, Lv2 items: 54188' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 18756456, Memory for Lv1+Lv2: 65129624' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.1615' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 2685' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1248' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2639' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 2685 to 6936' +2025-05-06 16:11:43 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1405' +2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2699' +2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 6936 to 12277' +2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1528' +2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2739' +2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 12277 to 18726' +2025-05-06 16:11:44 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1532' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2777' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18726 to 26443' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1580' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2821' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 26443 to 35759' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1576' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2806' +2025-05-06 16:11:45 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 35759 to 47744' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1573' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2856' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 47744 to 65536' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1359' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2405' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 3.3586' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 78300 30643082 25492789 25481862 30651391 1029 945 812 1089' +2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 112351299' +2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 112269124' +2025-05-06 16:11:46 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 78300' +2025-05-06 16:11:46 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0595' +2025-05-06 16:11:46 - b'INFO utils/utils.h : 152 - Real: 3.8031\tuser: 29.5556\tsys: 1.0094\tmaxrss: 125664' +2025-05-06 16:11:46 - Assemble contigs from SdBG for k = 119 +2025-05-06 16:11:46 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len 182.0 --careful_bubble +2025-05-06 16:11:48 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k119/119Done. Time elapsed: 1.560949' +2025-05-06 16:11:48 - b'INFO main_assemble.cpp : 133 - Number of Edges: 112351299; K value: 119' +2025-05-06 16:11:48 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:11:49 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 40; time elapsed: 0.0742' +2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 140; time elapsed: 0.0857' +2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 324; time elapsed: 0.1220' +2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 600; time elapsed: 0.2086' +2025-05-06 16:11:50 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 1230; time elapsed: 0.3832' +2025-05-06 16:11:51 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 2214; time elapsed: 0.7215' +2025-05-06 16:11:52 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 3216; time elapsed: 1.4043' +2025-05-06 16:11:54 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 182; Accumulated tips removed: 4724; time elapsed: 1.9662' +2025-05-06 16:11:54 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 6.407' +2025-05-06 16:12:04 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 41164, palindrome: 1' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 166 - unitig graph size: 41196, time for building: 10.203' +2025-05-06 16:12:05 - b'INFO assembly/contig_stat.h : 40 - Max: 337892, Min: 120, N50: 4705, number contigs: 41196, number isolated: 36769, number looped: 32, total size: 60790472,' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 112, Time elapsed(sec): 0.050' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 95, Time elapsed(sec): 0.072621' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 635, time: 0.007' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 109, time: 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 107, time: 0.020' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 5, Time elapsed(sec): 0.022146' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 13, time: 0.006' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 6, time: 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 2, time: 0.017' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.011774' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 2, time: 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 3, time: 0.018' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012443' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 1, time: 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 5' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 192 - Tips removed: 1, time: 0.017' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.011982' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.004' +2025-05-06 16:12:05 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:12:05 - b'INFO assembly/contig_stat.h : 40 - Max: 337892, Min: 120, N50: 4853, number contigs: 39607, number isolated: 37026, number looped: 36, total size: 60552126,' +2025-05-06 16:12:09 - b'INFO main_assemble.cpp : 267 - Time to output: 4.032789' +2025-05-06 16:12:09 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 111, complex bubbles removed: 6, time: 0.050294' +2025-05-06 16:12:09 - b'INFO assembly/contig_stat.h : 40 - Max: 337892, Min: 120, N50: 4875, number contigs: 39336, number isolated: 37084, number looped: 36, total size: 60508994,' +2025-05-06 16:12:13 - b'INFO utils/utils.h : 152 - Real: 26.3436\tuser: 197.6748\tsys: 0.7800\tmaxrss: 259672' +2025-05-06 16:12:13 - Local assembly for k = 119 +2025-05-06 16:12:13 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core local -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa -l /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib -t 10 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.local.fa --kmax 141 +2025-05-06 16:12:20 - b'INFO localasm/hash_mapper.cpp : 99 - Number of contigs: 39177, index size: 7379320' +2025-05-06 16:12:20 - b'INFO localasm/local_assemble.cpp : 315 - Hash mapper construction time elapsed: 7.033600' +2025-05-06 16:12:20 - b'INFO sequence/io/sequence_lib.cpp : 115 - Before reading, sizeof seq_package: 408595800' +2025-05-06 16:12:21 - b'INFO sequence/io/sequence_lib.cpp : 117 - After reading, sizeof seq_package: 408595800' +2025-05-06 16:12:21 - b'INFO localasm/local_assemble.cpp : 324 - Read lib time elapsed: 0.705988' +2025-05-06 16:12:21 - b'INFO localasm/local_assemble.cpp : 133 - Lib 0, insert size: 193.00 sd: 130.73' +2025-05-06 16:12:21 - b'INFO localasm/local_assemble.cpp : 330 - Insert size estimation time elapsed: 0.664913' +2025-05-06 16:12:32 - b'INFO localasm/local_assemble.cpp : 218 - Lib 0: total 13163984 reads, aligned 10702004, added 230222 reads to local assembly' +2025-05-06 16:12:32 - b'INFO localasm/local_assemble.cpp : 338 - Mapping time elapsed: 10.833063' +2025-05-06 16:12:32 - b'INFO localasm/local_assemble.cpp : 232 - Minimum number of reads to do local assembly: 3' +2025-05-06 16:12:37 - b'INFO localasm/local_assemble.cpp : 346 - Local assembly time elapsed: 5.206776' +2025-05-06 16:12:37 - b'INFO utils/utils.h : 152 - Real: 24.5040\tuser: 175.4174\tsys: 1.5997\tmaxrss: 755072' +2025-05-06 16:12:37 - Extract iterative edges from k = 119 to 141 +2025-05-06 16:12:37 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core iterate -c /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa -b /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.bubble_seq.fa -t 10 -k 119 -s 22 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 -r /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/reads.lib.bin +2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 190 - Selected kmer type size for k: 32' +2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 174 - Read 2581 contigs' +2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 5145' +2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 174 - Read 207 contigs' +2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 176 - Number of flank kmers: 5470' +2025-05-06 16:12:37 - b'INFO main_iterate.cpp : 123 - Selected kmer type size for next k: 64' +2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 4194304, aligned: 0. Iterative edges: 0' +2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 8388608, aligned: 0. Iterative edges: 0' +2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 12582912, aligned: 0. Iterative edges: 0' +2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 138 - Processed: 13163984, aligned: 0. Iterative edges: 0' +2025-05-06 16:12:38 - b'INFO main_iterate.cpp : 142 - Total: 13163984, aligned: 0. Iterative edges: 0' +2025-05-06 16:12:38 - b'INFO utils/utils.h : 152 - Real: 0.9748\tuser: 0.9102\tsys: 0.3657\tmaxrss: 318172' +2025-05-06 16:12:38 - Build graph for k = 141 +2025-05-06 16:12:38 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core seq2sdbg --host_mem 83886080 --mem_flag 1 --output_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 --num_cpu_threads 10 -k 141 --kmer_from 119 --input_prefix /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 --addi_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.addi.fa --local_contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.local.fa --contig /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa --bubble /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.bubble_seq.fa +2025-05-06 16:12:38 - b'INFO sorting/base_engine.cpp : 148 - Preparing data...' +2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 369 - Number edges: 0' +2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 413 - Bases to reserve: 8083978, number contigs: 57216, number multiplicity: 57216' +2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 421 - Before reading, sizeof seq_package: 2478732, multiplicity vector: 57216' +2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 428 - Read 0 edges.' +2025-05-06 16:12:38 - b'INFO sorting/seq_to_sdbg.cpp : 429 - After reading, sizeof seq_package: 2478732/0/0, multiplicity vector: 0/57216' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 458 - Read 39474 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.contigs.fa.' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 459 - After reading contigs, sizeof seq_package: 16625704/39474/60535886, multiplicity vector: 39474/57216' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 470 - Read 191 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.bubble_seq.fa.' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 471 - After reading contigs, sizeof seq_package: 16625704/39665/60899977, multiplicity vector: 39665/57216' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 484 - Read 109 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.addi.fa.' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 485 - After reading contigs, sizeof seq_package: 16625704/39774/61325148, multiplicity vector: 39774/57216' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 498 - Read 17292 contigs from /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k119.local.fa.' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 499 - After reading contigs, sizeof seq_package: 32793672/57066/68291254, multiplicity vector: 57066/57216' +2025-05-06 16:12:39 - b'INFO sorting/seq_to_sdbg.cpp : 506 - Finally, sizeof seq_package: 32793672/57066/68291254, multiplicity vector: 57066/57216' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 153 - Preparing data... Done. Time elapsed: 0.2272' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 156 - Preparing partitions and calculating bucket sizes...' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 80 - Minimum memory required: 37833532 bytes' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 138 - Lv1 items: 12086136, Lv2 items: 52497' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 139 - Memory of derived class: 33441656, Memory for Lv1+Lv2: 50444424' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 165 - Preparing partitions and calculating bucket sizes... Done. Time elapsed: 0.1457' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 172 - Start main loop...' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 0 to 1934' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1003' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1889' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 1934 to 4998' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1117' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2075' +2025-05-06 16:12:39 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 4998 to 8786' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1190' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2161' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 8786 to 13255' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1241' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2113' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 13255 to 18435' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1245' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2202' +2025-05-06 16:12:40 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 18435 to 24413' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1273' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2171' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 24413 to 31332' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1311' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2231' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 31332 to 39509' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1317' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2216' +2025-05-06 16:12:41 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 39509 to 49860' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1322' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.2307' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 185 - Lv1 scanning from bucket 49860 to 65536' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 192 - Lv1 scanning done. Large diff: 0. Time elapsed: 0.1178' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 198 - Lv1 fetching & sorting done. Time elapsed: 0.1943' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 204 - Main loop done. Time elapsed: 3.3552' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 207 - Postprocessing...' +2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 793 - Number of $ A C G T A- C- G- T-:' +2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 794 - 76643 30154604 25063258 25051974 30163672 729 623 594 694' +2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 800 - Total number of edges: 110512791' +2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 801 - Total number of ONEs: 110433508' +2025-05-06 16:12:42 - b'INFO sorting/seq_to_sdbg.cpp : 802 - Total number of $v edges: 76643' +2025-05-06 16:12:42 - b'INFO sorting/base_engine.cpp : 210 - Postprocess done. Time elapsed: 0.0580' +2025-05-06 16:12:42 - b'INFO utils/utils.h : 152 - Real: 3.7918\tuser: 29.6734\tsys: 1.0666\tmaxrss: 110768' +2025-05-06 16:12:42 - Assemble contigs from SdBG for k = 141 +2025-05-06 16:12:42 - command /shared/ifbstor1/galaxy/mutable-data/dependencies/_conda/envs/__megahit@1.2.9/bin/megahit_core assemble -s /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141 -o /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/intermediate_contigs/k141 -t 10 --min_standalone 300 --prune_level 2 --merge_len 20 --merge_similar 0.95 --cleaning_rounds 5 --disconnect_ratio 0.1 --low_local_ratio 0.2 --cleaning_rounds 5 --min_depth 2.0 --bubble_level 2 --max_tip_len 160.0 --is_final_round +2025-05-06 16:12:44 - b'INFO main_assemble.cpp : 129 - Loading succinct de Bruijn graph: /shared/ifbstor1/galaxy/datasets2/jobs/006/033/6033018/working/megahit_out/tmp/k141/141Done. Time elapsed: 1.607066' +2025-05-06 16:12:44 - b'INFO main_assemble.cpp : 133 - Number of Edges: 110512791; K value: 141' +2025-05-06 16:12:44 - b'INFO main_assemble.cpp : 140 - Number of CPU threads: 10' +2025-05-06 16:12:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 2; Accumulated tips removed: 40; time elapsed: 0.0745' +2025-05-06 16:12:45 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 4; Accumulated tips removed: 112; time elapsed: 0.0816' +2025-05-06 16:12:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 8; Accumulated tips removed: 224; time elapsed: 0.1117' +2025-05-06 16:12:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 16; Accumulated tips removed: 446; time elapsed: 0.1967' +2025-05-06 16:12:46 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 32; Accumulated tips removed: 802; time elapsed: 0.3563' +2025-05-06 16:12:47 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 64; Accumulated tips removed: 1423; time elapsed: 0.6505' +2025-05-06 16:12:48 - b'INFO assembly/sdbg_pruning.cpp : 160 - Removing tips with length less than 128; Accumulated tips removed: 2241; time elapsed: 1.2810' +2025-05-06 16:12:50 - b'INFO assembly/sdbg_pruning.cpp : 169 - Removing tips with length less than 160; Accumulated tips removed: 2437; time elapsed: 1.5794' +2025-05-06 16:12:50 - b'INFO main_assemble.cpp : 158 - Tips removal done! Time elapsed(sec): 5.738' +2025-05-06 16:12:58 - b'INFO assembly/unitig_graph.cpp : 83 - Graph size without loops: 39996, palindrome: 0' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 166 - unitig graph size: 40027, time for building: 8.702' +2025-05-06 16:12:58 - b'INFO assembly/contig_stat.h : 40 - Max: 337914, Min: 142, N50: 4837, number contigs: 40027, number isolated: 37087, number looped: 31, total size: 60751709,' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 1' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 57, Time elapsed(sec): 0.009' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 49, Time elapsed(sec): 0.015997' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 431, time: 0.005' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 65, time: 0.004' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 2' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 192 - Tips removed: 43, time: 0.019' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 4, Time elapsed(sec): 0.013486' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 6, time: 0.004' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 1, time: 0.003' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 3' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 192 - Tips removed: 1, time: 0.016' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012188' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.004' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 184 - Graph cleaning round 4' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 192 - Tips removed: 0, time: 0.017' +2025-05-06 16:12:58 - b'INFO main_assemble.cpp : 200 - Number of bubbles removed: 0, Time elapsed(sec): 0.004' +2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 210 - Number of complex bubbles removed: 0, Time elapsed(sec): 0.012029' +2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 221 - Number unitigs disconnected: 0, time: 0.004' +2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 245 - Unitigs removed in excessive pruning: 0, time: 0.000' +2025-05-06 16:12:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337914, Min: 142, N50: 4954, number contigs: 39100, number isolated: 37344, number looped: 34, total size: 60592689,' +2025-05-06 16:12:59 - b'INFO main_assemble.cpp : 286 - Number of local low depth unitigs removed: 51, complex bubbles removed: 1, time: 0.029958' +2025-05-06 16:12:59 - b'INFO assembly/contig_stat.h : 40 - Max: 337914, Min: 142, N50: 4958, number contigs: 38987, number isolated: 37386, number looped: 34, total size: 60572523,' +2025-05-06 16:13:03 - b'INFO utils/utils.h : 152 - Real: 20.4959\tuser: 163.9754\tsys: 0.6401\tmaxrss: 255384' +2025-05-06 16:13:03 - Merging to output final contigs +2025-05-06 16:13:03 - 38818 contigs, total 60544618 bp, min 200 bp, max 337914 bp, avg 1559 bp, N50 4963 bp +2025-05-06 16:13:03 - ALL DONE. Time elapsed: 1041.009176 seconds