+ sudo -E -H -u github ./ya make --test-size=small --test-size=medium --test-size=large --test-type=unittest --test-type=clang_tidy --test-type=gtest --test-type=py3test --test-type=py2test --test-type=pytest --test-type=flake8 --test-type=black --test-type=py2_flake8 --test-type=go_test --test-type=gofmt --run-all-tests --keep-going --retest --test-threads 14 --link-threads 28 --cache-size 512G --do-not-output-stderrs -T --nice 0 --stat --output /home/github/tmp/out -DGITHUB_CI=yes --build relwithdebinfo --target=cloud/blockstore/ --bazel-remote-store --bazel-remote-base-uri http://195.242.10.243:9090 --bazel-remote-username bazel-remote-user --bazel-remote-password-file /tmp/tmp.xa9Xb8NCkC --junit /home/github/tmp/junit.xml.3 --log-file /home/github/tmp/logs/3/ya_log.txt --evlog-file /home/github/tmp/logs/3/ya_evlog.jsonl -X Configuring dependencies for platform default-linux-x86_64-relwithdebinfo Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-data-integrity/blockstore-tests-loadtest-local-data-integrity: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-encryption/cloud-blockstore-tests-loadtest-local-encryption: Requirement ram is redefined 30 -> 48 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement ram is redefined 30 -> 96 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement ram is redefined 30 -> 96 Configuring dependencies for platform tools Configuring dependencies for platform test_tool_tc1-global Configuring tests execution Configuring local and dist store caches Configuration done. Preparing for execution |23.7%| PREPARE $(PYTHON) |26.3%| PREPARE $(TEST_TOOL_HOST-sbr:8580453620) |28.9%| PREPARE $(GDB) |31.6%| PREPARE $(YMAKE_PYTHON3-1415908779) |34.2%| PREPARE $(CLANG-2185927622) |36.8%| PREPARE $(OS_SDK_ROOT-sbr:1966560555) |39.5%| PREPARE $(LLD_ROOT-3334042713) |42.1%| PREPARE $(FLAKE8_PY3-3680676150) |47.4%| COMPACTING CACHE 308.6GiB |50.0%| CLEANING SYMRES |52.6%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror |55.3%| [LD] {RESULT} $(B)/cloud/storage/core/tools/testing/unstable-process/storage-unstable-process |57.9%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydb/{ydb ... libiconv.so} |60.5%| [LD] {RESULT} $(B)/cloud/blockstore/apps/client/{blockstore-client ... liblibidn-dynamic.so} |63.2%| [LD] {RESULT} $(B)/cloud/blockstore/tools/testing/loadtest/bin/{blockstore-loadtest ... liblibaio-dynamic.so} |65.8%| [LD] {RESULT} $(B)/cloud/blockstore/apps/disk_agent/{diskagentd ... liblibaio-dynamic.so} |68.4%| [LD] {RESULT} $(B)/cloud/blockstore/apps/server/{nbsd ... liblibaio-dynamic.so} |73.7%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydbd/{ydbd ... liblibaio-dynamic.so} >> test.py::test_load[no-rdma-mirror3-resync] |76.3%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |78.9%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |81.6%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |84.2%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] |86.8%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |89.5%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] |92.1%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] >> test.py::test_load[rdma-mirror3-resync] [FAIL] |94.7%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] [FAIL] |94.9%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |97.4%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |99.9%| CLEANING BUILD ROOT cloud/blockstore/tests/loadtest/local-mirror [size:large] nchunks:8 [tags: sb:cores=16, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:fat, ya:force_sandbox] ------ [0/8] chunk ran 1 test (total:163.88s - test:163.86s) [fail] test.py::test_load[no-rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (162.68s) cloud/blockstore/tests/loadtest/local-mirror/test.py:332: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:307: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 3. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/test.py.test_load.no-rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff ------ [1/8] chunk ran 1 test (total:163.77s - test:163.75s) [fail] test.py::test_load[rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (162.68s) cloud/blockstore/tests/loadtest/local-mirror/test.py:332: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:307: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 3. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/test.py.test_load.rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff ------ FAIL: 2 - FAIL cloud/blockstore/tests/loadtest/local-mirror Total 1 suite: 1 - FAIL Total 2 tests: 2 - FAIL Cache efficiency ratio is 99.97% (26264 of 26273). Local: 9 (0.03%), dist: 0 (0.00%), by dynamic uids: 0 (0.00%), avoided: 26255 (99.93%) Dist cache download: count=0, size=0 bytes, speed=0.0 bytes/s Disk usage for tools/sdk 1.25 GiB Additional disk space consumed for build cache 0 bytes Critical path: [164102 ms] [TL] [rnd-18027623850430636142 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 0 (1761675114090), finished: 164102 (1761675278192)] [ 211 ms] [TA] [rnd-pdbshelt3hh72d20]: $(BUILD_ROOT)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} [started: 165182 (1761675279272), finished: 165393 (1761675279483)] Time from start: 172785.61596679688 ms, time elapsed by graph 164313 ms, time diff 8472.615966796875 ms. The longest 10 tasks: [164102 ms] [TL] [rnd-18027623850430636142 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675114090, finished: 1761675278192] [164011 ms] [TL] [rnd-1055212071735168697 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675115244, finished: 1761675279255] [ 7388 ms] [ymake ThreadPoolExecutor-0_1 default-linux-x86_64-relwithdebinfo-pic] [started: 1761675101622705, finished: 1761675109011321] [ 7360 ms] [ymake ThreadPoolExecutor-0_0 default-linux-x86_64-relwithdebinfo-nopic] [started: 1761675101625142, finished: 1761675108985353] [ 2044 ms] [prepare:FromCache(u4YBYCgHXG_-EWLvq7Vliw$(BUILD_ROOT)/contrib/ydb/apps/ydbd/ydbd $(BUILD_ROOT)/contrib/ydb/apps/ydbd/libiconv.so $(BUILD_ROOT)/contrib/ydb/apps/ydbd/liblibidn-dynamic.so $(BUILD_ROOT)/contrib/ydb/apps/ydbd/liblibaio-dynamic.so)] local [started: 1761675112031, finished: 1761675114075] [ 1266 ms] [TL] [rnd-10439605502414270483 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675115344, finished: 1761675116610] [ 1256 ms] [TL] [rnd-14583084510523127614 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675115243, finished: 1761675116499] [ 1253 ms] [TL] [rnd-6247243319912276471 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675114086, finished: 1761675115339] [ 1251 ms] [TL] [rnd-17797652952554586511 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675114092, finished: 1761675115343] [ 1150 ms] [TL] [rnd-14675635019443585149 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761675114088, finished: 1761675115238] Total time by type: [335438 ms] [TL] [count: 8, ave time 41929.75 msec] [ 2104 ms] [prepare:get from local cache] [count: 9, ave time 233.78 msec] [ 297 ms] [prepare:clean] [count: 2, ave time 148.50 msec] [ 211 ms] [TA] [count: 1, ave time 211.00 msec] [ 80 ms] [prepare:tools] [count: 8, ave time 10.00 msec] [ 37 ms] [prepare:AC] [count: 2, ave time 18.50 msec] Total tasks times: Total failed tasks time - 0 ms (0.00%) Total tests tasks time - 335649 ms (100.00%) Total run tasks time - 335649 ms Configure time - 10.3 s Statistics overhead 617 ms Info: Dump junit report to /home/github/tmp/junit.xml.3 Failed + echo 10