+ sudo -E -H -u github ./ya make --test-size=small --test-size=medium --test-size=large --test-type=unittest --test-type=clang_tidy --test-type=gtest --test-type=py3test --test-type=py2test --test-type=pytest --test-type=flake8 --test-type=black --test-type=py2_flake8 --test-type=go_test --test-type=gofmt --run-all-tests --keep-going --retest --test-threads 14 --link-threads 28 --cache-size 512G --do-not-output-stderrs -T --nice 0 --stat --output /home/github/tmp/out -DGITHUB_CI=yes --build relwithdebinfo --target=cloud/blockstore/ --bazel-remote-store --bazel-remote-base-uri http://195.242.10.243:9090 --bazel-remote-username bazel-remote-user --bazel-remote-password-file /tmp/tmp.bXaKo3d5F5 --junit /home/github/tmp/junit.xml.3 --log-file /home/github/tmp/logs/3/ya_log.txt --evlog-file /home/github/tmp/logs/3/ya_evlog.jsonl -X Configuring dependencies for platform default-linux-x86_64-relwithdebinfo Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-data-integrity/blockstore-tests-loadtest-local-data-integrity: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-encryption/cloud-blockstore-tests-loadtest-local-encryption: Requirement ram is redefined 30 -> 48 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement ram is redefined 30 -> 96 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement ram is redefined 30 -> 96 Configuring dependencies for platform tools Configuring dependencies for platform test_tool_tc1-global Configuring tests execution Configuring local and dist store caches Configuration done. Preparing for execution |21.1%| PREPARE $(GDB) |23.7%| PREPARE $(PYTHON) |26.3%| PREPARE $(TEST_TOOL_HOST-sbr:8580453620) |28.9%| PREPARE $(OS_SDK_ROOT-sbr:1966560555) |31.6%| PREPARE $(LLD_ROOT-3334042713) |34.2%| PREPARE $(FLAKE8_PY3-3680676150) |39.5%| PREPARE $(YMAKE_PYTHON3-1415908779) |44.7%| PREPARE $(CLANG-2185927622) |47.4%| COMPACTING CACHE 308.6GiB |50.0%| CLEANING SYMRES |52.6%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror |55.3%| [LD] {RESULT} $(B)/cloud/storage/core/tools/testing/unstable-process/storage-unstable-process |57.9%| [LD] {RESULT} $(B)/cloud/blockstore/apps/client/{blockstore-client ... liblibidn-dynamic.so} |60.5%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydb/{ydb ... libiconv.so} |63.2%| [LD] {RESULT} $(B)/cloud/blockstore/tools/testing/loadtest/bin/{blockstore-loadtest ... liblibaio-dynamic.so} |65.8%| [LD] {RESULT} $(B)/cloud/blockstore/apps/server/{nbsd ... liblibaio-dynamic.so} |68.4%| [LD] {RESULT} $(B)/cloud/blockstore/apps/disk_agent/{diskagentd ... liblibaio-dynamic.so} |73.7%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydbd/{ydbd ... liblibaio-dynamic.so} >> test.py::test_load[no-rdma-mirror3-resync] |76.3%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |78.9%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |81.6%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |84.2%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] |86.8%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |89.5%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] [FAIL] |92.1%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] [FAIL] >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] |94.7%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] |94.9%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |97.4%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |99.9%| CLEANING BUILD ROOT cloud/blockstore/tests/loadtest/local-mirror [size:large] nchunks:8 [tags: sb:cores=16, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:fat, ya:force_sandbox] ------ [0/8] chunk ran 1 test (total:180.49s - test:180.47s) [fail] test.py::test_load[no-rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (179.37s) cloud/blockstore/tests/loadtest/local-mirror/test.py:335: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:310: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 1. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/test.py.test_load.no-rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff ------ [1/8] chunk ran 1 test (total:178.78s - test:178.76s) [fail] test.py::test_load[rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (177.59s) cloud/blockstore/tests/loadtest/local-mirror/test.py:335: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:310: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 1. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/test.py.test_load.rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff ------ FAIL: 2 - FAIL cloud/blockstore/tests/loadtest/local-mirror Total 1 suite: 1 - FAIL Total 2 tests: 2 - FAIL Cache efficiency ratio is 99.97% (26264 of 26273). Local: 9 (0.03%), dist: 0 (0.00%), by dynamic uids: 0 (0.00%), avoided: 26255 (99.93%) Dist cache download: count=0, size=0 bytes, speed=0.0 bytes/s Disk usage for tools/sdk 1.25 GiB Additional disk space consumed for build cache 0 bytes Critical path: [180710 ms] [TL] [rnd-4001503312724089052 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 0 (1761689168346), finished: 180710 (1761689349056)] [ 193 ms] [TA] [rnd-efmtr6lkaqtztbbi]: $(BUILD_ROOT)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} [started: 180728 (1761689349074), finished: 180921 (1761689349267)] Time from start: 188378.2939453125 ms, time elapsed by graph 180903 ms, time diff 7475.2939453125 ms. The longest 10 tasks: [180710 ms] [TL] [rnd-4001503312724089052 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689168346, finished: 1761689349056] [179006 ms] [TL] [rnd-13299839088989689955 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689169610, finished: 1761689348616] [ 7457 ms] [ymake ThreadPoolExecutor-0_1 default-linux-x86_64-relwithdebinfo-pic] [started: 1761689155846539, finished: 1761689163303833] [ 7326 ms] [ymake ThreadPoolExecutor-0_0 default-linux-x86_64-relwithdebinfo-nopic] [started: 1761689155850530, finished: 1761689163177244] [ 1849 ms] [prepare:FromCache(u4YBYCgHXG_-EWLvq7Vliw$(BUILD_ROOT)/contrib/ydb/apps/ydbd/ydbd $(BUILD_ROOT)/contrib/ydb/apps/ydbd/libiconv.so $(BUILD_ROOT)/contrib/ydb/apps/ydbd/liblibidn-dynamic.so $(BUILD_ROOT)/contrib/ydb/apps/ydbd/liblibaio-dynamic.so)] local [started: 1761689166484, finished: 1761689168333] [ 1259 ms] [TL] [rnd-7933165670658338080 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689169494, finished: 1761689170753] [ 1257 ms] [TL] [rnd-3233042568997009945 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689168348, finished: 1761689169605] [ 1255 ms] [TL] [rnd-10913877448020727770 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689168350, finished: 1761689169605] [ 1249 ms] [TL] [rnd-11406386820414439265 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689169601, finished: 1761689170850] [ 1248 ms] [TL] [rnd-14335186766491848887 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761689168351, finished: 1761689169599] Total time by type: [367125 ms] [TL] [count: 8, ave time 45890.62 msec] [ 1926 ms] [prepare:get from local cache] [count: 9, ave time 214.00 msec] [ 289 ms] [prepare:clean] [count: 3, ave time 96.33 msec] [ 193 ms] [TA] [count: 1, ave time 193.00 msec] [ 85 ms] [prepare:tools] [count: 8, ave time 10.62 msec] [ 39 ms] [prepare:AC] [count: 2, ave time 19.50 msec] Total tasks times: Total failed tasks time - 0 ms (0.00%) Total tests tasks time - 367318 ms (100.00%) Total run tasks time - 367318 ms Configure time - 10.6 s Statistics overhead 640 ms Info: Dump junit report to /home/github/tmp/junit.xml.3 Failed + echo 10