+ sudo -E -H -u github ./ya make --test-size=small --test-size=medium --test-size=large --test-type=unittest --test-type=clang_tidy --test-type=gtest --test-type=py3test --test-type=py2test --test-type=pytest --test-type=flake8 --test-type=black --test-type=py2_flake8 --test-type=go_test --test-type=gofmt --run-all-tests --keep-going --retest --test-threads 14 --link-threads 28 --cache-size 512G --do-not-output-stderrs -T --nice 0 --stat --output /home/github/tmp/out -DGITHUB_CI=yes --build relwithdebinfo --target=cloud/blockstore/ --bazel-remote-store --bazel-remote-base-uri http://195.242.10.243:9090 --bazel-remote-username bazel-remote-user --bazel-remote-password-file /tmp/tmp.HvhwgN4x3h --junit /home/github/tmp/junit.xml.3 --log-file /home/github/tmp/logs/3/ya_log.txt --evlog-file /home/github/tmp/logs/3/ya_evlog.jsonl -X Configuring dependencies for platform default-linux-x86_64-relwithdebinfo Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-data-integrity/blockstore-tests-loadtest-local-data-integrity: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-encryption/cloud-blockstore-tests-loadtest-local-encryption: Requirement ram is redefined 30 -> 48 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement ram is redefined 30 -> 96 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement ram is redefined 30 -> 96 Configuring dependencies for platform tools Configuring dependencies for platform test_tool_tc1-global Configuring tests execution Configuring local and dist store caches Configuration done. Preparing for execution |16.0%| PREPARE $(OS_SDK_ROOT-sbr:1966560555) |18.0%| PREPARE $(TEST_TOOL_HOST-sbr:8580453620) |20.0%| PREPARE $(LLD_ROOT-3334042713) |22.0%| PREPARE $(FLAKE8_PY3-3680676150) |24.0%| PREPARE $(YMAKE_PYTHON3-1415908779) |28.0%| PREPARE $(CLANG-2185927622) |30.0%| PREPARE $(PYTHON) |34.0%| PREPARE $(GDB) |36.0%| COMPACTING CACHE 308.5GiB |40.0%| CLEANING SYMRES |42.0%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging |44.0%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror |46.0%| [LD] {RESULT} $(B)/cloud/storage/core/tools/testing/unstable-process/storage-unstable-process |48.0%| [LD] {RESULT} $(B)/cloud/blockstore/apps/client/{blockstore-client ... liblibidn-dynamic.so} |50.0%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydb/{ydb ... libiconv.so} |52.0%| [LD] {RESULT} $(B)/cloud/blockstore/apps/disk_agent/{diskagentd ... liblibaio-dynamic.so} |54.0%| [LD] {RESULT} $(B)/cloud/blockstore/tools/testing/loadtest/bin/{blockstore-loadtest ... liblibaio-dynamic.so} |56.0%| [LD] {RESULT} $(B)/cloud/blockstore/apps/server/{nbsd ... liblibaio-dynamic.so} |60.0%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydbd/{ydbd ... liblibaio-dynamic.so} >> test.py::test_load[mirror2-migration-rdma] >> test.py::test_load[rdma-mirror3-resync] |62.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |64.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |66.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[rdma-mirror2-split-read-cross] >> test.py::test_load[mirror2-fresh-device-migration-rdma] >> test.py::test_load[no-rdma-mirror3-resync] >> test.py::test_load[mirror2-migration-rdma] [FAIL] |68.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[mirror2-migration-rdma] [FAIL] >> test.py::test_load[mirror2-target-migration-lagging-rdma] >> test.py::test_load[mirror2-fresh-device-migration-rdma] [FAIL] |70.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[mirror2-fresh-device-migration-rdma] [FAIL] |72.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror2-split-read-cross] [FAIL] >> test.py::test_load[rdma-mirror2-split-read-column] |74.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror2-split-read-cross] [FAIL] |76.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |78.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |80.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |82.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |84.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] [FAIL] |86.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] [FAIL] >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] |88.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] >> test.py::test_load[mirror2-target-migration-lagging-rdma] [FAIL] |90.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[mirror2-target-migration-lagging-rdma] [FAIL] |92.0%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/{meta.json ... results_accumulator.log} |94.0%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/{meta.json ... results_accumulator.log} >> test.py::test_load[rdma-mirror2-split-read-column] [FAIL] |96.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror2-split-read-column] [FAIL] |96.1%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |98.0%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |99.9%| CLEANING BUILD ROOT cloud/blockstore/tests/loadtest/local-mirror [size:large] nchunks:8 [tags: sb:cores=16, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:fat, ya:force_sandbox] ------ [0/8] chunk ran 1 test (total:164.35s - test:164.33s) [fail] test.py::test_load[no-rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (163.11s) cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 3. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/test.py.test_load.no-rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff ------ [1/8] chunk ran 1 test (total:132.38s - test:132.36s) [fail] test.py::test_load[rdma-mirror2-split-read-column] [default-linux-x86_64-relwithdebinfo] (130.95s) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:318: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/test.py.test_load.rdma-mirror2-split-read-column.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.353877.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.353877.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.353877.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.353877.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.353877.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.353877.core.0 ------ [2/8] chunk ran 1 test (total:147.36s - test:147.34s) [fail] test.py::test_load[rdma-mirror2-split-read-cross] [default-linux-x86_64-relwithdebinfo] (145.81s) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:318: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/test.py.test_load.rdma-mirror2-split-read-cross.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.348920.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.348920.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.348920.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.348920.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.348920.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.348920.core.0 ------ [3/8] chunk ran 1 test (total:164.08s - test:164.06s) [fail] test.py::test_load[rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (162.87s) cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 3. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff/test.py.test_load.rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff ------ FAIL: 4 - FAIL cloud/blockstore/tests/loadtest/local-mirror cloud/blockstore/tests/loadtest/local-mirror-lagging [size:large] nchunks:8 [tags: sb:cores=16, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:fat, ya:force_sandbox] ------ [0/8] chunk ran 1 test (total:144.34s - test:144.32s) [fail] test.py::test_load[mirror2-fresh-device-migration-rdma] [default-linux-x86_64-relwithdebinfo] (142.95s) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:373: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:399: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:387: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/test.py.test_load.mirror2-fresh-device-migration-rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.349057.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.349057.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.349057.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.349057.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.349057.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.349057.core.0 ------ [1/8] chunk ran 1 test (total:140.04s - test:140.02s) [fail] test.py::test_load[mirror2-migration-rdma] [default-linux-x86_64-relwithdebinfo] (138.62s) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:373: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:399: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:387: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/test.py.test_load.mirror2-migration-rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.348306.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.348306.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.348306.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.348306.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.348306.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.348306.core.0 ------ [2/8] chunk ran 1 test (total:120.95s - test:120.93s) [fail] test.py::test_load[mirror2-target-migration-lagging-rdma] [default-linux-x86_64-relwithdebinfo] (119.46s) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:373: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:399: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:387: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/test.py.test_load.mirror2-target-migration-lagging-rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.353042.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.353042.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.353042.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.353042.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.353042.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.353042.core.0 ------ FAIL: 3 - FAIL cloud/blockstore/tests/loadtest/local-mirror-lagging Total 2 suites: 2 - FAIL Total 7 tests: 7 - FAIL Cache efficiency ratio is 99.93% (26278 of 26296). Local: 10 (0.04%), dist: 0 (0.00%), by dynamic uids: 0 (0.00%), avoided: 26268 (99.89%) Dist cache download: count=0, size=0 bytes, speed=0.0 bytes/s Disk usage for tools/sdk 1.25 GiB Additional disk space consumed for build cache 0 bytes Critical path: [164603 ms] [TL] [rnd-5969218493207096129 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 0 (1761604548211), finished: 164603 (1761604712814)] [ 274 ms] [TA] [rnd-bbjcd2kujwa1ibvq]: $(BUILD_ROOT)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} [started: 278946 (1761604827157), finished: 279220 (1761604827431)] Time from start: 287849.6279296875 ms, time elapsed by graph 164877 ms, time diff 122972.6279296875 ms. The longest 10 tasks: [164603 ms] [TL] [rnd-5969218493207096129 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761604548211, finished: 1761604712814] [164330 ms] [TL] [rnd-9597390550030981934 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761604546950, finished: 1761604711280] [147634 ms] [TL] [rnd-976445697100312456 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761604548110, finished: 1761604695744] [144611 ms] [TL] [rnd-15136136517646295258 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test [started: 1761604548194, finished: 1761604692805] [140312 ms] [TL] [rnd-4562188333043550316 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test [started: 1761604546950, finished: 1761604687262] [132674 ms] [TL] [rnd-16487994346037740076 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761604694455, finished: 1761604827129] [121228 ms] [TL] [rnd-10911773227448342125 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test [started: 1761604687265, finished: 1761604808493] [ 7361 ms] [ymake ThreadPoolExecutor-0_1 default-linux-x86_64-relwithdebinfo-pic] [started: 1761604534658045, finished: 1761604542019556] [ 7339 ms] [ymake ThreadPoolExecutor-0_0 default-linux-x86_64-relwithdebinfo-nopic] [started: 1761604534654928, finished: 1761604541994358] [ 1924 ms] [prepare:FromCache(u4YBYCgHXG_-EWLvq7Vliw$(BUILD_ROOT)/contrib/ydb/apps/ydbd/ydbd $(BUILD_ROOT)/contrib/ydb/apps/ydbd/libiconv.so $(BUILD_ROOT)/contrib/ydb/apps/ydbd/liblibidn-dynamic.so $(BUILD_ROOT)/contrib/ydb/apps/ydbd/liblibaio-dynamic.so)] local [started: 1761604545011, finished: 1761604546935] Total time by type: [1028528 ms] [TL] [count: 16, ave time 64283.00 msec] [ 2103 ms] [prepare:get from local cache] [count: 10, ave time 210.30 msec] [ 505 ms] [TA] [count: 2, ave time 252.50 msec] [ 316 ms] [prepare:clean] [count: 3, ave time 105.33 msec] [ 79 ms] [prepare:tools] [count: 8, ave time 9.88 msec] [ 72 ms] [prepare:AC] [count: 2, ave time 36.00 msec] Total tasks times: Total failed tasks time - 0 ms (0.00%) Total tests tasks time - 1029033 ms (100.00%) Total run tasks time - 1029033 ms Configure time - 10.3 s Statistics overhead 728 ms Info: Dump junit report to /home/github/tmp/junit.xml.3 Failed + echo 10