+ sudo -E -H -u github ./ya make --test-size=small --test-size=medium --test-size=large --test-type=unittest --test-type=clang_tidy --test-type=gtest --test-type=py3test --test-type=py2test --test-type=pytest --test-type=flake8 --test-type=black --test-type=py2_flake8 --test-type=go_test --test-type=gofmt --run-all-tests --keep-going --retest --test-threads 14 --link-threads 28 --cache-size 512G --do-not-output-stderrs -T --nice 0 --stat --output /home/github/tmp/out -DGITHUB_CI=yes --build relwithdebinfo --target=cloud/blockstore/ --bazel-remote-store --bazel-remote-base-uri http://195.242.10.243:9090 --bazel-remote-username bazel-remote-user --bazel-remote-password-file /tmp/tmp.HvhwgN4x3h --junit /home/github/tmp/junit.xml.2 --log-file /home/github/tmp/logs/2/ya_log.txt --evlog-file /home/github/tmp/logs/2/ya_evlog.jsonl -X Configuring dependencies for platform default-linux-x86_64-relwithdebinfo Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-data-integrity/blockstore-tests-loadtest-local-data-integrity: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-encryption/cloud-blockstore-tests-loadtest-local-encryption: Requirement ram is redefined 30 -> 48 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement ram is redefined 30 -> 96 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement ram is redefined 30 -> 96 Configuring dependencies for platform tools Configuring dependencies for platform test_tool_tc1-global Configuring tests execution Configuring local and dist store caches Configuration done. Preparing for execution |14.5%| PREPARE $(CLANG-2185927622) |16.1%| PREPARE $(TEST_TOOL_HOST-sbr:8580453620) |19.4%| PREPARE $(FLAKE8_PY3-3680676150) |21.0%| PREPARE $(PYTHON) |22.6%| PREPARE $(GDB) |24.2%| PREPARE $(YMAKE_PYTHON3-1415908779) |25.8%| COMPACTING CACHE 308.5GiB |27.4%| PREPARE $(LLD_ROOT-3334042713) |30.6%| PREPARE $(OS_SDK_ROOT-sbr:1966560555) |32.3%| CLEANING SYMRES |33.9%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging |35.5%| [LD] {RESULT} $(B)/cloud/storage/core/tools/testing/unstable-process/storage-unstable-process |37.1%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror |38.7%| [LD] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-encryption/cloud-blockstore-tests-loadtest-local-encryption |40.3%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydb/{ydb ... libiconv.so} |41.9%| [LD] {RESULT} $(B)/cloud/blockstore/apps/server/{nbsd ... liblibaio-dynamic.so} |43.5%| [LD] {RESULT} $(B)/cloud/blockstore/apps/disk_agent/{diskagentd ... liblibaio-dynamic.so} |45.2%| [LD] {RESULT} $(B)/cloud/blockstore/tools/testing/loadtest/bin/{blockstore-loadtest ... liblibaio-dynamic.so} |48.4%| [LD] {RESULT} $(B)/cloud/blockstore/apps/client/{blockstore-client ... liblibidn-dynamic.so} |51.6%| [LD] {RESULT} $(B)/contrib/ydb/apps/ydbd/{ydbd ... liblibaio-dynamic.so} >> test.py::test_load[rdma-mirror3-resync] >> test.py::test_load[mirror2-fresh-device-migration-rdma] >> test.py::test_load[local-encryption-overlay-endpoint_snapshot_1] >> test.py::test_load[mirror2-target-migration-lagging-rdma] |53.2%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |54.8%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[mirror2-migration-rdma] |56.5%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test |58.1%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[no-rdma-mirror3-resync] >> test.py::test_load[local-encryption-overlay-endpoint_snapshot_1] [GOOD] >> test.py::test_load[local-encryption-overlay-endpoint_snapshot_2] >> test.py::test_load[mirror2-target-migration-lagging-rdma] [FAIL] |59.7%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[mirror2-target-migration-lagging-rdma] [FAIL] >> test.py::test_load[mirror2-fresh-device-migration-rdma] [FAIL] |61.3%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[mirror2-fresh-device-migration-rdma] [FAIL] |62.9%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[rdma-mirror2-split-read-column] |64.5%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |66.1%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |67.7%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror2-split-read-cross] >> test.py::test_load[mirror2-migration-rdma] [FAIL] |69.4%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test >> test.py::test_load[mirror2-migration-rdma] [FAIL] |71.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror-lagging/py3test |72.6%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/{meta.json ... results_accumulator.log} |74.2%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/{meta.json ... results_accumulator.log} >> test.py::test_load[local-encryption-nonoverlay-endpoint_snapshot_1] >> test.py::test_load[local-encryption-nonoverlay_snapshot_1] >> test.py::test_load[rdma-mirror3-resync] [FAIL] |75.8%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror3-resync] [FAIL] >> test.py::test_load[local-encryption-overlay-endpoint_1] >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] |77.4%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[no-rdma-mirror3-resync] [FAIL] >> test.py::test_load[local-encryption-nonoverlay-endpoint_1] >> test.py::test_load[local-encryption-overlay_snapshot_1] >> test.py::test_load[local-encryption-overlay-endpoint_snapshot_2] [GOOD] |79.0%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-overlay-endpoint_snapshot_2] [GOOD] >> test.py::test_load[local-encryption-overlay_1] >> test.py::test_load[local-encryption-nonoverlay-endpoint_snapshot_1] [GOOD] >> test.py::test_load[local-encryption-nonoverlay-endpoint_snapshot_2] >> test.py::test_load[local-encryption-nonoverlay_snapshot_1] [GOOD] >> test.py::test_load[local-encryption-nonoverlay_snapshot_2] >> test.py::test_load[local-encryption-overlay_snapshot_1] [GOOD] >> test.py::test_load[local-encryption-overlay_snapshot_2] >> test.py::test_load[local-encryption-overlay-endpoint_1] [GOOD] >> test.py::test_load[local-encryption-overlay-endpoint_2] >> test.py::test_load[local-encryption-nonoverlay-endpoint_1] [GOOD] >> test.py::test_load[local-encryption-nonoverlay-endpoint_2] >> test.py::test_load[rdma-mirror2-split-read-column] [FAIL] |80.6%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror2-split-read-column] [FAIL] >> test.py::test_load[local-encryption-nonoverlay_1] >> test.py::test_load[rdma-mirror2-split-read-cross] [FAIL] |82.3%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-mirror/py3test >> test.py::test_load[rdma-mirror2-split-read-cross] [FAIL] |83.9%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} |85.5%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/{meta.json ... results_accumulator.log} >> test.py::test_load[local-encryption-overlay_1] [GOOD] >> test.py::test_load[local-encryption-overlay_2] >> test.py::test_load[local-encryption-nonoverlay-endpoint_snapshot_2] [GOOD] >> test.py::test_load[local-encryption-nonoverlay_snapshot_2] [GOOD] |87.1%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-nonoverlay-endpoint_snapshot_2] [GOOD] |88.7%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-nonoverlay_snapshot_2] [GOOD] >> test.py::test_load[local-encryption-overlay_snapshot_2] [GOOD] |90.3%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-overlay_snapshot_2] [GOOD] >> test.py::test_load[local-encryption-nonoverlay-endpoint_2] [GOOD] |91.9%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-nonoverlay-endpoint_2] [GOOD] >> test.py::test_load[local-encryption-overlay-endpoint_2] [GOOD] |93.5%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-overlay-endpoint_2] [GOOD] >> test.py::test_load[local-encryption-nonoverlay_1] [GOOD] >> test.py::test_load[local-encryption-nonoverlay_2] >> test.py::test_load[local-encryption-overlay_2] [GOOD] |95.2%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-overlay_2] [GOOD] >> test.py::test_load[local-encryption-nonoverlay_2] [GOOD] |96.8%| [TL] {default-linux-x86_64, relwithdebinfo} cloud/blockstore/tests/loadtest/local-encryption/py3test >> test.py::test_load[local-encryption-nonoverlay_2] [GOOD] |98.4%| [TA] $(B)/cloud/blockstore/tests/loadtest/local-encryption/test-results/py3test/{meta.json ... results_accumulator.log} |99.9%| [TA] {RESULT} $(B)/cloud/blockstore/tests/loadtest/local-encryption/test-results/py3test/{meta.json ... results_accumulator.log} |99.9%| CLEANING BUILD ROOT cloud/blockstore/tests/loadtest/local-mirror [size:large] nchunks:8 [tags: sb:cores=16, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:fat, ya:force_sandbox] ------ [0/8] chunk ran 1 test (total:165.10s - test:165.08s) [fail] test.py::test_load[no-rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (163.42s) cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 3. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff/test.py.test_load.no-rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk0/testing_out_stuff ------ [1/8] chunk ran 1 test (total:199.78s - test:199.75s) [fail] test.py::test_load[rdma-mirror2-split-read-column] [default-linux-x86_64-relwithdebinfo] (197.93s) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:318: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/test.py.test_load.rdma-mirror2-split-read-column.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.330686.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.330686.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.330686.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.330686.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.330686.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk1/testing_out_stuff/nbsd.330686.core.0 ------ [2/8] chunk ran 1 test (total:226.58s - test:226.55s) [fail] test.py::test_load[rdma-mirror2-split-read-cross] [default-linux-x86_64-relwithdebinfo] (224.52s) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:318: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/test.py.test_load.rdma-mirror2-split-read-cross.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.331516.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.331516.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.331516.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.331516.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.331516.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk2/testing_out_stuff/nbsd.331516.core.0 ------ [3/8] chunk ran 1 test (total:164.40s - test:164.38s) [fail] test.py::test_load[rdma-mirror3-resync] [default-linux-x86_64-relwithdebinfo] (163.17s) cloud/blockstore/tests/loadtest/local-mirror/test.py:330: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror/test.py:305: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:278: in run_test r.stop() contrib/ydb/tests/library/harness/daemon.py:184: in stop if not self.__check_can_launch_stop("stop"): contrib/ydb/tests/library/harness/daemon.py:161: in __check_can_launch_stop raise DaemonError( E contrib.ydb.tests.library.harness.daemon.DaemonError: Daemon failed with message: Unexpectedly finished before stop. E Process exit_code = 3. E Stdout file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff/mirror3-resync_stdout.txt E Stderr file name: E /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff/mirror3-resync_stderr.txt Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff/test.py.test_load.rdma-mirror3-resync.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror/test-results/py3test/chunk3/testing_out_stuff ------ FAIL: 4 - FAIL cloud/blockstore/tests/loadtest/local-mirror cloud/blockstore/tests/loadtest/local-mirror-lagging [size:large] nchunks:8 [tags: sb:cores=16, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:fat, ya:force_sandbox] ------ [0/8] chunk ran 1 test (total:151.88s - test:151.86s) [fail] test.py::test_load[mirror2-fresh-device-migration-rdma] [default-linux-x86_64-relwithdebinfo] (150.42s) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:373: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:399: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:387: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/test.py.test_load.mirror2-fresh-device-migration-rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.325802.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.325802.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.325802.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.325802.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.325802.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk0/testing_out_stuff/nbsd.325802.core.0 ------ [1/8] chunk ran 1 test (total:157.65s - setup:0.03s test:157.60s) [fail] test.py::test_load[mirror2-migration-rdma] [default-linux-x86_64-relwithdebinfo] (156.17s) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:373: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:399: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:387: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/test.py.test_load.mirror2-migration-rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.326253.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.326253.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.326253.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.326253.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.326253.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk1/testing_out_stuff/nbsd.326253.core.0 ------ [2/8] chunk ran 1 test (total:150.19s - test:150.17s) [fail] test.py::test_load[mirror2-target-migration-lagging-rdma] [default-linux-x86_64-relwithdebinfo] (148.76s) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:373: in __run_test ret = run_test( cloud/blockstore/tests/python/lib/test_base.py:275: in run_test raise Exception( E Exception: Several (1) processes terminated prematurely. During handling of the above exception, another exception occurred: cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:399: in test_load return __run_test(test_case, use_rdma) cloud/blockstore/tests/loadtest/local-mirror-lagging/test.py:387: in __run_test nbs.stop() cloud/blockstore/tests/python/lib/nbs_runner.py:672: in stop self.__stop_daemon() cloud/blockstore/tests/python/lib/nbs_runner.py:667: in __stop_daemon super(LocalNbs, self).stop() cloud/storage/core/tools/common/python/daemon.py:215: in stop self.__terminate_process() cloud/storage/core/tools/common/python/daemon.py:111: in __terminate_process self.__verify_process() cloud/storage/core/tools/common/python/daemon.py:93: in __verify_process raise DaemonError("unexpected exit code", res) E cloud.storage.core.tools.common.python.daemon.DaemonError: Daemon failed with message: unexpected exit code. Process exit_code = -6. Log: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/test.py.test_load.mirror2-target-migration-lagging-rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff Nbsd backtrace: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.325803.backtrace Nbsd backtrace html: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.325803.backtrace.html Nbsd backtrace html2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.325803.backtrace.0.html Nbsd backtrace2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.325803.backtrace.0 Nbsd binary: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd binary2: /home/github/tmp/out/cloud/blockstore/apps/server/nbsd Nbsd core: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.325803.core Nbsd core2: /home/github/tmp/out/cloud/blockstore/tests/loadtest/local-mirror-lagging/test-results/py3test/chunk2/testing_out_stuff/nbsd.325803.core.0 ------ FAIL: 3 - FAIL cloud/blockstore/tests/loadtest/local-mirror-lagging Total 3 suites: 1 - GOOD 2 - FAIL Total 23 tests: 16 - GOOD 7 - FAIL Cache efficiency ratio is 99.90% (26292 of 26319). Local: 11 (0.04%), dist: 0 (0.00%), by dynamic uids: 0 (0.00%), avoided: 26281 (99.86%) Dist cache download: count=0, size=0 bytes, speed=0.0 bytes/s Disk usage for tools/sdk 1.25 GiB Additional disk space consumed for build cache 0 bytes Critical path: [274270 ms] [TL] [rnd-13474837539647021482 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 0 (1761603823996), finished: 274270 (1761604098266)] [ 2099 ms] [TA] [rnd-5sfomtd5u3o9oq8l]: $(BUILD_ROOT)/cloud/blockstore/tests/loadtest/local-encryption/test-results/py3test/{meta.json ... results_accumulator.log} [started: 367820 (1761604191816), finished: 369919 (1761604193915)] Time from start: 616966.5678710938 ms, time elapsed by graph 276369 ms, time diff 340597.56787109375 ms. The longest 10 tasks: [274270 ms] [TL] [rnd-13474837539647021482 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603823996, finished: 1761604098266] [267343 ms] [TL] [rnd-2966315461284270838 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603750973, finished: 1761604018316] [253133 ms] [TL] [rnd-2002213053304786323 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603938655, finished: 1761604191788] [252464 ms] [TL] [rnd-2688061589884110637 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603755712, finished: 1761604008176] [237854 ms] [TL] [rnd-5992171349501030085 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603755713, finished: 1761603993567] [237672 ms] [TL] [rnd-8494707907406581496 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603586321, finished: 1761603823993] [237107 ms] [TL] [rnd-5376493448354071192 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603747423, finished: 1761603984530] [236944 ms] [TL] [rnd-1855441735307032480 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-encryption/py3test [started: 1761603747149, finished: 1761603984093] [226928 ms] [TL] [rnd-10065200597412223518 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761603743639, finished: 1761603970567] [200173 ms] [TL] [rnd-17774212116024782548 default-linux-x86_64 relwithdebinfo]: cloud/blockstore/tests/loadtest/local-mirror/py3test [started: 1761603738477, finished: 1761603938650] Total time by type: [3228159 ms] [TL] [count: 24, ave time 134506.62 msec] [ 11441 ms] [prepare:get from local cache] [count: 11, ave time 1040.09 msec] [ 2906 ms] [TA] [count: 3, ave time 968.67 msec] [ 362 ms] [prepare:clean] [count: 2, ave time 181.00 msec] [ 117 ms] [prepare:AC] [count: 2, ave time 58.50 msec] [ 90 ms] [prepare:tools] [count: 8, ave time 11.25 msec] Total tasks times: Total failed tasks time - 0 ms (0.00%) Total tests tasks time - 3231065 ms (100.00%) Total run tasks time - 3231065 ms Configure time - 12.5 s Statistics overhead 779 ms Info: Dump junit report to /home/github/tmp/junit.xml.2 Failed + echo 10