+ sudo -E -H -u github ./ya make --test-size=small --test-size=medium --test-type=unittest --test-type=clang_tidy --test-type=gtest --test-type=py3test --test-type=py2test --test-type=pytest --test-type=flake8 --test-type=black --test-type=py2_flake8 --test-type=go_test --test-type=gofmt --run-all-tests --keep-going --retest --test-threads 20 --link-threads 40 --cache-size 512G --do-not-output-stderrs -T --nice 0 --stat --output /home/github/tmp/out -DGITHUB_CI=yes --build relwithdebinfo --target=cloud/blockstore/ --target=cloud/filestore/ --target=cloud/disk_manager/ --target=cloud/tasks/ --target=cloud/storage/ --bazel-remote-store --bazel-remote-base-uri http://195.242.10.243:9090 --bazel-remote-username bazel-remote-user --bazel-remote-password-file /tmp/tmp.ZAcPhEfzTP --junit /home/github/tmp/junit.xml.3 --log-file /home/github/tmp/logs/3/ya_log.txt --evlog-file /home/github/tmp/logs/3/ya_evlog.jsonl -X Configuring dependencies for platform default-linux-x86_64-relwithdebinfo Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-kikimr-test/cloud-blockstore-tests-fio-qemu-vhost-kikimr-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-local-test/cloud-blockstore-tests-fio-qemu-vhost-local-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/fio/qemu-vhost-null-test/cloud-blockstore-tests-fio-qemu-vhost-null-test: Requirement ram is redefined 30 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-data-integrity/blockstore-tests-loadtest-local-data-integrity: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-encryption/cloud-blockstore-tests-loadtest-local-encryption: Requirement ram is redefined 30 -> 48 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror/cloud-blockstore-tests-loadtest-local-mirror: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-mirror-lagging/blockstore-tests-loadtest-local-mirror-lagging: Requirement cpu is redefined 8 -> all Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/dedicated/tests-loadtest-local-nonrepl-dedicated: Requirement ram is redefined 30 -> 96 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement cpu is redefined 8 -> 16 Warn[-WPluginErr]: in $B/cloud/blockstore/tests/loadtest/local-nonrepl/embedded/tests-loadtest-local-nonrepl-embedded: Requirement ram is redefined 30 -> 96 Warn[-WPluginErr]: in $B/cloud/filestore/tests/async_close_test/cloud-filestore-tests-async_close_test: Requirement cpu is redefined 8 -> 4 Warn[-WPluginErr]: in $B/cloud/filestore/tests/async_close_test/cloud-filestore-tests-async_close_test: Requirement ram is redefined 30 -> 16 Configuring dependencies for platform tools Configuring dependencies for platform test_tool_tc1-global Configuring tests execution Configuring local and dist store caches Configuration done. Preparing for execution |28.8%| PREPARE $(PYTHON) |30.5%| PREPARE $(GDB) |32.2%| PREPARE $(CLANG-2185927622) |33.9%| PREPARE $(GO_TOOLS-2652799470) |39.0%| PREPARE $(OS_SDK_ROOT-sbr:1966560555) |40.7%| PREPARE $(YMAKE_PYTHON3-1415908779) |42.4%| PREPARE $(LLD_ROOT-3334042713) |44.1%| PREPARE $(TEST_TOOL_HOST-sbr:8580453620) |45.8%| PREPARE $(FLAKE8_PY3-3680676150) |49.2%| COMPACTING CACHE 423.1GiB |55.9%| CLEANING SYMRES |57.6%| [LD] {RESULT} $(B)/cloud/disk_manager/test/mocks/kms/kms-mock |59.3%| [LD] {RESULT} $(B)/cloud/disk_manager/test/recipe/recipe |61.0%| [LD] {RESULT} $(B)/cloud/blockstore/tests/rdma/rdma-test/cloud-blockstore-tests-rdma-rdma-test |62.7%| [GO] {RESULT} $(B)/cloud/disk_manager/internal/pkg/clients/nbs/tests/tests |64.4%| [LD] {RESULT} $(B)/cloud/disk_manager/cmd/disk-manager/disk-manager |66.1%| [LD] {RESULT} $(B)/cloud/tasks/test/nemesis/nemesis |67.8%| [LD] {RESULT} $(B)/cloud/disk_manager/test/mocks/compute/compute-mock |69.5%| [LD] {RESULT} $(B)/contrib/python/moto/bin/moto_server |71.2%| [LD] {RESULT} $(B)/cloud/disk_manager/test/mocks/metadata/metadata-mock |72.9%| [LD] {RESULT} $(B)/cloud/disk_manager/cmd/disk-manager-init-db/disk-manager-init-db |74.6%| [LD] {RESULT} $(B)/cloud/storage/core/tests/recipes/qemu/qemu-recipe |76.3%| [LD] {RESULT} $(B)/cloud/storage/core/tests/recipes/virtiofs-server/virtiofs-server-recipe |78.0%| [PK] {RESULT} $(B)/cloud/storage/core/tools/testing/ydb/bin/{testing-ydb-bin.final.pkg.fake ... cloud/storage/core/tools/testing/ydb/bin/ydbd} |79.7%| [LD] {RESULT} $(B)/cloud/blockstore/apps/client/{blockstore-client ... liblibidn-dynamic.so} |81.4%| [LD] {RESULT} $(B)/cloud/blockstore/apps/disk_agent/{diskagentd ... liblibaio-dynamic.so} |83.1%| [LD] {RESULT} $(B)/cloud/blockstore/apps/server/{nbsd ... liblibaio-dynamic.so} |84.7%| [PK] {RESULT} $(B)/cloud/storage/core/tools/testing/qemu/bin/{testing-qemu-bin.final.pkg.fake ... cloud/storage/core/tools/testing/qemu/bin/qemu-bin.tar.gz} |86.4%| [LD] {RESULT} $(B)/cloud/blockstore/tools/testing/rdma-test/{rdma-test ... liblibaio-dynamic.so} |88.1%| [PK] {RESULT} $(B)/cloud/blockstore/tests/rdma/image/{tests-rdma-image.final.pkg.fake ... cloud/blockstore/tests/rdma/image/rootfs.img} |89.8%| [PK] {RESULT} $(B)/cloud/storage/core/tools/testing/virtiofs_server/bin/{testing-virtiofs_server-bin.final.pkg.fake ... cloud/storage/core/tools/testing/virtiofs_server/bin/virtiofs-server} |93.2%| [LD] {RESULT} $(B)/cloud/filestore/apps/server/{filestore-server ... liblibaio-dynamic.so} >> test.py::test_rdma >> test.py::test_rdma [FAIL] |94.9%| [TM] cloud/blockstore/tests/rdma/rdma-test/py3test >> test.py::test_rdma [FAIL] |96.6%| [TM] {RESULT} cloud/blockstore/tests/rdma/rdma-test/py3test >> tests::TestCreateDisk [GOOD] >> tests::TestDeleteDisk [GOOD] >> tests::TestDeleteDiskSync [GOOD] >> tests::TestCreateDeleteCheckpoint [GOOD] >> tests::TestDeleteCheckpointOnUnexistingDisk [GOOD] >> tests::TestDeleteCheckpointData [GOOD] >> tests::TestResizeDisk [GOOD] >> tests::TestResizeDiskConcurrently [GOOD] >> tests::TestResizeDiskFailureBecauseSizeIsNotDivisibleByBlockSize [GOOD] >> tests::TestResizeDiskFailureBecauseSizeDecreaseIsForbidden [GOOD] >> tests::TestResizeDiskFailureWhileChekpointing [GOOD] >> tests::TestAlterDisk [GOOD] >> tests::TestAlterDiskConcurrently [GOOD] >> tests::TestAlterDiskFailureWhileCheckpointing [GOOD] >> tests::TestRebaseDisk [GOOD] >> tests::TestAssignDisk [GOOD] >> tests::TestUnassignDisk [GOOD] >> tests::TestUnassignDeletedDisk [GOOD] >> tests::TestTokenErrorsShouldBeRetriable [GOOD] |96.7%| [TM] cloud/disk_manager/internal/pkg/clients/nbs/tests/tests >> tests::TestTokenErrorsShouldBeRetriable [GOOD] |98.3%| [TM] {RESULT} cloud/disk_manager/internal/pkg/clients/nbs/tests/tests |99.9%| CLEANING BUILD ROOT ------ sole chunk ran 42 tests (total:194.94s - recipes:70.17s test:123.66s recipes:1.07s) Info: Test run has exceeded 8.0G (8388608K) memory limit with 8.2G (8615564K) used. This may lead to test failure on the Autocheck/CI You can increase test's ram requirement using REQUIREMENTS(ram:X) in the ya.make pid rss ref pdirt 718264 44.4M 44.8M 6.1M test_tool run_test @/home/github/tmp/out/ya_command_file_0.args 718266 30.6M 20.6M 8.5M ├─ test_tool run_test @/home/github/tmp/out/ya_command_file_0.args 721001 45.6M 46.3M 23.4M │ └─ test_tool run_go_test @/home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-results/tests/testing_out_stuff/test_tool. 721008 68.8M 86.7M 69.2M │ └─ tests -test.v 718288 82.5M 82.8M 40.9M ├─ moto_server s3 --port 18732 718289 1.1G 1.2G 612M ├─ ydbd server --suppress-version-check --node=1 --log-file-name=/home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-result 718665 368M 391M 210M ├─ nbsd --service kikimr --server-port 8984 --data-server-port 62203 --secure-server-port 17853 --mon-port 7242 --profile-file /home/github/tmp/out 718791 263M 273M 122M ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 10864 --mon-port 22522 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent --diag-file 718930 267M 277M 126M ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 15960 --mon-port 24386 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent-1 --diag-fi 719069 258M 268M 117M ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 11965 --mon-port 23843 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent-2 --diag-fi 719210 265M 276M 125M ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 9597 --mon-port 7271 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent-3 --diag-file 719349 1.4G 1.4G 1.3G ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 30022 --mon-port 15314 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent-4 --diag-fi 719488 271M 282M 130M ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 6925 --mon-port 30470 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent-5 --diag-fil 719628 258M 266M 115M ├─ diskagentd --domain Root --node-broker localhost:16247 --ic-port 21738 --mon-port 9761 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent-6 --diag-fil 719784 1.1G 1.1G 568M ├─ ydbd server --suppress-version-check --node=1 --log-file-name=/home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-result 720123 303M 316M 137M ├─ nbsd --service kikimr --server-port 32470 --data-server-port 16136 --secure-server-port 8085 --mon-port 14700 --profile-file /home/github/.ya/build/build_root/64sv/00001 720250 256M 264M 113M ├─ diskagentd --domain Root --node-broker localhost:22330 --ic-port 12153 --mon-port 28413 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent --diag-file 720410 1.1G 1.1G 566M ├─ ydbd server --suppress-version-check --node=1 --log-file-name=/home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-result 720753 286M 296M 120M ├─ nbsd --service kikimr --server-port 16071 --data-server-port 22863 --secure-server-port 22073 --mon-port 10474 --profile-file /home/github/.ya/build/build_root/64sv/0000 720884 260M 265M 114M └─ diskagentd --domain Root --node-broker localhost:28812 --ic-port 11669 --mon-port 15645 --scheme-shard-dir nbs --load-configs-from-cms --node-type disk-agent --diag-file Log: /home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-results/tests/run_test.log Logsdir: /home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-results/tests/testing_out_stuff Stderr: /home/github/tmp/out/cloud/disk_manager/internal/pkg/clients/nbs/tests/test-results/tests/testing_out_stuff/stderr cloud/blockstore/tests/rdma/rdma-test [size:medium] [tags: sb:MULTISLOT, sb:cores=8, sb:logs_ttl=3, sb:ssd, sb:ttl=3, ya:dirty] ------ sole chunk ran 1 test (total:141.05s - recipes:58.33s test:82.13s recipes:0.58s) [fail] test.py::test_rdma [default-linux-x86_64-relwithdebinfo] (81.61s) cloud/blockstore/tests/rdma/rdma-test/test.py:63: in test_rdma check_rdma_connectivity(h1, h2, timeout=test_duration_sec) cloud/blockstore/tests/rdma/rdma-test/test.py:47: in check_rdma_connectivity h1.execute(initiator_cmd) cloud/blockstore/tests/python/lib/rdma.py:54: in execute return yatest.common.execute(cmd, *args, **kwargs) library/python/testing/yatest_common/yatest/common/process.py:656: in execute res.wait(check_exit_code, timeout, on_timeout) library/python/testing/yatest_common/yatest/common/process.py:411: in wait self._finalise(check_exit_code) library/python/testing/yatest_common/yatest/common/process.py:422: in _finalise raise ExecutionError(self) E yatest.common.process.ExecutionError: Command 'ssh -n -F /dev/null -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o ConnectTimeout=10 -o IdentitiesOnly=yes -o ServerAliveInterval=10 -o ServerAliveCountMax=10 -i /home/github/tmp/out/cloud/blockstore/tests/rdma/rdma-test/test-results/py3test/id_rsa -l qemu -p 38439 127.0.0.1 /home/github/tmp/out/cloud/blockstore/tools/testing/rdma-test/rdma-test --test Initiator --host 192.168.1.2 --port 9999 --wait Poll --storage Rdma --verbose debug --test-duration 10 --connect-timeout 120' has failed with code 255. E Errors: E b'...eived RDMA_CM_EVENT_ROUTE_RESOLVED\n2025-10-23T18:27:27.474347Z :BLOCKSTORE_RDMA DEBUG: [7070377926784618075] ResolvingRoute -> Connecting\n2025-10-23T18:27:27.474571Z :BLOCKSTORE_RDMA INFO: [7070377926784618075] connect [private_data=0x00007F48398CFAF8 private_data_len=16 responder_resources=255 initiator_depth=255 flow_control=1 retry_count=7 rnr_retry_count=7 srq=0 qp_num=0]\n2025-10-23T18:27:27.483382Z :BLOCKSTORE_RDMA DEBUG: [7070377926784618075] received RDMA_CM_EVENT_ESTABLISHED\n2025-10-23T18:27:27.483421Z :BLOCKSTORE_RDMA DEBUG: [7070377926784618075] validate [private_data=0x000054097F100050 private_data_len=196 responder_resources=128 initiator_depth=128 flow_control=1 retry_count=0 rnr_retry_count=7 srq=0 qp_num=17]\n2025-10-23T18:27:27.483425Z :BLOCKSTORE_RDMA DEBUG: [7070377926784618075] Connecting -> Connected\nVERIFY failed (2025-10-23T18:28:27.548081Z): E_TIMEOUT request timeout\n cloud/blockstore/tools/testing/rdma-test/initiator.cpp:304\n ProcessResponse(): requirement !HasError(request->Response) failed\nNPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf >, char const*, unsigned long)+663 (0xD86E87)\nNPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...)+284 (0xD7D11C)\n??+0 (0xC51B20)\n??+0 (0xC4F610)\nNCloud::NBlockStore::AppMain(NCloud::NBlockStore::TBootstrap&)+263 (0xC4BC97)\nmain+204 (0xC5562C)\n__libc_start_main+243 (0x7F483AC66083)\n??+0 (0xC2A029)\n' Log: /home/github/tmp/out/cloud/blockstore/tests/rdma/rdma-test/test-results/py3test/testing_out_stuff/test.py.test_rdma.log Logsdir: /home/github/tmp/out/cloud/blockstore/tests/rdma/rdma-test/test-results/py3test/testing_out_stuff ------ FAIL: 1 - FAIL cloud/blockstore/tests/rdma/rdma-test Total 2 suites: 1 - GOOD 1 - FAIL Total 43 tests: 42 - GOOD 1 - FAIL Cache efficiency ratio is 99.99% (28527 of 28529). Local: 22 (0.08%), dist: 0 (0.00%), by dynamic uids: 0 (0.00%), avoided: 28505 (99.92%) Dist cache download: count=0, size=0 bytes, speed=0.0 bytes/s Disk usage for tools/sdk 1.49 GiB Additional disk space consumed for build cache 0 bytes Critical path: [195187 ms] [TM] [rnd-bg6vvqncigxwzas6]: cloud/disk_manager/internal/pkg/clients/nbs/tests/tests [started: 0 (1761243973778), finished: 195187 (1761244168965)] Time from start: 205700.76904296875 ms, time elapsed by graph 195187 ms, time diff 10513.76904296875 ms. The longest 10 tasks: [195187 ms] [TM] [rnd-bg6vvqncigxwzas6]: cloud/disk_manager/internal/pkg/clients/nbs/tests/tests [started: 1761243973778, finished: 1761244168965] [141269 ms] [TM] [rnd-sdzmmc25920t4yod]: cloud/blockstore/tests/rdma/rdma-test/py3test [started: 1761243972101, finished: 1761244113370] [ 8836 ms] [ymake ThreadPoolExecutor-0_0 default-linux-x86_64-relwithdebinfo-nopic] [started: 1761243959691065, finished: 1761243968527834] [ 8806 ms] [ymake ThreadPoolExecutor-0_1 default-linux-x86_64-relwithdebinfo-pic] [started: 1761243959693686, finished: 1761243968499895] [ 1714 ms] [prepare:FromCache(Iuctuu2B2V0BsOI6sukFiA$(BUILD_ROOT)/cloud/filestore/apps/server/filestore-server $(BUILD_ROOT)/cloud/filestore/apps/server/filestore-server.debug $(BUILD_ROOT)/cloud/filestore/apps/server/libiconv.so $(BUILD_ROOT)/cloud/filestore/apps/server/liblibidn-dynamic.so $(BUILD_ROOT)/cloud/filestore/apps/server/liblibaio-dynamic.so)] local [started: 1761243972057, finished: 1761243973771] [ 876 ms] [ymake ThreadPoolExecutor-0_2 tools-pic] [started: 1761243961217455, finished: 1761243962094141] [ 422 ms] [prepare:clean symres] local [started: 1761243972034, finished: 1761243972456] [ 131 ms] [prepare:FromCache(PlfJST8XHGmkFY_wmy66yw$(BUILD_ROOT)/cloud/blockstore/apps/client/blockstore-client $(BUILD_ROOT)/cloud/blockstore/apps/client/libiconv.so $(BUILD_ROOT)/cloud/blockstore/apps/client/liblibidn-dynamic.so)] local [started: 1761243972054, finished: 1761243972185] [ 70 ms] [prepare:$(AC-get)] local [count: 22, cps: 314.29, ave time 3.18 msec] [ 44 ms] [prepare:FromCache(OZMlo8t8daQLCCy6TqssKA$(BUILD_ROOT)/cloud/disk_manager/test/recipe/recipe)] local [started: 1761243972053, finished: 1761243972097] Total time by type: [336456 ms] [TM] [count: 2, ave time 168228.00 msec] [ 2120 ms] [prepare:get from local cache] [count: 22, ave time 96.36 msec] [ 423 ms] [prepare:clean] [count: 2, ave time 211.50 msec] [ 108 ms] [prepare:tools] [count: 9, ave time 12.00 msec] [ 93 ms] [prepare:AC] [count: 2, ave time 46.50 msec] Total tasks times: Total failed tasks time - 0 ms (0.00%) Total tests tasks time - 336456 ms (100.00%) Total run tasks time - 336456 ms Configure time - 12.3 s Statistics overhead 736 ms Info: Dump junit report to /home/github/tmp/junit.xml.3 Failed + echo 10