[2025-07-22 17:48:18,783][ INFO][PID:2844438] Marking build as starting [2025-07-22 17:48:18,867][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:18,868][ INFO][PID:2844438] VM allocation process starts [2025-07-22 17:48:18,885][ INFO][PID:2844438] Trying to allocate VM: ResallocHost, ticket_id=4034628, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-22 17:48:23,887][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:28,890][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:33,893][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:38,895][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:43,896][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:48,897][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:53,898][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:48:58,899][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:03,900][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:08,901][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:13,903][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:18,904][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:23,905][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:28,906][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:33,907][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:38,908][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:43,910][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:46,963][ INFO][PID:2844438] Allocated host ResallocHost, ticket_id=4034628, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05733487_20250722_174619, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-22 17:49:46,964][ INFO][PID:2844438] Allocating ssh connection to builder [2025-07-22 17:49:46,965][ INFO][PID:2844438] Checking that builder machine is OK [2025-07-22 17:49:48,193][ INFO][PID:2844438] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-22 17:49:49,199][ INFO][PID:2844438] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-22 17:49:49,200][ INFO][PID:2844438] Filling build.info file with builder info [2025-07-22 17:49:49,201][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:49:49,202][ INFO][PID:2844438] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": null, "started_on": 1753206589.201933, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9301977-fedora-42-ppc64le", "build_id": 9301977, "package_name": "bootc", "package_version": "202507221737.gfe7e44c88e-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "b69a38257eddd049605e5d0480df53a425fd37fa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "09301977-bootc", "built_packages": "", "id": 9301977, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2025-07-22 17:49:49,257][ INFO][PID:2844438] Sending fedora-messaging bus message in build.start [2025-07-22 17:49:50,573][ INFO][PID:2844438] Sending fedora-messaging bus message in chroot.start [2025-07-22 17:49:50,652][ INFO][PID:2844438] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9301977-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-22 17:49:51,953][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 1 [2025-07-22 17:49:51,955][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-22 17:49:56,964][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 17:49:56,964][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:01,965][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:06,966][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:11,967][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:16,969][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:21,970][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:26,971][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:31,972][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:36,973][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:41,974][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:46,978][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:51,980][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:50:56,981][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:01,983][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:06,984][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:11,985][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:16,987][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:21,992][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:26,993][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:31,995][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:37,002][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:42,003][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:47,006][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:52,007][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:51:57,009][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:02,012][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:07,013][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:12,014][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:17,015][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:22,018][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:27,023][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:32,026][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:37,029][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:42,031][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:47,032][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:52,035][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:52:57,037][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:02,038][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:07,039][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:12,041][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:17,042][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:22,043][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:27,044][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:32,046][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:37,047][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:42,049][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:44,139][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:53:47,050][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:52,051][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:53:54,139][WARNING][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 17:53:57,059][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:02,061][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:04,141][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 2 [2025-07-22 17:54:04,142][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-22 17:54:07,062][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:12,064][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:17,066][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:22,067][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:27,069][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:32,070][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:37,071][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:42,073][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:47,074][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:52,075][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:54:57,076][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:02,078][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:04,281][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:55:07,079][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:12,080][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:14,284][WARNING][PID:2844438] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 17:55:17,082][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:22,084][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:24,285][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 3 [2025-07-22 17:55:24,290][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-22 17:55:27,085][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:32,086][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:37,087][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:42,089][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:47,090][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:52,091][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:55:57,092][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:02,093][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:07,095][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:12,096][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:17,097][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:22,098][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:24,429][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:56:27,099][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:32,101][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:34,434][WARNING][PID:2844438] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 17:56:37,102][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:42,104][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:44,436][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 4 [2025-07-22 17:56:44,437][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-22 17:56:47,105][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:52,107][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:56:57,108][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:02,110][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:07,111][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:12,112][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:17,114][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:22,115][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:27,117][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:32,122][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:37,123][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:42,127][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:44,575][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:57:47,130][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:52,132][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:54,579][ ERROR][PID:2844438] Giving up for unstable SSH, failures: 1753206834.1398761, 1753206914.2843812, 1753206994.4348001, 1753207074.5790765 [2025-07-22 17:57:54,580][ ERROR][PID:2844438] Re-try request for task on 'ResallocHost, ticket_id=4034628, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05733487_20250722_174619, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-22 17:57:54,581][ INFO][PID:2844438] Releasing VM back to pool [2025-07-22 17:57:54,600][ INFO][PID:2844438] Retry #1 (on other host) [2025-07-22 17:57:54,600][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:57:54,601][ INFO][PID:2844438] VM allocation process starts [2025-07-22 17:57:54,625][ INFO][PID:2844438] Trying to allocate VM: ResallocHost, ticket_id=4034797, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-22 17:57:59,627][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:04,628][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:09,629][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:14,630][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:19,632][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:24,633][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:29,634][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:34,635][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:39,637][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:44,638][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:49,639][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:54,640][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:58:59,641][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:04,644][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:09,645][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:14,647][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:19,648][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:24,649][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:29,650][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:34,652][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:39,653][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:44,655][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:49,656][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:54,657][ INFO][PID:2844438] Checking for cancel request [2025-07-22 17:59:59,658][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:04,659][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:09,660][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:14,661][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:19,662][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:24,664][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:29,666][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:34,668][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:39,671][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:44,673][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:49,674][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:54,675][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:00:59,676][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:04,677][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:09,678][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:14,680][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:19,682][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:24,683][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:29,685][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:34,686][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:39,687][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:44,688][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:49,689][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:54,690][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:01:59,691][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:04,692][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:09,694][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:14,695][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:19,697][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:24,701][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:29,703][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:34,704][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:39,705][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:44,706][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:49,707][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:54,709][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:02:59,710][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:04,711][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:09,712][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:14,713][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:19,714][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:24,715][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:29,716][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:34,718][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:39,719][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:44,720][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:49,722][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:54,725][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:03:59,727][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:04,728][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:09,729][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:14,730][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:19,731][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:24,732][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:29,733][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:34,737][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:39,738][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:44,739][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:49,741][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:54,742][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:04:59,743][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:04,744][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:09,746][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:14,747][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:19,752][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:24,754][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:29,755][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:34,760][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:39,762][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:44,763][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:49,765][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:54,766][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:05:59,767][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:04,769][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:09,770][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:14,771][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:19,775][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:24,788][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:29,792][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:34,793][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:39,796][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:44,797][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:49,798][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:54,799][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:06:59,800][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:04,806][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:09,808][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:14,813][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:19,815][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:24,819][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:29,824][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:34,831][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:39,832][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:44,833][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:49,836][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:54,837][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:07:59,841][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:04,844][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:09,846][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:14,851][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:19,861][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:24,873][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:29,878][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:34,881][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:39,891][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:44,896][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:49,898][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:54,905][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:08:59,908][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:04,910][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:09,926][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:14,933][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:19,940][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:24,954][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:29,968][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:34,969][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:39,971][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:44,977][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:49,990][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:09:55,001][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:00,005][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:05,008][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:10,012][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:15,020][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:20,023][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:25,030][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:30,037][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:35,038][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:40,040][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:45,049][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:50,051][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:10:55,057][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:00,061][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:05,072][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:10,077][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:15,079][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:20,087][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:25,094][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:30,099][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:35,116][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:40,120][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:45,129][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:50,131][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:11:55,136][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:00,138][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:05,142][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:10,146][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:15,150][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:20,156][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:25,157][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:30,166][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:35,167][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:40,169][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:45,170][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:50,172][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:12:55,176][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:00,178][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:05,180][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:10,181][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:15,182][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:20,183][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:25,185][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:30,186][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:35,187][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:40,189][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:45,190][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:50,191][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:13:55,196][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:00,197][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:05,199][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:10,201][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:15,205][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:20,206][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:25,209][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:30,212][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:35,214][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:40,220][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:45,223][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:50,229][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:14:55,231][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:00,233][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:05,241][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:10,245][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:15,249][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:20,250][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:25,260][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:30,261][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:35,267][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:40,271][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:45,273][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:50,274][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:15:55,277][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:00,279][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:05,281][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:10,282][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:15,284][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:20,285][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:25,293][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:30,299][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:35,303][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:40,304][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:45,306][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:50,307][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:16:55,309][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:00,314][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:05,317][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:10,319][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:15,322][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:20,323][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:25,324][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:30,326][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:35,327][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:40,329][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:45,333][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:50,336][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:17:55,340][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:00,341][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:05,347][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:10,348][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:15,349][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:20,350][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:25,354][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:30,356][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:35,358][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:40,360][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:45,361][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:50,362][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:18:55,363][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:00,365][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:05,367][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:10,372][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:12,984][ INFO][PID:2844438] Allocated host ResallocHost, ticket_id=4034797, hostname=140.211.168.199, name=copr_osuosl_p09_prod_05734436_20250722_181435, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-22 18:19:12,985][ INFO][PID:2844438] Allocating ssh connection to builder [2025-07-22 18:19:12,985][ INFO][PID:2844438] Checking that builder machine is OK [2025-07-22 18:19:14,395][ INFO][PID:2844438] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-22 18:19:15,410][ INFO][PID:2844438] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-22 18:19:15,411][ INFO][PID:2844438] Filling build.info file with builder info [2025-07-22 18:19:15,412][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:15,412][ INFO][PID:2844438] Not re-notifying FE and msg buses for the new host. [2025-07-22 18:19:15,414][ INFO][PID:2844438] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9301977-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-22 18:19:16,746][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 1 [2025-07-22 18:19:16,748][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log [2025-07-22 18:19:21,755][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 18:19:21,756][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:26,758][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:31,760][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:36,762][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:41,764][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:46,770][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:51,772][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:19:56,774][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:01,775][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:06,777][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:11,778][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:16,779][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:21,780][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:26,782][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:31,783][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:36,784][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:41,785][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:46,786][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:51,788][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:20:56,790][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:01,792][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:06,795][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:11,796][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:16,798][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:21,800][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:26,802][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:31,808][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:36,816][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:41,817][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:46,819][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:51,823][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:21:56,826][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:01,830][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:06,833][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:11,835][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:16,842][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:21,843][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:26,845][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:31,847][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:36,853][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:41,855][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:46,857][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:51,861][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:22:56,862][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:01,864][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:06,867][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:11,869][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:16,877][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:21,879][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:26,880][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:31,884][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:36,887][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:41,889][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:46,891][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:51,893][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:23:56,898][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:01,901][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:06,903][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:11,906][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:16,908][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:21,913][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:26,918][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:31,928][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:36,932][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:41,936][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:46,937][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:51,938][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:24:56,939][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:01,943][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:06,945][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:11,947][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:16,950][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:21,952][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:26,953][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:31,955][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:36,956][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:41,957][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:46,958][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:51,960][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:25:56,961][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:01,963][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:06,964][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:11,965][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:16,967][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:21,968][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:26,969][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:31,971][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:36,972][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:41,973][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:46,974][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:51,975][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:26:56,976][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:01,977][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:06,979][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:11,980][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:16,982][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:21,983][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:26,984][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:31,986][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:36,987][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:41,988][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:46,989][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:51,991][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:27:56,992][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:01,993][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:06,994][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:11,995][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:16,997][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:21,998][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:26,999][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:32,000][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:37,001][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:42,002][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:47,003][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:52,004][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:28:57,005][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:02,006][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:07,008][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:12,009][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:17,014][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:22,021][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 18:29:22,022][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:27,022][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:32,023][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:37,025][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:42,026][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:47,027][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:52,028][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:29:57,030][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:02,032][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:07,033][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:12,035][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:17,036][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:22,037][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:27,039][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:32,040][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:37,041][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:42,045][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:47,047][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:52,048][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:30:57,049][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:02,050][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:07,051][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:12,052][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:17,053][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:22,054][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:27,055][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:32,056][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:37,057][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:42,058][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:47,060][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:52,060][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:31:57,061][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:02,063][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:07,064][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:12,071][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:17,072][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:22,073][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:27,074][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:32,075][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:37,076][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:42,078][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:47,079][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:52,080][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:32:57,081][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:02,083][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:07,084][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:12,084][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:17,085][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:22,087][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:27,088][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:32,089][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:37,090][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:42,091][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:47,092][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:52,093][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:33:57,094][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:02,096][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:07,097][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:12,098][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:17,099][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:22,100][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:27,101][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:32,103][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:37,104][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:42,105][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:47,106][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:52,108][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:34:57,109][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:02,110][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:07,111][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:12,113][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:17,114][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:22,115][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:27,116][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:32,118][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:37,119][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:42,120][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:47,121][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:52,123][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:35:57,124][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:02,125][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:07,126][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:12,127][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:17,129][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:22,131][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:27,132][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:32,134][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:37,136][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:42,137][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:47,138][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:52,140][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:36:57,142][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:02,143][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:07,144][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:12,145][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:17,146][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:22,147][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:27,149][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:32,150][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:37,151][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:42,152][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:47,153][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:52,154][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:37:57,155][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:02,157][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:07,158][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:12,159][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:17,160][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:22,162][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:27,163][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:32,167][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:37,168][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:42,169][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:47,171][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:52,172][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:38:57,179][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:02,180][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:07,181][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:12,182][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:17,184][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:22,194][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 18:39:22,195][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:27,195][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:32,197][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:37,199][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:42,200][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:47,202][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:52,206][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:39:57,210][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:02,212][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:07,213][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:12,214][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:17,215][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:22,217][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:27,218][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:32,219][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:37,220][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:42,221][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:47,222][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:52,223][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:40:57,225][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:02,226][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:07,227][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:12,228][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:17,229][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:22,231][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:27,232][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:32,233][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:37,234][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:42,238][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:47,239][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:52,240][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:41:57,241][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:02,242][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:07,243][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:12,244][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:17,245][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:22,247][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:27,248][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:32,249][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:37,251][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:42,252][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:47,253][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:52,254][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:42:57,256][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:02,257][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:07,258][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:12,259][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:17,261][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:22,262][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:27,264][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:32,265][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:37,266][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:42,267][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:47,268][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:52,269][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:43:57,270][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:02,271][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:07,272][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:12,273][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:17,274][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:22,276][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:27,277][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:32,278][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:37,279][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:42,280][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:47,281][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:52,282][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:44:57,283][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:02,285][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:07,286][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:12,287][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:17,289][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:22,290][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:27,291][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:32,292][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:37,293][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:42,294][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:47,295][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:52,296][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:45:57,303][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:02,310][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:07,312][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:12,313][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:17,314][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:22,315][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:27,316][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:32,317][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:37,318][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:42,319][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:47,320][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:52,321][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:46:57,323][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:02,328][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:07,329][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:12,330][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:17,331][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:22,332][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:27,333][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:32,334][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:37,336][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:42,338][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:47,341][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:52,353][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:47:57,354][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:02,356][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:07,357][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:12,358][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:17,359][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:22,360][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:27,362][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:32,364][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:37,366][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:42,367][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:47,368][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:52,369][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:48:57,371][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:49:02,372][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:49:07,373][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:49:12,376][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:49:14,146][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 18:49:17,381][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:49:22,405][ INFO][PID:2844438] Periodic builder liveness probe: dead [2025-07-22 18:49:24,147][WARNING][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 18:49:34,148][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 2 [2025-07-22 18:49:34,150][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log [2025-07-22 18:50:22,484][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.199 port 22: Connection timed out [2025-07-22 18:50:34,219][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 18:50:44,224][WARNING][PID:2844438] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 18:50:54,225][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 3 [2025-07-22 18:50:54,226][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log [2025-07-22 18:51:32,560][ ERROR][PID:2844438] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.199 port 22: Connection timed out [2025-07-22 18:51:54,300][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 18:52:04,304][WARNING][PID:2844438] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 18:52:14,305][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 4 [2025-07-22 18:52:14,307][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log [2025-07-22 18:52:42,634][ ERROR][PID:2844438] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.199 port 22: Connection timed out [2025-07-22 18:53:14,375][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 18:53:24,385][ ERROR][PID:2844438] Giving up for unstable SSH, failures: 1753210164.1474369, 1753210244.224258, 1753210324.3043866, 1753210404.384794 [2025-07-22 18:53:52,709][ ERROR][PID:2844438] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.199 port 22: Connection timed out [2025-07-22 18:54:02,710][ ERROR][PID:2844438] Can't ssh to cancel build. [2025-07-22 18:54:02,711][ ERROR][PID:2844438] Re-try request for task on 'ResallocHost, ticket_id=4034797, hostname=140.211.168.199, name=copr_osuosl_p09_prod_05734436_20250722_181435, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-22 18:54:02,711][ INFO][PID:2844438] Releasing VM back to pool [2025-07-22 18:54:02,724][ INFO][PID:2844438] Retry #2 (on other host) [2025-07-22 18:54:02,725][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:02,726][ INFO][PID:2844438] VM allocation process starts [2025-07-22 18:54:02,740][ INFO][PID:2844438] Trying to allocate VM: ResallocHost, ticket_id=4035916, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-22 18:54:07,744][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:12,746][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:17,747][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:22,748][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:27,750][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:32,751][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:37,752][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:42,754][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:47,755][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:52,760][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:54:57,761][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:02,763][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:07,764][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:12,765][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:17,767][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:22,768][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:27,769][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:32,770][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:37,772][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:42,773][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:47,774][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:52,775][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:55:57,776][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:02,777][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:07,778][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:12,779][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:17,780][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:22,781][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:27,783][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:32,784][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:37,787][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:42,788][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:47,792][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:52,796][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:56:57,798][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:02,801][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:07,803][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:12,804][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:17,805][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:22,807][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:27,810][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:32,817][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:37,818][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:42,822][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:47,823][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:52,824][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:57:57,825][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:02,826][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:07,827][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:12,829][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:17,833][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:22,834][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:27,835][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:32,837][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:37,844][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:42,845][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:47,848][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:52,849][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:58:57,851][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:02,852][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:07,853][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:12,855][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:17,857][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:22,860][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:27,864][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:32,867][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:37,869][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:42,870][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:47,871][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:52,873][ INFO][PID:2844438] Checking for cancel request [2025-07-22 18:59:57,875][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:02,880][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:07,882][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:12,884][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:17,886][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:22,887][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:27,888][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:32,889][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:37,891][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:42,892][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:47,893][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:52,895][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:00:57,896][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:02,898][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:07,901][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:12,902][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:17,906][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:22,907][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:27,911][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:32,915][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:37,922][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:42,924][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:47,926][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:52,928][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:01:57,930][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:02,931][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:07,956][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:12,957][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:17,959][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:22,962][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:27,964][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:32,969][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:37,971][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:42,973][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:47,977][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:52,979][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:02:57,980][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:02,984][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:07,987][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:12,991][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:17,995][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:22,996][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:27,999][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:33,006][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:38,007][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:43,009][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:48,010][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:53,011][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:03:58,012][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:03,014][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:08,015][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:13,018][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:18,021][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:23,022][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:28,026][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:33,027][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:38,028][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:43,029][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:48,031][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:53,032][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:04:58,033][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:03,035][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:08,036][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:13,037][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:18,038][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:21,028][ INFO][PID:2844438] Allocated host ResallocHost, ticket_id=4035916, hostname=140.211.168.81, name=copr_osuosl_p09_prod_05736096_20250722_190123, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-22 19:05:21,029][ INFO][PID:2844438] Allocating ssh connection to builder [2025-07-22 19:05:21,030][ INFO][PID:2844438] Checking that builder machine is OK [2025-07-22 19:05:22,646][ INFO][PID:2844438] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-22 19:05:23,659][ INFO][PID:2844438] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-22 19:05:23,660][ INFO][PID:2844438] Filling build.info file with builder info [2025-07-22 19:05:23,662][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:23,663][ INFO][PID:2844438] Not re-notifying FE and msg buses for the new host. [2025-07-22 19:05:23,663][ INFO][PID:2844438] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9301977-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-22 19:05:24,984][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 1 [2025-07-22 19:05:24,986][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-22 19:05:29,993][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 19:05:29,993][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:34,994][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:39,995][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:45,003][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:50,004][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:05:55,005][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:00,007][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:05,008][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:10,009][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:15,010][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:20,011][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:25,013][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:30,014][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:35,015][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:40,016][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:45,017][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:50,019][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:06:55,021][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:00,022][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:05,023][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:10,024][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:15,025][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:20,027][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:25,028][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:30,029][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:35,030][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:40,031][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:45,033][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:50,035][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:07:55,040][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:00,047][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:05,049][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:10,052][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:15,056][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:20,060][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:25,061][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:30,062][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:35,065][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:40,069][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:45,076][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:50,081][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:08:55,084][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:00,090][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:05,093][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:10,100][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:15,102][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:20,107][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:25,111][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:30,113][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:35,122][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:40,126][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:45,128][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:50,132][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:09:55,136][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:00,139][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:05,140][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:10,143][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:15,144][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:20,145][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:25,147][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:30,148][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:35,149][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:40,153][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:45,154][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:50,155][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:10:55,156][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:00,157][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:05,158][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:10,159][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:15,161][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:20,162][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:25,163][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:30,164][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:35,166][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:40,169][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:45,170][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:50,172][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:11:55,175][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:00,176][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:05,179][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:10,184][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:15,185][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:20,187][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:25,189][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:30,193][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:35,199][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:40,200][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:45,201][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:50,204][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:12:55,208][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:00,213][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:05,214][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:10,222][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:15,223][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:20,225][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:25,230][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:30,233][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:35,234][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:40,235][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:45,236][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:50,237][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:13:55,240][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:00,241][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:05,243][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:10,247][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:15,251][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:20,256][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:25,257][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:30,258][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:35,260][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:40,262][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:45,267][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:50,268][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:14:55,269][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:00,271][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:05,274][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:10,275][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:15,277][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:20,278][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:25,287][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:30,302][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 19:15:30,303][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:35,304][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:40,306][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:45,307][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:50,308][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:15:55,309][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:00,311][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:05,314][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:10,315][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:15,319][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:20,320][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:25,321][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:30,323][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:35,325][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:40,326][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:45,327][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:50,328][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:16:55,329][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:00,332][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:05,333][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:10,335][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:15,336][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:20,337][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:25,338][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:30,340][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:35,341][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:40,342][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:45,344][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:50,345][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:17:55,346][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:00,348][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:05,349][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:10,350][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:15,351][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:20,352][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:25,353][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:30,355][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:35,356][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:40,357][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:45,359][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:50,360][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:18:55,361][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:00,362][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:05,363][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:10,364][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:15,365][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:20,367][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:25,368][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:30,369][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:35,370][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:40,373][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:45,374][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:50,376][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:19:55,377][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:00,378][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:05,379][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:10,380][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:15,381][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:20,382][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:25,383][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:30,385][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:35,386][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:40,387][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:45,388][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:50,389][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:20:55,390][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:00,391][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:05,392][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:10,393][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:15,394][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:20,395][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:25,396][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:30,397][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:35,399][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:40,400][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:45,402][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:50,405][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:21:55,406][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:00,407][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:05,408][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:10,409][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:15,410][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:20,411][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:25,413][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:30,415][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:35,417][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:40,418][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:45,419][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:50,421][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:22:55,422][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:00,423][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:05,424][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:10,425][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:15,426][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:20,429][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:25,430][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:30,431][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:35,432][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:40,433][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:45,434][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:50,435][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:23:55,436][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:00,437][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:05,438][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:10,440][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:15,441][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:20,442][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:25,443][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:30,444][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:35,445][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:40,446][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:45,447][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:50,448][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:24:55,449][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:00,450][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:05,451][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:10,452][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:15,453][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:20,454][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:25,455][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:30,464][ INFO][PID:2844438] Periodic builder liveness probe: alive [2025-07-22 19:25:30,465][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:35,466][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:40,466][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:45,467][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:50,468][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:25:55,470][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:00,471][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:05,472][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:10,473][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:15,474][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:20,475][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:25,477][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:30,478][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:35,483][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:40,484][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:45,485][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:50,487][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:26:55,488][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:00,489][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:05,490][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:10,492][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:15,493][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:20,497][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:25,500][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:30,502][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:35,503][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:40,504][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:45,505][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:50,506][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:27:55,507][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:00,508][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:05,509][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:10,511][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:15,512][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:20,513][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:25,514][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:30,515][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:35,517][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:40,518][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:45,519][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:50,520][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:28:55,521][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:00,523][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:05,524][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:10,525][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:15,526][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:20,527][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:25,529][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:30,530][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:35,531][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:40,532][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:45,533][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:50,535][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:29:55,536][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:00,537][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:05,538][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:10,540][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:15,541][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:20,542][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:25,543][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:30,545][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:35,546][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:40,550][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:45,553][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:50,554][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:30:55,555][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:00,556][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:05,558][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:10,559][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:15,560][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:20,561][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:25,562][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:30,563][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:35,565][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:40,566][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:45,568][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:50,570][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:31:55,571][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:00,574][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:05,575][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:10,576][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:15,578][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:20,580][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:25,582][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:30,583][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:35,584][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:40,585][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:45,587][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:50,590][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:32:55,595][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:00,596][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:05,597][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:10,599][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:15,600][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:20,602][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:25,604][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:30,606][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:35,608][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:40,609][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:45,614][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:50,616][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:33:55,618][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:00,620][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:05,621][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:10,622][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:15,624][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:20,626][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:25,629][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:30,631][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:35,632][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:40,633][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:45,634][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:50,640][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:34:55,645][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:00,646][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:05,647][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:10,648][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:15,649][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:20,651][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:25,652][ INFO][PID:2844438] Checking for cancel request [2025-07-22 19:35:30,670][ INFO][PID:2844438] Periodic builder liveness probe: dead [2025-07-22 19:36:30,753][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.81 port 22: Connection timed out [2025-07-22 19:36:54,140][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 19:37:04,141][WARNING][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 19:37:14,141][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 2 [2025-07-22 19:37:14,143][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-22 19:37:40,822][ ERROR][PID:2844438] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.81 port 22: Connection timed out [2025-07-22 19:38:14,213][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 19:38:24,215][WARNING][PID:2844438] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 19:38:34,216][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 3 [2025-07-22 19:38:34,217][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-22 19:38:50,893][ ERROR][PID:2844438] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.81 port 22: Connection timed out [2025-07-22 19:39:34,286][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 19:39:44,293][WARNING][PID:2844438] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 19:39:54,294][ INFO][PID:2844438] Downloading the builder-live.log file, attempt 4 [2025-07-22 19:39:54,295][ INFO][PID:2844438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-22 19:40:00,963][ ERROR][PID:2844438] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.81 port 22: Connection timed out [2025-07-22 19:40:10,964][ ERROR][PID:2844438] Can't ssh to cancel build. [2025-07-22 19:40:54,364][ ERROR][PID:2844438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 19:41:04,365][ ERROR][PID:2844438] Giving up for unstable SSH, failures: 1753213024.141077, 1753213104.2154982, 1753213184.2938907, 1753213264.365613 [2025-07-22 19:41:04,366][ ERROR][PID:2844438] Re-try request for task on 'ResallocHost, ticket_id=4035916, hostname=140.211.168.81, name=copr_osuosl_p09_prod_05736096_20250722_190123, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-22 19:41:04,367][ INFO][PID:2844438] Releasing VM back to pool [2025-07-22 19:41:04,385][ ERROR][PID:2844438] Backend process error: Three host tried without success: {'140.211.168.199', '140.211.168.89', '140.211.168.81'} [2025-07-22 19:41:04,386][WARNING][PID:2844438] Switching not-finished job state to 'failed' [2025-07-22 19:41:04,386][ INFO][PID:2844438] Worker failed build, took 2140.723270177841 [2025-07-22 19:41:04,387][ INFO][PID:2844438] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": 1753213264.386404, "started_on": 1753211123.6631339, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9301977-fedora-42-ppc64le", "build_id": 9301977, "package_name": "bootc", "package_version": "202507221737.gfe7e44c88e-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "b69a38257eddd049605e5d0480df53a425fd37fa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "09301977-bootc", "built_packages": "", "id": 9301977, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2025-07-22 19:41:04,444][ INFO][PID:2844438] Sending fedora-messaging bus message in build.end [2025-07-22 19:41:04,501][ INFO][PID:2844438] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-42-ppc64le/09301977-bootc/builder-live.log by gzip [2025-07-22 19:41:04,502][ INFO][PID:2844438] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-42-ppc64le/09301977-bootc/builder-live.log' as PID 3625098 [2025-07-22 19:41:04,503][ INFO][PID:2844438] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-42-ppc64le/09301977-bootc/builder-live.log) [2025-07-22 19:41:04,504][ INFO][PID:2844438] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-42-ppc64le/09301977-bootc/backend.log by gzip [2025-07-22 19:41:04,505][ INFO][PID:2844438] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-42-ppc64le/09301977-bootc/backend.log' as PID 3625099