[2025-07-28 01:44:34,670][ INFO][PID:1612453] Marking build as starting [2025-07-28 01:44:34,716][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:44:34,717][ INFO][PID:1612453] VM allocation process starts [2025-07-28 01:44:34,728][ INFO][PID:1612453] Trying to allocate VM: ResallocHost, ticket_id=4190836, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-28 01:44:39,730][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:44:44,731][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:44:49,732][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:44:54,733][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:44:59,735][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:04,736][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:09,737][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:14,738][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:19,739][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:24,740][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:29,742][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:34,743][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:39,744][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:44,745][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:49,746][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:54,747][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:45:59,749][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:04,750][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:09,751][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:14,752][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:19,754][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:24,756][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:29,758][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:34,759][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:39,760][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:44,761][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:49,762][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:54,764][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:46:59,765][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:04,766][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:09,767][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:14,768][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:19,770][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:24,771][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:29,772][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:34,773][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:39,774][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:44,775][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:49,776][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:54,777][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:47:59,779][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:04,780][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:09,781][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:14,782][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:19,783][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:24,784][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:29,785][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:34,786][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:39,787][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:44,788][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:49,789][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:54,790][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:48:59,791][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:04,793][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:09,794][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:14,795][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:19,796][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:24,798][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:29,799][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:34,800][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:39,801][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:44,802][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:49,803][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:54,804][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:49:59,806][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:04,807][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:09,808][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:14,809][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:19,810][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:24,811][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:29,812][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:34,813][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:39,815][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:44,816][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:49,817][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:54,818][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:50:59,819][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:04,820][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:09,822][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:14,823][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:19,824][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:24,825][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:29,826][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:34,827][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:39,828][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:44,829][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:49,830][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:54,832][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:51:59,833][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:04,834][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:09,835][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:14,836][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:19,837][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:24,838][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:29,839][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:34,840][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:39,841][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:44,842][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:49,843][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:54,844][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:52:59,845][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:04,846][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:09,847][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:14,848][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:19,849][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:24,850][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:29,851][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:34,852][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:39,853][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:44,854][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:49,855][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:54,857][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:53:59,858][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:04,858][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:09,860][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:14,861][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:19,862][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:24,863][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:29,864][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:34,865][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:39,866][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:44,867][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:49,868][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:54,869][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:54:59,870][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:04,871][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:09,873][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:14,874][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:19,875][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:24,876][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:29,877][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:34,878][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:39,879][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:44,880][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:49,881][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:54,882][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:55:59,884][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:04,885][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:09,886][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:14,887][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:19,888][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:24,889][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:29,890][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:34,891][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:39,892][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:44,893][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:49,894][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:54,895][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:56:59,897][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:04,898][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:09,899][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:14,900][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:19,901][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:24,902][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:29,903][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:34,904][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:39,905][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:44,907][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:49,908][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:52,891][ INFO][PID:1612453] Allocated host ResallocHost, ticket_id=4190836, hostname=140.211.168.48, name=copr_osuosl_p09_prod_05919844_20250728_015420, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-28 01:57:52,891][ INFO][PID:1612453] Allocating ssh connection to builder [2025-07-28 01:57:52,892][ INFO][PID:1612453] Checking that builder machine is OK [2025-07-28 01:57:54,253][ INFO][PID:1612453] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-28 01:57:55,264][ INFO][PID:1612453] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-28 01:57:55,264][ INFO][PID:1612453] Filling build.info file with builder info [2025-07-28 01:57:55,265][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:57:55,266][ INFO][PID:1612453] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1753667875.2658212, "submitted_on": null, "status": 3, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9343530-fedora-eln-ppc64le", "build_id": 9343530, "package_name": "libcomps", "package_version": "0.1.21-20250728012519.5.g702ec14", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libcomps", "git_hash": "401b039a2362aee6acbd651a457e076dcfe2556d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09343530-libcomps", "built_packages": "", "id": 9343530, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-07-28 01:57:55,330][ INFO][PID:1612453] Sending fedora-messaging bus message in build.start [2025-07-28 01:57:55,956][ INFO][PID:1612453] Sending fedora-messaging bus message in chroot.start [2025-07-28 01:57:55,980][ INFO][PID:1612453] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9343530-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-28 01:57:57,282][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 1 [2025-07-28 01:57:57,283][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.48 copr-rpmbuild-log [2025-07-28 01:58:02,287][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 01:58:02,288][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:07,289][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:12,290][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:17,291][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:22,292][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:27,293][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:32,294][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:37,295][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:42,296][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:47,297][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:52,298][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:58:57,299][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:02,300][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:07,301][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:12,302][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:17,303][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:22,304][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:27,306][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:32,307][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:37,308][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:42,309][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:47,310][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:52,311][ INFO][PID:1612453] Checking for cancel request [2025-07-28 01:59:57,312][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:02,313][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:07,315][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:12,316][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:17,317][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:22,318][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:27,319][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:32,321][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:37,322][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:42,323][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:47,324][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:52,325][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:00:57,326][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:02,327][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:07,328][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:12,330][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:17,331][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:22,332][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:27,333][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:32,334][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:37,335][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:42,336][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:47,337][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:52,338][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:01:57,139][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 02:01:57,340][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:02,341][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:07,140][WARNING][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 02:02:07,342][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:12,345][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:17,141][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 2 [2025-07-28 02:02:17,142][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.48 copr-rpmbuild-log [2025-07-28 02:02:17,347][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:22,348][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:27,349][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:32,350][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:37,351][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:42,352][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:47,353][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:52,354][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:02:57,355][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:02,356][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:07,358][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:12,358][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:17,280][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 02:03:17,360][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:22,361][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:27,282][WARNING][PID:1612453] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 02:03:27,362][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:32,363][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:37,283][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 3 [2025-07-28 02:03:37,284][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.48 copr-rpmbuild-log [2025-07-28 02:03:37,364][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:42,365][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:47,366][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:52,367][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:03:57,369][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:02,370][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:07,371][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:12,372][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:17,373][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:22,374][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:27,375][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:32,377][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:37,378][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:37,420][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 02:04:42,379][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:47,380][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:47,587][WARNING][PID:1612453] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 02:04:52,381][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:57,382][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:04:57,837][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 4 [2025-07-28 02:04:57,839][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.48 copr-rpmbuild-log [2025-07-28 02:05:02,383][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:07,384][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:12,385][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:17,387][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:22,388][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:27,389][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:32,390][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:37,391][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:42,392][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:47,393][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:52,394][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:57,396][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:05:57,974][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 02:06:02,397][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:07,398][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:07,976][ ERROR][PID:1612453] Giving up for unstable SSH, failures: 1753668127.1404657, 1753668207.2827003, 1753668287.587884, 1753668367.9764447 [2025-07-28 02:06:07,977][ ERROR][PID:1612453] Re-try request for task on 'ResallocHost, ticket_id=4190836, hostname=140.211.168.48, name=copr_osuosl_p09_prod_05919844_20250728_015420, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-28 02:06:07,978][ INFO][PID:1612453] Releasing VM back to pool [2025-07-28 02:06:08,002][ INFO][PID:1612453] Retry #1 (on other host) [2025-07-28 02:06:08,003][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:08,004][ INFO][PID:1612453] VM allocation process starts [2025-07-28 02:06:08,019][ INFO][PID:1612453] Trying to allocate VM: ResallocHost, ticket_id=4190989, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-28 02:06:13,020][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:18,021][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:23,022][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:28,024][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:33,026][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:38,027][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:43,029][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:48,030][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:53,031][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:06:58,033][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:03,034][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:08,036][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:13,037][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:18,039][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:23,041][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:28,042][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:33,044][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:38,046][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:43,048][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:48,049][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:53,052][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:07:58,054][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:03,055][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:08,056][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:13,057][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:18,060][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:23,061][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:28,064][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:33,066][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:38,067][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:43,068][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:48,071][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:53,076][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:08:58,081][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:03,083][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:08,084][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:13,084][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:18,085][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:23,086][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:28,087][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:33,088][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:38,089][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:43,090][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:48,091][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:53,092][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:09:58,093][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:03,094][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:08,095][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:13,096][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:18,097][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:23,098][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:28,099][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:33,100][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:38,102][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:43,103][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:48,104][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:53,105][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:10:58,106][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:03,107][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:08,109][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:13,110][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:18,117][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:23,118][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:28,122][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:33,127][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:38,129][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:43,131][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:48,133][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:53,143][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:11:58,145][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:03,149][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:08,151][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:13,155][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:18,158][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:23,160][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:28,178][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:33,180][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:38,182][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:43,185][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:48,187][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:53,189][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:12:58,190][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:03,192][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:08,193][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:13,194][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:18,195][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:23,196][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:28,197][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:33,198][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:38,199][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:43,200][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:48,201][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:53,202][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:13:58,205][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:03,209][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:08,210][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:13,211][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:18,213][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:23,214][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:28,218][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:33,219][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:38,220][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:43,221][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:48,222][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:53,223][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:14:58,224][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:03,225][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:08,233][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:13,237][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:18,239][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:23,242][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:28,248][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:33,249][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:38,256][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:43,260][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:48,262][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:53,264][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:15:58,266][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:03,268][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:08,281][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:13,286][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:18,294][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:23,296][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:26,186][ INFO][PID:1612453] Allocated host ResallocHost, ticket_id=4190989, hostname=140.211.168.2, name=copr_osuosl_p09_prod_05920042_20250728_021228, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-28 02:16:26,187][ INFO][PID:1612453] Allocating ssh connection to builder [2025-07-28 02:16:26,188][ INFO][PID:1612453] Checking that builder machine is OK [2025-07-28 02:16:27,849][ INFO][PID:1612453] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-28 02:16:28,930][ INFO][PID:1612453] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-28 02:16:28,930][ INFO][PID:1612453] Filling build.info file with builder info [2025-07-28 02:16:28,935][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:28,936][ INFO][PID:1612453] Not re-notifying FE and msg buses for the new host. [2025-07-28 02:16:28,937][ INFO][PID:1612453] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9343530-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-28 02:16:30,266][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 1 [2025-07-28 02:16:30,269][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log [2025-07-28 02:16:35,286][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 02:16:35,290][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:40,291][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:45,297][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:50,301][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:16:55,306][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:00,308][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:05,312][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:10,314][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:15,316][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:20,317][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:25,319][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:30,320][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:35,323][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:40,324][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:45,326][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:50,327][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:17:55,332][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:00,335][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:05,336][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:10,337][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:15,339][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:20,340][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:25,341][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:30,342][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:35,345][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:40,346][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:45,347][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:50,349][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:18:55,350][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:00,352][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:05,353][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:10,356][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:15,358][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:20,360][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:25,363][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:30,364][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:35,366][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:40,367][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:45,368][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:50,373][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:19:55,374][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:00,375][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:05,377][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:10,378][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:15,379][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:20,381][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:25,383][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:30,386][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:35,390][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:40,394][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:45,395][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:50,396][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:20:55,401][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:00,403][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:05,405][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:10,406][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:15,409][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:20,412][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:25,418][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:30,419][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:35,424][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:40,432][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:45,435][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:50,436][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:21:55,438][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:00,441][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:05,448][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:10,453][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:15,454][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:20,456][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:25,458][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:30,459][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:35,461][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:40,462][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:45,463][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:50,464][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:22:55,466][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:00,467][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:05,468][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:10,469][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:15,470][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:20,471][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:25,472][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:30,474][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:35,475][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:40,476][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:45,477][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:50,479][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:23:55,480][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:00,486][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:05,487][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:10,488][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:15,489][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:20,490][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:25,491][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:30,492][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:35,493][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:40,494][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:45,495][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:50,497][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:24:55,498][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:00,499][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:05,500][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:10,501][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:15,502][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:20,503][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:25,505][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:30,506][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:35,507][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:40,508][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:45,509][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:50,510][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:25:55,511][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:00,512][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:05,513][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:10,514][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:15,515][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:20,516][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:25,517][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:30,518][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:35,528][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 02:26:35,529][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:40,530][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:45,531][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:50,532][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:26:55,533][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:00,534][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:05,535][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:10,536][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:15,537][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:20,538][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:25,539][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:30,540][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:35,541][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:40,542][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:45,543][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:50,544][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:27:55,546][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:00,547][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:05,548][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:10,549][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:15,550][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:20,551][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:25,553][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:30,554][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:35,555][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:40,556][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:45,557][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:50,558][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:28:55,559][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:00,560][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:05,562][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:10,563][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:15,564][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:20,565][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:25,566][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:30,567][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:35,568][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:40,569][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:45,570][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:50,571][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:29:55,572][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:00,573][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:05,574][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:10,576][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:15,577][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:20,578][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:25,579][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:30,580][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:35,581][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:40,582][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:45,583][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:50,584][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:30:55,585][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:00,587][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:05,588][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:10,589][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:15,591][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:20,592][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:25,593][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:30,594][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:35,595][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:40,596][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:45,598][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:50,599][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:31:55,600][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:00,601][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:05,602][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:10,603][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:15,604][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:20,605][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:25,606][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:30,607][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:35,608][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:40,609][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:45,610][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:50,611][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:32:55,612][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:00,613][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:05,614][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:10,615][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:15,616][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:20,617][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:25,618][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:30,620][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:35,621][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:40,622][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:45,623][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:50,624][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:33:55,625][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:00,626][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:05,627][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:10,628][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:15,629][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:20,631][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:25,632][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:30,633][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:35,634][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:40,635][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:45,636][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:50,637][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:34:55,638][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:00,639][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:05,643][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:10,644][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:15,646][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:20,647][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:25,648][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:30,649][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:35,650][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:40,651][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:45,652][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:50,653][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:35:55,654][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:00,655][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:05,656][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:10,657][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:15,658][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:20,659][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:25,660][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:30,661][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:35,669][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 02:36:35,670][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:40,670][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:45,671][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:50,672][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:36:55,673][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:00,674][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:05,676][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:10,677][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:15,678][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:20,679][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:25,680][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:30,681][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:35,682][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:40,683][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:45,684][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:50,686][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:37:55,686][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:00,688][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:05,689][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:10,690][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:15,691][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:20,724][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:25,725][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:30,726][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:35,727][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:40,728][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:45,729][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:50,730][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:38:55,731][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:00,732][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:05,733][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:10,734][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:15,735][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:20,736][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:25,785][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:31,072][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:36,433][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:41,523][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:46,798][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:52,153][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:39:57,177][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:02,594][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:07,619][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:12,620][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:17,621][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:22,622][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:27,623][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:32,625][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:37,626][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:42,627][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:47,631][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:52,633][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:40:57,635][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:02,705][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:07,707][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:13,710][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:18,717][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:23,718][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:28,719][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:33,721][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:38,722][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:43,723][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:48,731][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:53,733][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:41:58,738][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:03,743][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:08,745][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:13,747][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:18,753][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:23,755][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:28,757][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:33,758][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:38,759][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:43,760][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:48,761][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:53,764][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:42:58,766][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:03,768][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:08,773][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:13,777][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:18,779][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:23,785][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:28,787][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:33,792][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:38,793][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:43,795][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:48,863][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:53,903][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:43:58,906][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:03,908][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:08,909][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:13,913][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:18,914][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:23,915][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:28,916][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:33,918][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:38,919][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:43,921][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:48,922][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:53,923][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:44:58,924][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:03,925][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:08,927][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:13,933][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:18,934][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:23,935][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:28,943][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:33,950][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:38,951][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:43,952][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:48,953][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:53,958][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:45:58,959][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:03,960][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:08,961][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:13,964][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:18,967][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:23,968][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:28,970][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:33,971][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:38,980][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 02:46:38,981][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:43,982][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:48,983][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:53,984][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:46:58,985][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:03,986][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:08,987][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:13,988][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:18,989][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:23,990][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:28,991][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:33,992][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:38,994][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:43,995][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:48,996][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:53,997][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:47:58,998][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:03,999][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:09,001][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:14,002][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:19,003][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:24,004][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:29,005][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:34,006][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:39,007][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:44,008][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:49,010][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:54,011][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:48:59,012][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:04,013][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:09,014][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:14,015][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:19,016][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:24,017][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:29,018][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:34,019][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:39,020][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:44,021][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:49,022][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:54,023][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:49:59,025][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:04,027][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:09,028][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:14,029][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:19,030][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:24,032][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:29,033][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:34,033][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:39,035][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:44,036][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:49,037][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:54,038][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:50:59,039][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:04,040][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:09,042][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:14,045][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:19,047][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:24,048][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:29,049][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:34,050][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:39,051][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:44,052][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:49,053][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:54,054][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:51:59,055][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:04,056][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:09,058][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:14,059][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:19,060][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:24,061][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:29,062][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:34,063][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:39,065][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:44,066][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:49,067][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:54,068][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:52:59,069][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:04,070][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:09,071][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:14,072][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:19,073][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:24,075][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:29,076][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:34,079][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:39,080][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:44,081][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:49,083][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:54,084][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:53:59,085][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:04,086][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:09,087][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:14,088][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:19,089][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:24,090][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:29,092][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:34,093][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:39,094][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:43,140][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 02:54:44,096][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:49,097][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:53,140][WARNING][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 02:54:54,098][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:54:59,099][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:03,141][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 2 [2025-07-28 02:55:03,143][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log [2025-07-28 02:55:03,220][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 02:55:04,100][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:09,101][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:13,225][WARNING][PID:1612453] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 02:55:14,102][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:19,103][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:23,226][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 3 [2025-07-28 02:55:23,227][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log [2025-07-28 02:55:24,105][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:29,107][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:34,108][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:39,110][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:44,111][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:49,113][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:54,114][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:55:59,115][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:04,116][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:09,117][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:14,118][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:19,119][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:24,120][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:29,121][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:34,122][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:56:39,166][ INFO][PID:1612453] Periodic builder liveness probe: dead [2025-07-28 02:56:40,474][ INFO][PID:1612453] Cancel request succeeded out: err: Warning: Permanently added '140.211.168.2' (ED25519) to the list of known hosts. Unexpected exception Traceback (most recent call last): File "/usr/bin/copr-rpmbuild-cancel", line 86, in _main() ~~~~~^^ File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main with open(pidfile, "r") as pidfd: ~~~~^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid' [2025-07-28 02:57:25,737][ ERROR][PID:1612453] Re-try request for task on 'ResallocHost, ticket_id=4190989, hostname=140.211.168.2, name=copr_osuosl_p09_prod_05920042_20250728_021228, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-28 02:57:25,737][ INFO][PID:1612453] Releasing VM back to pool [2025-07-28 02:57:25,746][ INFO][PID:1612453] Retry #2 (on other host) [2025-07-28 02:57:25,747][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:57:25,747][ INFO][PID:1612453] VM allocation process starts [2025-07-28 02:57:25,796][ INFO][PID:1612453] Trying to allocate VM: ResallocHost, ticket_id=4191470, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-28 02:57:30,797][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:57:35,799][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:57:40,800][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:57:45,802][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:57:50,804][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:57:55,806][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:00,807][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:05,808][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:10,809][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:15,810][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:20,812][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:25,813][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:30,814][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:35,815][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:40,816][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:45,818][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:50,819][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:58:55,821][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:00,822][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:05,823][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:10,825][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:15,827][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:20,830][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:25,834][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:30,844][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:35,846][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:40,848][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:45,850][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:50,852][ INFO][PID:1612453] Checking for cancel request [2025-07-28 02:59:55,853][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:00,854][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:05,855][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:10,857][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:15,858][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:20,859][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:25,860][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:30,861][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:35,862][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:40,863][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:45,864][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:50,865][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:00:55,866][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:00,868][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:05,869][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:10,871][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:15,872][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:20,873][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:25,874][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:30,875][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:35,876][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:40,878][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:45,879][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:50,880][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:01:55,881][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:00,882][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:05,884][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:10,885][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:15,886][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:20,888][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:25,889][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:30,890][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:35,891][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:40,892][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:45,893][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:50,894][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:02:55,895][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:00,897][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:05,898][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:10,899][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:15,905][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:20,907][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:25,914][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:30,916][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:35,917][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:40,918][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:45,919][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:50,920][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:03:55,925][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:00,926][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:05,927][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:10,928][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:15,930][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:20,931][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:25,932][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:30,933][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:35,934][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:40,935][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:45,936][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:50,937][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:04:55,938][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:00,939][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:05,940][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:10,941][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:15,942][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:20,943][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:25,944][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:30,946][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:35,947][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:40,949][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:45,950][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:50,951][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:05:55,952][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:00,953][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:05,956][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:10,963][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:15,965][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:20,971][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:25,973][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:30,978][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:35,979][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:40,981][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:45,982][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:50,983][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:06:55,984][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:00,985][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:05,986][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:10,987][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:15,988][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:20,989][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:25,992][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:30,996][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:35,998][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:41,002][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:46,005][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:51,006][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:07:56,008][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:01,009][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:06,011][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:11,012][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:16,017][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:21,018][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:26,020][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:31,021][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:36,026][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:41,028][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:46,029][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:51,030][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:08:56,032][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:01,035][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:06,036][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:11,038][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:16,040][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:21,042][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:26,046][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:31,054][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:36,055][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:41,057][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:46,060][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:51,064][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:09:56,068][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:01,071][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:06,072][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:11,077][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:16,087][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:21,089][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:26,094][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:31,099][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:36,100][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:41,103][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:44,112][ INFO][PID:1612453] Allocated host ResallocHost, ticket_id=4191470, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05920637_20250728_030640, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-28 03:10:44,113][ INFO][PID:1612453] Allocating ssh connection to builder [2025-07-28 03:10:44,115][ INFO][PID:1612453] Checking that builder machine is OK [2025-07-28 03:10:45,486][ INFO][PID:1612453] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-28 03:10:46,553][ INFO][PID:1612453] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-28 03:10:46,555][ INFO][PID:1612453] Filling build.info file with builder info [2025-07-28 03:10:46,568][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:46,569][ INFO][PID:1612453] Not re-notifying FE and msg buses for the new host. [2025-07-28 03:10:46,570][ INFO][PID:1612453] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9343530-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-28 03:10:47,915][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 1 [2025-07-28 03:10:47,920][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-28 03:10:52,941][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 03:10:52,942][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:10:57,946][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:02,947][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:07,949][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:12,954][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:17,955][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:22,957][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:27,960][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:32,962][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:37,965][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:42,967][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:47,968][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:52,971][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:11:57,974][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:02,975][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:07,977][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:12,981][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:17,982][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:22,984][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:27,989][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:32,994][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:37,995][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:42,997][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:47,998][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:53,002][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:12:58,003][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:03,006][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:08,010][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:13,011][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:18,013][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:23,014][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:28,015][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:33,017][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:38,018][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:43,020][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:48,023][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:53,025][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:13:58,030][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:03,034][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:08,036][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:13,039][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:18,049][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:23,052][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:28,056][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:33,060][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:38,062][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:43,066][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:48,072][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:53,073][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:14:58,075][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:03,079][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:08,081][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:13,083][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:18,085][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:23,086][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:28,087][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:33,096][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:38,101][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:43,103][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:48,104][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:53,106][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:15:58,108][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:03,110][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:08,111][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:13,601][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:18,614][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:23,616][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:28,659][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:33,661][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:38,662][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:43,665][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:48,669][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:53,671][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:16:58,673][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:03,675][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:08,676][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:13,677][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:18,678][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:23,679][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:28,681][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:33,682][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:38,822][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:43,877][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:48,879][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:53,921][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:17:58,923][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:03,925][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:08,926][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:13,928][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:18,929][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:23,931][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:28,932][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:33,933][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:38,935][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:43,936][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:48,937][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:53,938][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:18:58,939][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:03,941][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:08,942][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:13,944][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:18,945][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:23,947][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:28,948][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:33,949][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:38,950][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:43,952][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:48,953][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:53,955][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:19:58,956][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:03,958][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:08,960][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:13,962][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:18,963][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:23,965][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:28,966][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:33,968][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:38,969][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:43,970][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:48,971][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:53,979][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 03:20:53,979][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:20:58,980][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:03,981][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:08,982][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:13,983][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:18,984][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:23,985][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:28,986][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:33,986][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:38,987][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:43,988][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:48,989][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:53,991][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:21:59,001][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:04,007][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:09,008][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:14,009][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:19,011][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:24,014][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:29,018][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:34,019][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:39,021][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:44,022][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:49,023][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:54,025][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:22:59,026][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:04,027][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:09,028][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:14,029][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:19,030][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:24,031][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:29,033][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:34,034][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:39,035][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:44,036][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:49,037][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:54,039][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:23:59,041][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:04,042][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:09,043][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:14,044][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:19,045][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:24,047][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:29,048][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:34,049][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:39,050][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:44,051][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:49,052][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:54,053][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:24:59,054][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:04,055][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:09,056][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:14,057][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:19,058][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:24,059][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:29,060][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:34,061][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:39,062][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:44,064][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:49,065][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:54,066][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:25:59,067][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:04,068][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:09,069][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:14,070][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:19,071][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:24,072][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:29,073][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:34,074][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:39,075][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:44,076][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:49,078][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:54,079][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:26:59,086][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:04,087][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:09,088][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:14,089][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:19,090][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:24,091][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:29,093][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:34,094][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:39,095][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:44,103][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:49,106][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:54,107][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:27:59,108][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:04,109][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:09,110][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:14,111][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:19,112][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:24,113][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:29,114][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:34,115][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:39,116][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:44,117][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:49,119][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:54,120][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:28:59,124][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:04,125][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:09,126][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:14,127][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:19,131][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:24,132][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:29,133][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:34,134][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:39,135][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:44,137][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:49,138][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:54,141][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:29:59,146][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:04,147][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:09,151][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:14,152][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:19,154][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:24,157][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:29,158][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:34,159][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:39,161][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:44,162][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:49,166][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:54,190][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 03:30:54,191][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:30:59,194][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:04,197][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:09,201][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:14,208][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:19,211][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:24,213][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:29,223][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:34,229][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:39,237][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:44,244][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:49,249][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:54,250][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:31:59,256][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:04,259][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:09,260][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:14,261][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:19,263][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:24,264][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:29,265][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:34,266][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:39,267][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:44,269][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:49,272][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:54,273][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:32:59,276][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:04,278][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:09,281][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:14,284][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:19,286][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:24,290][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:29,297][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:34,302][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:39,304][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:44,307][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:49,313][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:54,316][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:33:59,321][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:04,324][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:09,328][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:14,333][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:19,334][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:24,337][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:29,354][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:34,356][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:39,362][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:44,364][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:49,368][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:54,370][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:34:59,373][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:04,383][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:09,392][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:14,396][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:19,401][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:24,410][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:29,411][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:34,413][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:39,415][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:44,418][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:49,423][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:54,425][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:35:59,428][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:04,431][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:09,435][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:14,437][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:19,440][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:24,443][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:29,444][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:34,448][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:39,456][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:44,470][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:49,475][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:54,478][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:36:59,485][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:04,491][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:09,495][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:14,498][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:19,569][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:24,573][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:29,583][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:34,598][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:39,600][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:44,613][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:49,616][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:54,620][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:37:59,622][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:04,624][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:09,626][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:14,627][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:19,628][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:24,630][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:29,632][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:34,637][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:39,638][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:44,640][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:49,643][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:54,645][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:38:59,646][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:04,648][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:09,649][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:14,650][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:19,651][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:24,652][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:29,654][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:34,655][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:39,656][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:44,657][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:49,658][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:54,659][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:39:59,661][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:04,662][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:09,663][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:14,665][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:19,667][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:24,674][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:29,675][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:34,677][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:39,678][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:44,679][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:49,680][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:54,695][ INFO][PID:1612453] Periodic builder liveness probe: alive [2025-07-28 03:40:54,697][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:40:59,699][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:04,700][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:09,701][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:14,702][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:19,703][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:24,705][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:29,706][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:34,707][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:39,710][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:44,713][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:49,715][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:54,716][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:41:59,719][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:04,720][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:09,722][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:14,723][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:19,724][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:24,725][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:29,726][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:34,727][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:39,729][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:44,731][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:49,733][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:54,734][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:42:59,735][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:04,736][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:09,737][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:14,738][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:19,739][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:24,741][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:29,742][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:34,746][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:39,747][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:44,749][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:49,749][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:54,750][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:43:59,752][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:04,753][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:09,754][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:14,755][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:19,757][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:24,758][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:29,759][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:34,760][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:39,761][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:44,763][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:49,768][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:54,769][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:44:59,771][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:04,772][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:09,773][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:14,774][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:19,775][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:24,776][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:29,778][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:34,779][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:39,780][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:44,781][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:49,782][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:54,783][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:45:59,785][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:04,786][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:09,789][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:14,792][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:19,794][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:24,795][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:29,796][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:34,798][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:39,803][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:44,804][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:49,806][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:54,807][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:46:59,809][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:04,811][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:09,813][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:14,814][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:19,822][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:24,831][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:29,832][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:34,843][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:39,851][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:44,855][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:49,859][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:54,867][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:47:59,872][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:04,874][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:09,883][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:14,885][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:19,891][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:24,900][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:29,901][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:34,905][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:39,911][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:44,913][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:49,920][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:54,924][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:48:59,928][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:04,942][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:09,945][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:14,947][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:19,951][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:24,961][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:29,962][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:34,965][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:39,971][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:44,972][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:49,973][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:54,975][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:49:59,976][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:00,144][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 03:50:04,977][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:09,978][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:10,145][WARNING][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 03:50:14,979][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:19,980][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:20,145][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 2 [2025-07-28 03:50:20,147][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-28 03:50:24,986][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:29,987][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:34,988][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:39,989][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:44,991][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:49,992][ INFO][PID:1612453] Checking for cancel request [2025-07-28 03:50:54,998][ INFO][PID:1612453] Periodic builder liveness probe: dead [2025-07-28 03:51:20,215][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 03:51:30,216][WARNING][PID:1612453] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 03:51:40,216][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 3 [2025-07-28 03:51:40,218][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-28 03:51:55,067][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-28 03:52:40,286][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 03:52:50,290][WARNING][PID:1612453] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-28 03:53:00,290][ INFO][PID:1612453] Downloading the builder-live.log file, attempt 4 [2025-07-28 03:53:00,292][ INFO][PID:1612453] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-28 03:53:05,137][ ERROR][PID:1612453] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-28 03:54:00,361][ ERROR][PID:1612453] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-28 03:54:10,366][ ERROR][PID:1612453] Giving up for unstable SSH, failures: 1753674610.145039, 1753674690.216235, 1753674770.2900581, 1753674850.3662946 [2025-07-28 03:54:15,203][ ERROR][PID:1612453] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-28 03:55:25,272][ ERROR][PID:1612453] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-28 03:55:35,273][ ERROR][PID:1612453] Can't ssh to cancel build. [2025-07-28 03:55:35,274][ ERROR][PID:1612453] Re-try request for task on 'ResallocHost, ticket_id=4191470, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05920637_20250728_030640, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-28 03:55:35,274][ INFO][PID:1612453] Releasing VM back to pool [2025-07-28 03:55:35,283][ ERROR][PID:1612453] Backend process error: Three host tried without success: {'140.211.168.229', '140.211.168.48', '140.211.168.2'} [2025-07-28 03:55:35,283][WARNING][PID:1612453] Switching not-finished job state to 'failed' [2025-07-28 03:55:35,284][ INFO][PID:1612453] Worker failed build, took 2688.713718652725 [2025-07-28 03:55:35,284][ INFO][PID:1612453] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": 1753674935.283517, "started_on": 1753672246.5697982, "submitted_on": null, "status": 0, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9343530-fedora-eln-ppc64le", "build_id": 9343530, "package_name": "libcomps", "package_version": "0.1.21-20250728012519.5.g702ec14", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libcomps", "git_hash": "401b039a2362aee6acbd651a457e076dcfe2556d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09343530-libcomps", "built_packages": "", "id": 9343530, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-07-28 03:55:35,350][ INFO][PID:1612453] Sending fedora-messaging bus message in build.end [2025-07-28 03:55:35,377][ INFO][PID:1612453] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09343530-libcomps/builder-live.log by gzip [2025-07-28 03:55:35,378][ INFO][PID:1612453] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09343530-libcomps/builder-live.log' as PID 2352857 [2025-07-28 03:55:35,379][ INFO][PID:1612453] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09343530-libcomps/builder-live.log) [2025-07-28 03:55:35,380][ INFO][PID:1612453] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09343530-libcomps/backend.log by gzip [2025-07-28 03:55:35,381][ INFO][PID:1612453] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09343530-libcomps/backend.log' as PID 2352858