[2025-07-27 02:29:35,927][ INFO][PID:233657] Marking build as starting [2025-07-27 02:29:35,987][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:29:35,988][ INFO][PID:233657] VM allocation process starts [2025-07-27 02:29:36,008][ INFO][PID:233657] Trying to allocate VM: ResallocHost, ticket_id=4181325, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-27 02:29:41,011][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:29:46,012][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:29:51,013][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:29:56,014][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:01,015][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:06,016][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:11,017][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:16,019][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:21,020][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:26,021][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:31,022][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:36,023][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:41,024][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:46,025][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:51,028][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:30:56,029][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:01,030][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:06,031][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:11,032][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:16,034][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:21,034][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:26,035][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:31,037][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:36,038][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:41,039][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:46,040][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:51,041][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:31:56,042][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:01,043][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:06,044][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:11,045][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:16,046][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:21,048][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:26,049][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:31,050][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:36,051][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:41,052][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:46,053][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:51,055][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:32:56,056][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:01,057][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:06,058][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:11,059][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:16,060][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:21,061][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:26,062][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:31,063][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:36,065][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:41,066][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:46,067][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:51,068][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:33:56,069][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:01,070][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:06,071][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:11,073][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:16,074][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:21,075][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:26,076][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:31,077][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:36,078][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:41,079][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:46,080][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:51,082][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:34:56,083][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:01,084][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:06,085][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:11,086][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:16,087][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:21,088][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:26,089][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:31,090][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:36,091][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:41,092][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:46,093][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:51,094][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:35:56,095][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:01,096][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:06,097][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:11,099][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:16,101][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:21,102][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:26,103][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:31,104][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:36,105][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:41,106][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:46,107][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:51,109][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:36:56,110][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:01,112][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:06,113][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:11,113][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:16,115][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:21,116][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:26,117][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:31,118][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:36,119][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:41,120][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:46,121][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:51,123][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:37:56,124][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:01,125][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:06,126][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:11,127][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:16,128][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:21,129][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:26,130][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:31,131][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:36,132][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:41,133][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:46,135][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:51,136][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:38:56,137][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:01,138][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:06,139][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:11,140][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:16,141][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:21,143][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:26,145][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:31,146][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:36,147][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:41,148][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:46,149][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:51,150][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:39:56,151][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:01,152][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:06,153][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:11,155][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:16,156][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:21,157][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:26,158][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:31,159][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:36,160][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:41,162][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:46,163][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:51,164][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:54,198][ INFO][PID:233657] Allocated host ResallocHost, ticket_id=4181325, hostname=140.211.168.107, name=copr_osuosl_p09_prod_05900845_20250727_023718, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-27 02:40:54,199][ INFO][PID:233657] Allocating ssh connection to builder [2025-07-27 02:40:54,200][ INFO][PID:233657] Checking that builder machine is OK [2025-07-27 02:40:55,559][ INFO][PID:233657] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-27 02:40:56,536][ INFO][PID:233657] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-27 02:40:56,536][ INFO][PID:233657] Filling build.info file with builder info [2025-07-27 02:40:56,537][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:40:56,538][ INFO][PID:233657] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1753584056.5380654, "submitted_on": null, "status": 3, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9342069-fedora-eln-ppc64le", "build_id": 9342069, "package_name": "libdnf", "package_version": "0.75.0-0.20250727012708.0.74.0+27.g96de9331", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libdnf", "git_hash": "e5a1e12e8aa694bee97fd0029a728a16d7bb9e34", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09342069-libdnf", "built_packages": "", "id": 9342069, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-07-27 02:40:56,591][ INFO][PID:233657] Sending fedora-messaging bus message in build.start [2025-07-27 02:40:57,254][ INFO][PID:233657] Sending fedora-messaging bus message in chroot.start [2025-07-27 02:40:57,278][ INFO][PID:233657] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9342069-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-27 02:40:58,498][ INFO][PID:233657] Downloading the builder-live.log file, attempt 1 [2025-07-27 02:40:58,499][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log [2025-07-27 02:41:03,506][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 02:41:03,507][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:08,508][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:13,509][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:18,510][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:23,511][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:28,512][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:33,513][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:38,515][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:43,516][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:48,517][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:53,519][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:41:58,520][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:03,521][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:08,522][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:13,523][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:18,525][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:23,526][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:28,527][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:33,528][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:38,529][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:43,530][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:48,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:53,534][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:42:58,535][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:03,536][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:08,536][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:13,537][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:18,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:23,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:28,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:33,542][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:38,544][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:43,545][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:48,546][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:53,547][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:43:58,549][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:03,550][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:08,551][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:13,552][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:18,553][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:23,554][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:28,555][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:33,556][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:38,557][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:43,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:48,559][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:53,560][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:44:58,561][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:03,562][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:08,564][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:13,565][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:18,566][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:23,567][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:28,568][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:33,569][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:38,570][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:43,571][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:48,573][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:53,574][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:45:58,575][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:03,576][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:08,577][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:13,578][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:18,579][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:23,580][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:28,581][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:33,582][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:38,583][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:43,584][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:48,585][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:53,586][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:46:58,587][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:03,588][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:08,590][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:13,591][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:18,592][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:23,593][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:28,594][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:33,595][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:38,596][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:43,598][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:48,598][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:53,599][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:47:58,601][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:03,602][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:08,603][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:13,604][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:18,618][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:23,623][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:28,624][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:33,625][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:38,639][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:43,640][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:48,641][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:53,642][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:48:58,643][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:03,644][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:08,645][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:13,646][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:18,647][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:23,648][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:28,649][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:33,650][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:38,651][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:43,652][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:48,653][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:53,654][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:49:58,656][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:03,656][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:08,658][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:13,659][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:18,660][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:23,661][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:28,662][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:33,663][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:38,664][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:43,666][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:48,667][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:53,668][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:50:58,674][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:03,684][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 02:51:03,684][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:08,685][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:13,687][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:18,688][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:23,689][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:28,690][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:33,691][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:38,692][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:43,693][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:48,694][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:53,695][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:51:58,696][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:03,698][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:08,699][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:13,700][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:18,701][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:23,701][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:28,703][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:33,704][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:38,705][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:43,706][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:48,707][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:53,708][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:52:58,709][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:03,710][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:08,711][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:13,712][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:18,714][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:23,715][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:28,716][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:33,717][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:38,718][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:43,719][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:48,720][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:53,721][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:53:58,723][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:03,725][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:08,727][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:13,728][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:18,729][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:23,731][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:28,732][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:33,733][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:38,734][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:43,736][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:48,737][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:53,738][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:54:58,740][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:03,741][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:08,742][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:13,743][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:18,745][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:23,746][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:28,747][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:33,749][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:38,750][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:43,751][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:48,752][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:53,753][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:55:58,754][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:03,756][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:08,757][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:13,758][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:18,760][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:23,761][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:28,762][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:33,763][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:38,765][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:43,766][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:48,768][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:53,769][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:56:58,770][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:03,771][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:08,773][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:13,774][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:18,775][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:23,776][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:28,777][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:33,778][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:38,779][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:43,780][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:48,781][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:53,782][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:57:58,783][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:03,784][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:08,785][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:13,786][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:18,787][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:23,788][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:28,790][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:33,790][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:38,792][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:43,793][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:48,794][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:53,795][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:58:58,796][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:03,797][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:08,798][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:13,799][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:18,800][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:23,801][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:28,802][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:33,803][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:38,805][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:43,806][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:48,807][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:53,808][ INFO][PID:233657] Checking for cancel request [2025-07-27 02:59:58,809][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:03,809][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:08,810][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:13,812][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:18,813][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:23,813][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:28,814][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:33,815][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:38,816][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:43,818][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:48,819][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:53,820][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:00:58,821][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:03,835][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 03:01:03,835][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:08,836][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:13,837][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:18,838][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:23,839][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:28,840][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:33,842][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:38,843][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:43,844][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:48,845][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:53,846][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:01:58,847][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:03,848][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:08,849][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:13,850][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:18,851][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:23,853][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:28,854][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:33,856][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:38,859][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:43,861][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:48,862][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:53,864][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:02:58,865][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:03,866][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:08,867][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:13,868][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:18,869][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:23,870][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:28,871][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:33,872][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:38,875][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:43,876][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:48,877][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:53,878][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:03:58,879][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:03,880][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:08,882][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:13,883][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:18,885][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:23,894][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:28,899][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:33,900][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:38,901][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:43,902][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:48,903][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:53,907][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:04:58,908][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:03,910][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:08,911][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:13,914][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:18,915][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:23,920][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:28,923][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:33,925][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:38,926][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:43,929][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:48,930][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:53,931][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:05:58,932][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:03,934][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:08,936][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:13,938][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:18,939][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:23,940][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:28,941][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:33,943][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:38,944][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:43,945][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:48,946][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:53,948][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:06:58,949][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:03,950][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:08,951][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:13,952][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:18,954][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:23,957][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:28,958][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:33,964][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:38,969][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:43,970][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:48,971][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:53,972][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:07:58,973][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:03,974][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:08,975][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:13,976][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:18,984][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:23,985][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:28,987][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:33,991][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:38,992][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:43,993][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:48,995][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:53,998][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:08:59,002][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:04,005][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:09,006][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:14,008][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:19,009][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:24,011][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:29,014][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:34,015][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:39,017][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:44,020][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:49,021][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:54,022][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:09:59,024][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:04,026][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:09,028][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:14,031][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:19,032][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:24,034][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:29,036][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:34,040][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:39,042][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:44,044][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:49,045][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:54,047][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:10:59,048][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:11:04,058][ INFO][PID:233657] Periodic builder liveness probe: dead [2025-07-27 03:11:24,146][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 03:11:34,147][WARNING][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 03:11:44,148][ INFO][PID:233657] Downloading the builder-live.log file, attempt 2 [2025-07-27 03:11:44,152][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log [2025-07-27 03:12:04,133][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.107 port 22: Connection timed out [2025-07-27 03:12:44,222][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 03:12:54,233][WARNING][PID:233657] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 03:13:04,237][ INFO][PID:233657] Downloading the builder-live.log file, attempt 3 [2025-07-27 03:13:04,240][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log [2025-07-27 03:13:14,215][ ERROR][PID:233657] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.107 port 22: Connection timed out [2025-07-27 03:14:04,310][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 03:14:14,314][WARNING][PID:233657] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 03:14:24,288][ ERROR][PID:233657] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.107 port 22: Connection timed out [2025-07-27 03:14:24,315][ INFO][PID:233657] Downloading the builder-live.log file, attempt 4 [2025-07-27 03:14:24,316][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log [2025-07-27 03:15:24,384][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 03:15:34,360][ ERROR][PID:233657] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.107 port 22: Connection timed out [2025-07-27 03:15:34,385][ ERROR][PID:233657] Giving up for unstable SSH, failures: 1753585894.147412, 1753585974.233164, 1753586054.3143787, 1753586134.3851912 [2025-07-27 03:15:44,360][ ERROR][PID:233657] Can't ssh to cancel build. [2025-07-27 03:15:44,361][ ERROR][PID:233657] Re-try request for task on 'ResallocHost, ticket_id=4181325, hostname=140.211.168.107, name=copr_osuosl_p09_prod_05900845_20250727_023718, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-27 03:15:44,361][ INFO][PID:233657] Releasing VM back to pool [2025-07-27 03:15:44,373][ INFO][PID:233657] Retry #1 (on other host) [2025-07-27 03:15:44,374][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:15:44,374][ INFO][PID:233657] VM allocation process starts [2025-07-27 03:15:44,385][ INFO][PID:233657] Trying to allocate VM: ResallocHost, ticket_id=4181646, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-27 03:15:49,387][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:15:54,388][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:15:59,389][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:04,390][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:09,391][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:14,392][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:19,393][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:24,394][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:29,395][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:34,396][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:39,397][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:44,399][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:49,400][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:54,401][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:16:59,402][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:04,403][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:09,404][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:14,405][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:19,406][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:24,407][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:29,408][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:34,409][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:39,410][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:44,411][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:49,412][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:54,413][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:17:59,414][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:04,415][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:09,416][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:14,417][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:19,418][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:24,419][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:29,420][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:34,421][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:39,422][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:44,424][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:49,425][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:54,426][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:18:59,427][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:04,428][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:09,430][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:14,430][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:19,431][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:24,433][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:29,434][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:34,435][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:39,436][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:44,437][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:49,437][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:54,438][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:19:59,439][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:04,441][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:09,442][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:14,443][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:19,444][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:24,445][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:29,445][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:34,446][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:39,448][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:44,449][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:49,450][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:54,451][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:20:59,453][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:04,454][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:09,455][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:14,457][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:19,458][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:24,460][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:29,461][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:34,462][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:39,463][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:44,465][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:49,466][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:54,467][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:21:59,468][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:04,469][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:09,471][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:14,472][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:19,474][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:24,476][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:29,477][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:34,479][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:39,481][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:44,482][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:49,483][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:54,484][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:22:59,485][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:04,486][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:09,487][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:14,488][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:19,490][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:24,491][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:29,492][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:34,493][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:39,494][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:44,495][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:49,498][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:54,499][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:23:59,504][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:04,505][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:09,506][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:14,507][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:19,507][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:24,508][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:29,510][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:34,512][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:39,513][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:44,514][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:49,515][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:54,516][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:24:59,517][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:04,518][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:09,519][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:14,521][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:19,522][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:24,523][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:29,524][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:34,525][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:39,526][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:44,527][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:49,528][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:54,529][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:25:59,530][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:04,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:09,533][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:14,534][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:19,535][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:24,536][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:29,537][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:34,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:39,539][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:44,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:49,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:54,543][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:26:59,544][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:04,545][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:09,546][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:14,547][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:19,548][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:24,549][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:29,550][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:34,551][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:39,552][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:44,553][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:49,555][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:54,556][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:27:59,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:04,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:09,560][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:14,561][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:19,562][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:24,565][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:29,566][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:34,567][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:39,568][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:44,569][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:49,571][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:54,572][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:28:59,573][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:04,574][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:09,575][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:14,576][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:19,576][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:24,577][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:29,579][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:34,580][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:39,581][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:44,583][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:49,584][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:54,585][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:29:59,586][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:04,587][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:09,587][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:14,589][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:19,590][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:24,591][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:29,592][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:34,593][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:39,594][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:44,595][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:49,596][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:54,598][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:30:59,599][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:02,584][ INFO][PID:233657] Allocated host ResallocHost, ticket_id=4181646, hostname=140.211.168.94, name=copr_osuosl_p09_prod_05901506_20250727_032710, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-27 03:31:02,586][ INFO][PID:233657] Allocating ssh connection to builder [2025-07-27 03:31:02,587][ INFO][PID:233657] Checking that builder machine is OK [2025-07-27 03:31:04,042][ INFO][PID:233657] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-27 03:31:05,073][ INFO][PID:233657] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-27 03:31:05,074][ INFO][PID:233657] Filling build.info file with builder info [2025-07-27 03:31:05,077][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:05,077][ INFO][PID:233657] Not re-notifying FE and msg buses for the new host. [2025-07-27 03:31:05,078][ INFO][PID:233657] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9342069-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-27 03:31:06,381][ INFO][PID:233657] Downloading the builder-live.log file, attempt 1 [2025-07-27 03:31:06,384][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log [2025-07-27 03:31:11,389][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 03:31:11,390][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:16,391][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:21,392][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:26,394][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:31,396][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:36,398][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:41,399][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:46,400][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:51,402][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:31:56,403][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:01,404][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:06,405][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:11,407][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:16,408][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:21,410][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:26,412][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:31,413][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:36,418][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:41,419][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:46,421][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:51,422][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:32:56,424][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:01,425][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:06,426][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:11,427][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:16,428][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:21,429][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:26,430][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:31,432][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:36,434][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:41,435][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:46,437][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:51,439][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:33:56,441][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:01,447][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:06,448][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:11,449][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:16,450][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:21,455][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:26,456][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:31,457][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:36,458][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:41,460][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:46,461][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:51,463][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:34:56,468][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:01,470][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:06,471][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:11,472][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:16,473][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:21,474][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:26,475][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:31,476][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:36,478][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:41,480][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:46,481][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:51,482][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:35:56,483][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:01,484][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:06,485][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:11,487][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:16,488][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:21,489][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:26,490][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:31,493][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:36,495][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:41,496][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:46,497][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:51,498][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:36:56,500][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:01,501][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:06,502][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:11,503][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:16,505][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:21,506][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:26,507][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:31,509][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:36,510][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:41,512][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:46,514][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:51,515][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:37:56,516][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:01,517][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:06,518][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:11,519][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:16,520][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:21,521][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:26,523][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:31,524][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:36,525][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:41,526][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:46,527][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:51,528][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:38:56,529][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:01,531][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:06,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:11,533][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:16,534][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:21,535][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:26,536][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:31,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:36,539][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:41,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:46,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:51,542][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:39:56,543][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:01,545][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:06,546][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:11,547][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:16,548][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:21,550][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:26,551][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:31,552][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:36,553][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:41,554][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:46,555][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:51,557][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:40:56,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:01,559][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:06,560][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:11,571][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 03:41:11,572][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:16,574][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:21,576][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:26,577][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:31,578][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:36,581][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:41,582][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:46,583][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:51,584][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:41:56,586][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:01,587][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:06,588][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:11,589][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:16,591][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:21,594][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:26,595][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:31,597][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:36,599][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:41,600][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:46,602][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:51,603][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:42:56,604][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:01,606][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:06,607][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:11,608][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:16,609][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:21,610][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:26,611][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:31,612][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:36,614][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:41,615][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:46,616][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:51,617][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:43:56,618][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:01,623][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:06,624][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:11,626][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:16,627][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:21,628][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:26,630][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:31,631][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:36,632][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:41,634][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:46,639][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:51,641][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:44:56,642][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:01,644][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:06,646][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:11,649][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:16,655][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:21,656][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:26,658][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:31,659][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:36,661][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:41,662][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:46,664][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:51,665][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:45:56,666][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:01,668][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:06,669][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:11,670][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:16,671][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:21,672][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:26,673][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:31,677][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:36,678][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:41,679][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:46,680][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:51,681][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:46:56,682][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:01,684][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:06,685][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:11,687][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:16,689][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:21,691][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:26,692][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:31,693][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:36,694][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:41,696][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:46,697][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:51,699][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:47:56,700][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:01,703][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:06,704][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:11,706][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:16,708][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:21,711][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:26,713][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:31,714][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:36,717][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:41,718][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:46,720][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:51,721][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:48:56,722][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:01,724][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:06,725][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:11,726][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:16,731][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:21,734][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:26,739][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:31,742][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:36,743][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:41,751][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:46,965][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:52,154][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:49:57,171][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:02,220][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:07,230][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:12,234][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:17,236][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:22,247][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:27,251][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:32,253][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:37,271][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:42,835][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:47,852][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:52,853][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:50:57,855][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:02,856][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:07,859][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:12,883][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 03:51:12,883][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:17,885][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:22,887][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:27,889][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:32,897][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:37,910][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:42,913][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:47,922][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:52,963][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:51:57,967][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:02,980][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:07,985][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:12,987][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:17,989][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:22,992][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:28,005][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:33,023][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:38,030][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:43,046][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:48,062][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:53,090][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:52:58,105][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:03,118][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:08,126][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:13,135][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:18,148][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:23,150][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:28,162][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:33,178][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:38,188][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:43,189][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:48,366][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:53,385][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:53:58,396][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:03,408][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:08,409][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:13,411][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:18,414][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:23,415][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:28,417][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:33,418][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:38,422][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:43,432][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:48,440][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:53,442][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:54:58,446][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:03,447][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:08,449][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:13,451][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:18,453][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:23,457][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:28,465][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:33,467][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:38,470][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:43,474][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:48,477][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:53,479][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:55:58,481][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:03,482][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:08,483][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:13,485][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:18,486][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:23,488][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:28,489][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:33,490][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:38,491][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:43,492][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:48,493][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:53,494][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:56:58,495][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:03,496][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:08,499][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:13,501][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:18,503][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:23,504][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:28,506][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:33,508][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:38,512][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:43,515][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:48,517][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:53,520][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:57:58,521][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:03,523][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:08,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:13,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:18,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:23,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:28,575][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:33,577][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:38,578][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:43,579][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:48,581][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:53,582][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:58:58,583][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:03,586][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:08,588][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:13,589][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:18,594][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:23,597][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:28,598][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:33,599][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:38,600][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:43,716][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:48,725][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:53,728][ INFO][PID:233657] Checking for cancel request [2025-07-27 03:59:58,731][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:03,734][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:08,739][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:13,744][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:18,746][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:23,749][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:28,760][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:33,765][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:38,772][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:43,776][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:48,777][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:53,780][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:00:58,784][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:03,796][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:08,801][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:13,820][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 04:01:13,821][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:18,823][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:23,828][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:28,831][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:33,833][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:39,297][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:44,299][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:49,304][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:54,309][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:01:59,311][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:04,325][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:09,330][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:14,389][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:19,393][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:24,400][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:29,583][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:34,588][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:39,592][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:44,601][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:49,602][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:54,604][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:02:59,610][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:04,612][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:09,613][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:14,614][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:19,616][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:24,638][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:29,641][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:34,645][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:39,648][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:44,650][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:49,652][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:54,653][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:03:59,655][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:04,657][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:09,659][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:14,661][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:19,662][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:24,663][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:29,664][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:34,665][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:39,709][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:44,714][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:49,716][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:54,718][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:04:59,727][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:04,734][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:09,736][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:14,741][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:19,744][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:24,747][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:29,749][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:34,752][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:39,754][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:44,755][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:49,757][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:54,761][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:05:59,782][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:04,788][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:09,792][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:14,798][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:19,800][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:24,802][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:29,804][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:34,809][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:39,812][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:44,814][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:49,815][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:54,818][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:06:59,819][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:04,820][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:09,822][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:14,823][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:19,826][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:24,834][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:29,837][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:34,838][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:39,840][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:44,842][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:49,843][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:54,844][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:07:59,845][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:04,846][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:09,848][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:14,849][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:19,850][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:24,852][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:29,853][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:34,855][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:39,857][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:44,858][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:49,859][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:54,862][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:08:59,863][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:04,865][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:09,869][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:14,870][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:19,873][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:21,146][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 04:09:24,875][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:29,879][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:31,149][WARNING][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 04:09:34,884][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:39,889][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:41,149][ INFO][PID:233657] Downloading the builder-live.log file, attempt 2 [2025-07-27 04:09:41,155][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log [2025-07-27 04:09:44,897][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:49,901][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:54,905][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:09:59,908][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:04,915][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:09,930][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:14,932][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:19,941][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:24,950][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:29,955][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:34,956][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:39,962][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:41,234][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 04:10:44,971][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:49,977][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:10:51,236][WARNING][PID:233657] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 04:10:54,984][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:11:00,001][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:11:01,239][ INFO][PID:233657] Downloading the builder-live.log file, attempt 3 [2025-07-27 04:11:01,244][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log [2025-07-27 04:11:05,017][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:11:10,027][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:11:15,044][ INFO][PID:233657] Periodic builder liveness probe: dead [2025-07-27 04:12:01,330][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 04:12:11,332][WARNING][PID:233657] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 04:12:15,137][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.94 port 22: Connection timed out [2025-07-27 04:12:21,334][ INFO][PID:233657] Downloading the builder-live.log file, attempt 4 [2025-07-27 04:12:21,335][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log [2025-07-27 04:13:21,788][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 04:13:25,220][ ERROR][PID:233657] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.94 port 22: Connection timed out [2025-07-27 04:13:32,276][ ERROR][PID:233657] Giving up for unstable SSH, failures: 1753589371.1491559, 1753589451.2363708, 1753589531.3326285, 1753589612.2768095 [2025-07-27 04:14:35,298][ ERROR][PID:233657] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.94 port 22: Connection timed out [2025-07-27 04:15:45,370][ ERROR][PID:233657] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.94 port 22: Connection timed out [2025-07-27 04:15:55,371][ ERROR][PID:233657] Can't ssh to cancel build. [2025-07-27 04:15:55,372][ ERROR][PID:233657] Re-try request for task on 'ResallocHost, ticket_id=4181646, hostname=140.211.168.94, name=copr_osuosl_p09_prod_05901506_20250727_032710, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-27 04:15:55,372][ INFO][PID:233657] Releasing VM back to pool [2025-07-27 04:15:55,395][ INFO][PID:233657] Retry #2 (on other host) [2025-07-27 04:15:55,395][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:15:55,397][ INFO][PID:233657] VM allocation process starts [2025-07-27 04:15:55,412][ INFO][PID:233657] Trying to allocate VM: ResallocHost, ticket_id=4182125, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-27 04:16:00,413][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:05,414][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:10,416][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:15,417][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:20,418][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:25,420][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:30,421][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:35,423][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:40,424][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:45,425][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:50,427][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:16:55,428][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:00,429][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:05,430][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:10,431][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:15,432][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:20,434][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:25,435][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:30,436][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:35,437][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:40,438][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:45,439][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:50,440][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:17:55,441][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:00,442][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:05,444][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:10,448][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:15,449][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:20,450][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:25,451][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:30,453][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:35,454][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:40,455][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:45,456][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:50,458][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:18:55,459][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:00,461][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:05,462][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:10,463][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:15,464][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:20,465][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:25,466][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:30,467][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:35,468][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:40,469][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:45,470][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:50,471][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:19:55,473][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:00,474][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:05,476][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:10,477][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:15,481][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:20,482][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:25,483][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:30,484][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:35,485][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:40,487][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:45,488][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:50,489][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:20:55,490][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:00,491][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:05,492][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:10,493][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:15,494][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:20,495][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:25,497][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:30,498][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:35,499][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:40,500][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:45,502][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:50,503][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:21:55,504][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:00,506][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:05,507][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:10,508][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:15,509][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:20,510][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:25,511][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:30,512][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:35,513][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:40,515][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:45,516][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:50,517][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:22:55,519][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:00,520][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:05,521][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:10,523][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:15,524][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:20,526][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:25,527][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:30,528][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:35,529][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:40,530][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:45,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:50,533][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:23:55,534][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:00,535][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:05,537][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:10,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:15,539][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:20,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:25,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:30,542][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:35,543][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:40,544][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:45,546][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:50,547][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:24:55,548][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:00,549][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:05,550][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:10,551][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:15,552][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:20,553][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:25,554][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:30,555][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:35,557][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:40,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:45,559][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:50,560][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:25:55,561][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:00,562][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:05,564][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:10,567][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:15,569][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:20,571][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:25,572][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:30,574][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:35,576][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:40,577][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:45,579][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:50,581][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:26:55,582][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:00,584][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:05,586][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:10,587][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:15,589][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:20,592][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:25,593][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:30,594][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:35,597][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:40,598][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:45,599][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:50,600][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:27:55,601][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:00,603][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:05,604][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:10,605][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:15,606][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:20,607][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:25,609][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:30,610][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:35,611][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:40,613][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:45,614][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:50,616][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:28:55,617][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:00,619][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:05,620][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:10,622][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:15,623][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:20,625][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:25,626][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:30,627][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:35,628][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:40,630][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:45,631][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:50,632][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:29:55,633][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:00,635][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:05,636][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:10,637][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:15,638][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:20,639][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:25,640][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:30,643][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:35,644][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:40,645][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:45,647][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:50,648][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:30:55,651][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:00,652][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:05,653][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:10,655][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:15,656][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:20,657][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:25,658][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:30,662][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:35,664][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:40,665][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:45,666][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:50,668][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:31:55,669][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:00,672][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:05,673][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:10,675][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:15,678][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:20,683][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:25,691][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:30,692][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:35,695][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:40,696][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:45,697][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:50,700][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:32:55,702][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:00,703][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:05,705][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:10,706][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:13,662][ INFO][PID:233657] Allocated host ResallocHost, ticket_id=4182125, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05902171_20250727_042935, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-27 04:33:13,663][ INFO][PID:233657] Allocating ssh connection to builder [2025-07-27 04:33:13,663][ INFO][PID:233657] Checking that builder machine is OK [2025-07-27 04:33:15,099][ INFO][PID:233657] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-27 04:33:16,211][ INFO][PID:233657] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-27 04:33:16,211][ INFO][PID:233657] Filling build.info file with builder info [2025-07-27 04:33:16,215][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:16,216][ INFO][PID:233657] Not re-notifying FE and msg buses for the new host. [2025-07-27 04:33:16,216][ INFO][PID:233657] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9342069-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-27 04:33:17,535][ INFO][PID:233657] Downloading the builder-live.log file, attempt 1 [2025-07-27 04:33:17,537][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-27 04:33:22,544][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 04:33:22,545][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:27,546][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:32,548][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:37,549][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:42,551][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:47,555][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:52,556][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:33:57,557][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:02,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:07,559][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:12,560][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:17,561][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:22,562][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:27,564][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:32,565][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:37,566][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:42,567][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:47,568][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:52,569][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:34:57,572][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:02,573][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:07,574][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:12,575][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:17,576][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:22,577][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:27,579][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:32,580][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:37,582][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:42,586][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:47,587][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:52,589][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:35:57,590][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:02,591][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:07,593][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:12,595][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:17,596][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:22,597][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:27,598][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:32,599][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:37,601][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:42,602][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:47,607][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:52,610][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:36:57,611][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:02,612][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:07,614][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:12,616][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:17,617][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:22,618][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:27,619][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:32,624][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:37,625][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:42,626][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:47,628][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:52,629][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:37:57,630][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:02,631][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:07,632][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:12,633][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:17,635][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:22,636][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:27,638][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:32,642][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:37,643][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:42,647][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:47,649][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:52,650][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:38:57,651][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:02,652][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:07,653][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:12,655][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:17,656][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:22,657][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:27,658][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:32,659][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:37,661][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:42,662][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:47,663][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:52,664][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:39:57,665][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:02,667][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:07,668][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:13,234][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:18,235][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:23,236][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:28,238][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:33,239][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:38,240][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:43,241][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:48,242][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:53,243][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:40:58,244][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:03,245][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:08,246][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:13,247][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:18,248][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:23,249][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:28,250][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:33,251][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:38,252][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:43,253][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:48,254][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:53,255][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:41:58,256][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:03,258][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:08,259][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:13,260][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:18,261][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:23,262][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:28,263][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:33,264][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:38,265][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:43,267][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:48,510][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:53,511][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:42:58,512][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:03,513][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:08,514][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:13,515][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:18,516][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:23,522][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 04:43:23,522][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:28,523][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:33,524][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:38,525][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:43,526][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:48,528][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:53,529][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:43:58,530][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:03,531][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:08,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:13,533][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:18,534][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:23,535][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:28,536][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:33,537][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:38,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:43,539][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:48,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:53,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:44:58,542][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:03,550][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:08,551][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:13,552][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:18,553][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:23,554][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:28,555][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:33,556][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:38,558][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:43,559][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:48,559][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:53,560][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:45:58,561][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:03,562][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:08,563][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:13,565][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:18,579][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:23,745][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:28,748][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:33,750][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:38,752][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:43,754][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:48,755][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:53,757][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:46:58,758][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:03,760][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:08,769][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:13,772][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:18,773][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:23,774][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:28,775][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:33,776][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:38,777][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:43,780][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:48,933][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:53,936][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:47:58,937][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:04,151][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:09,153][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:14,154][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:19,155][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:24,156][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:29,157][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:34,158][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:39,159][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:44,160][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:49,161][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:54,163][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:48:59,164][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:04,165][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:09,166][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:14,167][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:19,168][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:24,199][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:29,201][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:34,425][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:39,426][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:44,427][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:49,428][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:54,429][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:49:59,430][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:04,431][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:09,432][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:14,433][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:19,435][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:24,436][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:29,437][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:34,438][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:39,439][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:44,440][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:49,441][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:54,530][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:50:59,531][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:04,532][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:09,533][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:14,534][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:19,535][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:24,536][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:29,537][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:34,538][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:39,539][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:44,540][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:49,541][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:54,542][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:51:59,840][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:04,841][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:09,842][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:14,843][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:19,844][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:24,845][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:29,846][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:34,847][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:39,848][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:44,849][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:50,317][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:52:55,318][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:00,319][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:05,320][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:10,321][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:15,322][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:20,323][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:25,329][ INFO][PID:233657] Periodic builder liveness probe: alive [2025-07-27 04:53:25,330][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:30,331][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:35,332][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:40,333][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:45,334][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:50,335][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:53:55,336][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:00,337][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:05,399][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:10,400][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:15,401][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:20,402][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:25,403][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:30,404][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:35,405][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:40,406][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:45,407][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:50,409][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:54:55,410][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:00,411][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:05,412][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:10,413][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:15,414][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:20,415][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:25,416][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:30,417][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:35,418][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:40,419][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:45,420][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:50,421][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:55:55,422][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:00,423][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:05,424][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:10,425][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:15,426][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:20,427][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:25,428][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:30,429][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:35,430][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:40,431][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:45,432][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:50,433][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:56:55,434][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:00,435][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:05,436][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:10,437][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:15,438][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:20,439][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:25,440][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:30,441][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:35,442][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:40,443][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:45,444][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:50,445][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:57:55,446][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:00,447][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:05,448][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:10,449][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:15,450][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:20,451][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:25,452][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:30,977][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:35,978][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:40,979][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:45,980][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:51,130][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:58:56,131][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:01,132][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:06,134][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:11,135][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:16,136][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:21,137][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:26,138][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:31,139][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:36,140][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:41,141][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:46,142][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:51,143][ INFO][PID:233657] Checking for cancel request [2025-07-27 04:59:56,144][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:01,145][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:06,146][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:11,147][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:16,148][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:21,149][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:26,150][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:31,151][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:36,152][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:41,124][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 05:00:41,153][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:46,154][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:51,125][WARNING][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 05:00:51,155][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:00:56,156][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:01,125][ INFO][PID:233657] Downloading the builder-live.log file, attempt 2 [2025-07-27 05:01:01,127][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-27 05:01:01,158][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:06,159][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:11,160][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:16,161][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:21,163][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:26,164][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:31,165][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:36,166][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:41,167][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:46,168][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:51,169][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:01:56,171][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:01,172][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:01,190][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 05:02:06,173][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:11,179][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:11,267][WARNING][PID:233657] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 05:02:16,180][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:21,181][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:21,268][ INFO][PID:233657] Downloading the builder-live.log file, attempt 3 [2025-07-27 05:02:21,269][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-27 05:02:26,182][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:31,183][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:36,184][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:41,185][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:46,186][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:51,187][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:02:56,188][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:03:01,189][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:03:06,190][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:03:11,191][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:03:16,192][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:03:21,193][ INFO][PID:233657] Checking for cancel request [2025-07-27 05:03:21,304][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 05:03:26,199][ INFO][PID:233657] Periodic builder liveness probe: dead [2025-07-27 05:03:31,307][WARNING][PID:233657] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-27 05:03:41,307][ INFO][PID:233657] Downloading the builder-live.log file, attempt 4 [2025-07-27 05:03:41,309][ INFO][PID:233657] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-07-27 05:04:26,260][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-27 05:04:41,376][ ERROR][PID:233657] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-27 05:04:51,377][ ERROR][PID:233657] Giving up for unstable SSH, failures: 1753592451.1250358, 1753592531.2675102, 1753592611.3069332, 1753592691.3776784 [2025-07-27 05:05:36,327][ ERROR][PID:233657] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-27 05:06:46,386][ ERROR][PID:233657] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-27 05:07:56,455][ ERROR][PID:233657] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.229 port 22: Connection timed out [2025-07-27 05:08:06,455][ ERROR][PID:233657] Can't ssh to cancel build. [2025-07-27 05:08:06,456][ ERROR][PID:233657] Re-try request for task on 'ResallocHost, ticket_id=4182125, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05902171_20250727_042935, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-27 05:08:06,457][ INFO][PID:233657] Releasing VM back to pool [2025-07-27 05:08:06,469][ ERROR][PID:233657] Backend process error: Three host tried without success: {'140.211.168.107', '140.211.168.229', '140.211.168.94'} [2025-07-27 05:08:06,470][WARNING][PID:233657] Switching not-finished job state to 'failed' [2025-07-27 05:08:06,471][ INFO][PID:233657] Worker failed build, took 2090.254580259323 [2025-07-27 05:08:06,471][ INFO][PID:233657] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": 1753592886.4706583, "started_on": 1753590796.216078, "submitted_on": null, "status": 0, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9342069-fedora-eln-ppc64le", "build_id": 9342069, "package_name": "libdnf", "package_version": "0.75.0-0.20250727012708.0.74.0+27.g96de9331", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libdnf", "git_hash": "e5a1e12e8aa694bee97fd0029a728a16d7bb9e34", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09342069-libdnf", "built_packages": "", "id": 9342069, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-07-27 05:08:06,617][ INFO][PID:233657] Sending fedora-messaging bus message in build.end [2025-07-27 05:08:06,641][ INFO][PID:233657] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09342069-libdnf/builder-live.log by gzip [2025-07-27 05:08:06,643][ INFO][PID:233657] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09342069-libdnf/builder-live.log' as PID 1037721 [2025-07-27 05:08:06,644][ INFO][PID:233657] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09342069-libdnf/builder-live.log) [2025-07-27 05:08:06,645][ INFO][PID:233657] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09342069-libdnf/backend.log by gzip [2025-07-27 05:08:06,646][ INFO][PID:233657] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09342069-libdnf/backend.log' as PID 1037722