[2025-07-23 10:21:56,202][ INFO][PID:1765457] Marking build as starting [2025-07-23 10:21:56,267][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:21:56,268][ INFO][PID:1765457] VM allocation process starts [2025-07-23 10:21:56,299][ INFO][PID:1765457] Trying to allocate VM: ResallocHost, ticket_id=4063183, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-23 10:22:01,305][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:06,315][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:11,317][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:16,318][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:21,320][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:26,324][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:31,326][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:36,329][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:41,335][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:46,341][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:51,344][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:22:56,347][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:01,349][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:06,360][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:11,364][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:16,370][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:21,373][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:26,557][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:31,559][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:36,611][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:41,706][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:44,532][ INFO][PID:1765457] Allocated host ResallocHost, ticket_id=4063183, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05756879_20250723_101951, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-23 10:23:44,533][ INFO][PID:1765457] Allocating ssh connection to builder [2025-07-23 10:23:44,534][ INFO][PID:1765457] Checking that builder machine is OK [2025-07-23 10:23:46,090][ INFO][PID:1765457] Running remote command: copr-builder-ready epel-9-ppc64le [2025-07-23 10:23:47,315][ INFO][PID:1765457] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-07-23 10:23:47,317][ INFO][PID:1765457] Filling build.info file with builder info [2025-07-23 10:23:47,321][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:23:47,324][ INFO][PID:1765457] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "https://api.github.com/users/nuqleo", "ended_on": null, "started_on": 1753266227.3247156, "submitted_on": null, "status": 3, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9311979-epel-9-ppc64le", "build_id": 9311979, "package_name": "freerouter", "package_version": "25.7.22-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "a679ffb945b21af63565434e777560823c2e50e0", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09311979-freerouter", "built_packages": "", "id": 9311979, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2025-07-23 10:23:47,388][ INFO][PID:1765457] Sending fedora-messaging bus message in build.start [2025-07-23 10:23:50,146][ INFO][PID:1765457] Sending fedora-messaging bus message in chroot.start [2025-07-23 10:23:50,258][ INFO][PID:1765457] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9311979-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2025-07-23 10:23:51,668][ INFO][PID:1765457] Downloading the builder-live.log file, attempt 1 [2025-07-23 10:23:51,674][ INFO][PID:1765457] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-23 10:23:56,691][ INFO][PID:1765457] Periodic builder liveness probe: alive [2025-07-23 10:23:56,699][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:01,713][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:06,719][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:11,723][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:16,726][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:21,728][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:26,730][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:31,731][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:36,733][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:41,735][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:46,744][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:51,753][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:24:56,756][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:01,765][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:06,774][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:11,783][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:16,785][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:21,791][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:26,813][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:31,822][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:36,833][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:41,842][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:46,846][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:51,857][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:25:56,863][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:01,871][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:06,887][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:11,888][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:16,896][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:21,900][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:26,901][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:31,905][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:36,911][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:41,929][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:46,932][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:51,934][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:26:56,939][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:01,950][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:06,951][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:11,967][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:16,979][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:21,990][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:27,063][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:32,088][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:37,129][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:42,270][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:47,678][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:52,935][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:27:58,362][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:03,514][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:08,622][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:13,661][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:18,721][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:24,051][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:29,449][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:34,738][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:39,752][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:44,839][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:49,985][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:28:55,167][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:00,457][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:05,492][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:10,580][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:15,623][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:20,144][ ERROR][PID:1765457] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-23 10:29:20,903][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:26,040][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:30,148][WARNING][PID:1765457] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-23 10:29:31,101][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:36,235][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:40,151][ INFO][PID:1765457] Downloading the builder-live.log file, attempt 2 [2025-07-23 10:29:40,161][ INFO][PID:1765457] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-23 10:29:41,559][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:46,715][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:51,989][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:29:57,043][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:02,183][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:07,371][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:12,395][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:17,999][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:23,008][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:28,108][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:33,138][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:38,208][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:40,347][ ERROR][PID:1765457] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-23 10:30:43,294][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:48,666][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:50,364][WARNING][PID:1765457] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-23 10:30:53,888][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:30:59,103][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:00,365][ INFO][PID:1765457] Downloading the builder-live.log file, attempt 3 [2025-07-23 10:31:00,369][ INFO][PID:1765457] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-23 10:31:04,169][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:09,319][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:14,481][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:19,696][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:25,000][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:30,319][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:35,362][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:40,375][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:45,493][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:50,531][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:31:55,570][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:00,590][ ERROR][PID:1765457] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-23 10:32:00,693][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:06,034][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:10,621][WARNING][PID:1765457] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-23 10:32:11,303][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:16,372][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:20,623][ INFO][PID:1765457] Downloading the builder-live.log file, attempt 4 [2025-07-23 10:32:20,630][ INFO][PID:1765457] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-23 10:32:21,583][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:26,749][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:32,019][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:37,075][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:42,084][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:47,237][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:52,376][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:32:57,403][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:02,522][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:07,559][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:12,572][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:17,592][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:20,913][ ERROR][PID:1765457] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-23 10:33:22,628][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:27,631][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:30,938][ ERROR][PID:1765457] Giving up for unstable SSH, failures: 1753266570.1484585, 1753266650.3641431, 1753266730.6209462, 1753266810.93809 [2025-07-23 10:33:30,942][ ERROR][PID:1765457] Re-try request for task on 'ResallocHost, ticket_id=4063183, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05756879_20250723_101951, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-23 10:33:30,949][ INFO][PID:1765457] Releasing VM back to pool [2025-07-23 10:33:31,061][ INFO][PID:1765457] Retry #1 (on other host) [2025-07-23 10:33:31,091][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:31,107][ INFO][PID:1765457] VM allocation process starts [2025-07-23 10:33:31,231][ INFO][PID:1765457] Trying to allocate VM: ResallocHost, ticket_id=4063553, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-23 10:33:36,250][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:41,256][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:46,262][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:51,281][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:33:56,286][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:01,288][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:06,318][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:11,320][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:16,342][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:21,357][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:26,363][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:31,364][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:36,377][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:41,403][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:46,408][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:51,416][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:34:56,430][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:01,445][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:06,449][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:11,477][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:16,490][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:21,491][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:26,507][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:31,509][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:36,514][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:41,528][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:46,539][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:51,544][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:35:56,547][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:01,578][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:06,629][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:11,660][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:16,676][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:21,690][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:26,719][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:31,731][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:36,749][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:41,754][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:46,762][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:51,770][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:36:56,785][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:01,793][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:06,962][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:12,270][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:17,347][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:22,549][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:27,710][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:33,032][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:38,413][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:43,605][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:48,747][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:50,178][ INFO][PID:1765457] Allocated host ResallocHost, ticket_id=4063553, hostname=140.211.168.189, name=copr_osuosl_p09_prod_05757150_20250723_103220, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-23 10:37:50,186][ INFO][PID:1765457] Allocating ssh connection to builder [2025-07-23 10:37:50,202][ INFO][PID:1765457] Checking that builder machine is OK [2025-07-23 10:37:51,752][ INFO][PID:1765457] Running remote command: copr-builder-ready epel-9-ppc64le [2025-07-23 10:37:52,950][ INFO][PID:1765457] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-07-23 10:37:52,952][ INFO][PID:1765457] Filling build.info file with builder info [2025-07-23 10:37:52,968][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:37:52,970][ INFO][PID:1765457] Not re-notifying FE and msg buses for the new host. [2025-07-23 10:37:52,970][ INFO][PID:1765457] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9311979-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2025-07-23 10:37:54,369][ INFO][PID:1765457] Downloading the builder-live.log file, attempt 1 [2025-07-23 10:37:54,374][ INFO][PID:1765457] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-07-23 10:37:59,412][ INFO][PID:1765457] Periodic builder liveness probe: alive [2025-07-23 10:37:59,420][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:04,436][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:09,445][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:14,451][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:19,456][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:24,488][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:29,499][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:34,502][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:39,719][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:45,034][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:50,358][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:38:55,801][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:01,222][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:06,548][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:12,403][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:17,627][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:23,215][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:28,258][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:33,296][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:38,350][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:43,577][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:48,886][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:53,912][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:39:59,021][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:40:04,228][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:40:09,254][ INFO][PID:1765457] Checking for cancel request [2025-07-23 10:40:09,475][ INFO][PID:1765457] Downloading results from builder [2025-07-23 10:40:09,475][ INFO][PID:1765457] rsyncing of mockbuilder@140.211.168.189:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter started [2025-07-23 10:40:09,477][ INFO][PID:1765457] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.189:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/ &> /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/build-09311979.rsync.log [2025-07-23 10:40:11,171][ INFO][PID:1765457] rsyncing finished. [2025-07-23 10:40:11,173][ INFO][PID:1765457] Releasing VM back to pool [2025-07-23 10:40:11,185][ INFO][PID:1765457] Searching for 'success' file in resultdir [2025-07-23 10:40:11,186][ ERROR][PID:1765457] Build failed: Backend process error: No success file => build failure [2025-07-23 10:40:11,188][ INFO][PID:1765457] Finished build: id=9311979 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/nucleo/freerouter chroot=epel-9-ppc64le [2025-07-23 10:40:11,191][ ERROR][PID:1765457] Backend process error: No success file => build failure [2025-07-23 10:40:11,192][ INFO][PID:1765457] Worker failed build, took 138.2227110862732 [2025-07-23 10:40:11,194][ INFO][PID:1765457] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "https://api.github.com/users/nuqleo", "ended_on": 1753267211.1928422, "started_on": 1753267072.9701312, "submitted_on": null, "status": 0, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9311979-epel-9-ppc64le", "build_id": 9311979, "package_name": "freerouter", "package_version": "25.7.22-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "a679ffb945b21af63565434e777560823c2e50e0", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09311979-freerouter", "built_packages": "", "id": 9311979, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2025-07-23 10:40:11,241][ INFO][PID:1765457] Sending fedora-messaging bus message in build.end [2025-07-23 10:40:11,277][ INFO][PID:1765457] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/builder-live.log by gzip [2025-07-23 10:40:11,286][ INFO][PID:1765457] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/builder-live.log' as PID 1926023 [2025-07-23 10:40:11,293][ INFO][PID:1765457] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/builder-live.log) [2025-07-23 10:40:11,294][ INFO][PID:1765457] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/backend.log by gzip [2025-07-23 10:40:11,296][ INFO][PID:1765457] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09311979-freerouter/backend.log' as PID 1926029