[2026-01-01 02:42:19,189][ INFO][PID:4085415] Marking build as starting [2026-01-01 02:42:19,357][ INFO][PID:4085415] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-01 02:42:19,386][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:19,386][ INFO][PID:4085415] VM allocation process starts [2026-01-01 02:42:19,398][ INFO][PID:4085415] Trying to allocate VM: ResallocHost, ticket_id=601946, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 02:42:24,400][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:29,401][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:34,402][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:39,403][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:44,404][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:49,405][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:54,406][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:42:59,407][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:04,408][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:09,409][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:14,410][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:19,411][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:24,412][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:29,414][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:34,416][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:39,417][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:44,418][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:49,420][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:54,421][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:43:59,422][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:04,423][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:07,480][ INFO][PID:4085415] Allocated host ResallocHost, ticket_id=601946, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00875395_20260101_023930, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 02:44:07,481][ INFO][PID:4085415] Allocating ssh connection to builder [2026-01-01 02:44:07,481][ INFO][PID:4085415] Checking that builder machine is OK [2026-01-01 02:44:08,453][ INFO][PID:4085415] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-01 02:44:08,931][ INFO][PID:4085415] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-01 02:44:08,932][ INFO][PID:4085415] Filling build.info file with builder info [2026-01-01 02:44:08,932][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:08,933][ INFO][PID:4085415] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "keithbowes", "project_name": "deponejo", "project_dirname": "deponejo", "submitter": "keithbowes", "ended_on": null, "started_on": 1767235448.9333131, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9966429-fedora-rawhide-ppc64le", "build_id": 9966429, "package_name": "waybar", "package_version": "0.14.0-1.2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/waybar", "git_hash": "9f96e88653bb068dc6792f2ec5cd5aeb90e2625e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "keithbowes/deponejo--keithbowes", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo", "result_dir": "09966429-waybar", "built_packages": "", "id": 9966429, "mockchain_macros": { "copr_username": "keithbowes", "copr_projectname": "deponejo", "vendor": "Fedora Project COPR (keithbowes/deponejo)" } } ] } [2026-01-01 02:44:09,040][ INFO][PID:4085415] Sending fedora-messaging bus message in build.start [2026-01-01 02:44:09,593][ INFO][PID:4085415] Sending fedora-messaging bus message in chroot.start [2026-01-01 02:44:09,624][ INFO][PID:4085415] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9966429-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-01 02:44:10,647][ INFO][PID:4085415] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c194' (ED25519) to the list of known hosts. [2026-01-01 02:44:10,648][ INFO][PID:4085415] Downloading the builder-live.log file, attempt 1 [2026-01-01 02:44:10,650][ INFO][PID:4085415] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c194 copr-rpmbuild-log [2026-01-01 02:44:15,654][ INFO][PID:4085415] Periodic builder liveness probe: alive [2026-01-01 02:44:15,655][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:20,655][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:25,656][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:30,657][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:35,658][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:40,659][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:45,661][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:50,662][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:44:55,663][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:00,664][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:05,665][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:10,666][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:15,667][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:20,668][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:25,669][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:30,670][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:35,671][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:40,672][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:45,673][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:50,674][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:45:55,675][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:00,676][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:05,678][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:10,679][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:15,679][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:20,681][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:25,682][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:30,683][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:35,684][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:40,686][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:45,687][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:50,688][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:46:55,689][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:00,690][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:05,691][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:10,692][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:15,693][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:20,694][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:25,695][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:30,696][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:35,698][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:40,700][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:45,701][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:50,702][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:47:55,703][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:00,704][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:05,706][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:10,707][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:15,709][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:20,711][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:25,712][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:30,713][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:35,714][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:40,715][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:43,370][ ERROR][PID:4085415] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-01 02:48:45,716][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:50,717][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:48:53,370][WARNING][PID:4085415] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-01 02:48:55,718][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:00,721][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:03,371][ INFO][PID:4085415] Downloading the builder-live.log file, attempt 2 [2026-01-01 02:49:03,376][ INFO][PID:4085415] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c194 copr-rpmbuild-log [2026-01-01 02:49:05,722][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:10,723][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:15,725][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:20,727][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:25,729][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:30,731][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:35,733][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:40,734][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:45,735][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:50,736][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:49:55,738][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:00,739][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:05,741][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:10,744][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:15,745][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:20,746][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:25,747][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:30,749][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:35,750][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:40,751][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:45,752][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:50,758][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:50:55,759][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:00,760][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:05,761][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:10,762][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:15,763][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:20,765][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:25,766][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:30,767][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:35,769][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:40,770][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:45,771][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:50,772][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:51:55,773][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:00,775][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:05,776][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:10,777][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:15,780][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:20,781][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:25,782][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:30,783][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:35,786][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:40,788][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:45,789][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:50,790][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:52:55,792][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:00,793][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:05,794][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:10,795][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:15,796][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:20,797][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:25,798][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:30,800][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:35,801][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:53:38,034][ INFO][PID:4085415] Downloading results from builder [2026-01-01 02:53:38,034][ INFO][PID:4085415] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar started [2026-01-01 02:53:38,035][ INFO][PID:4085415] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/build-09966429.rsync.log [2026-01-01 02:54:38,111][ INFO][PID:4085415] rsyncing finished. [2026-01-01 02:54:38,111][ ERROR][PID:4085415] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-01 02:54:38,112][ ERROR][PID:4085415] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-01 02:54:48,112][ INFO][PID:4085415] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar started [2026-01-01 02:54:48,115][ INFO][PID:4085415] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/build-09966429.rsync.log [2026-01-01 02:55:48,198][ INFO][PID:4085415] rsyncing finished. [2026-01-01 02:55:48,199][ ERROR][PID:4085415] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-01 02:55:48,200][ ERROR][PID:4085415] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-01 02:55:58,201][ INFO][PID:4085415] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar started [2026-01-01 02:55:58,203][ INFO][PID:4085415] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/build-09966429.rsync.log [2026-01-01 02:56:58,310][ INFO][PID:4085415] rsyncing finished. [2026-01-01 02:56:58,311][ ERROR][PID:4085415] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-01 02:56:58,311][ ERROR][PID:4085415] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-01 02:57:08,313][ ERROR][PID:4085415] Re-try request for task on 'ResallocHost, ticket_id=601946, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00875395_20260101_023930, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts [2026-01-01 02:57:08,313][ INFO][PID:4085415] Releasing VM back to pool [2026-01-01 02:57:08,331][ INFO][PID:4085415] Retry #1 (on other host) [2026-01-01 02:57:08,331][ INFO][PID:4085415] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-01 02:57:08,332][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:08,333][ INFO][PID:4085415] VM allocation process starts [2026-01-01 02:57:08,344][ INFO][PID:4085415] Trying to allocate VM: ResallocHost, ticket_id=602240, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 02:57:11,365][ INFO][PID:4085415] Allocated host ResallocHost, ticket_id=602240, hostname=140.211.168.243, name=copr_osuosl_p09_prod_00875402_20260101_023959, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 02:57:11,366][ INFO][PID:4085415] Allocating ssh connection to builder [2026-01-01 02:57:11,367][ INFO][PID:4085415] Checking that builder machine is OK [2026-01-01 02:57:12,810][ INFO][PID:4085415] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-01 02:57:13,897][ INFO][PID:4085415] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-01 02:57:13,897][ INFO][PID:4085415] Filling build.info file with builder info [2026-01-01 02:57:13,905][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:13,906][ INFO][PID:4085415] Not re-notifying FE and msg buses for the new host. [2026-01-01 02:57:13,907][ INFO][PID:4085415] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9966429-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-01 02:57:15,262][ INFO][PID:4085415] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.243' (ED25519) to the list of known hosts. [2026-01-01 02:57:15,263][ INFO][PID:4085415] Downloading the builder-live.log file, attempt 1 [2026-01-01 02:57:15,265][ INFO][PID:4085415] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log [2026-01-01 02:57:20,275][ INFO][PID:4085415] Periodic builder liveness probe: alive [2026-01-01 02:57:20,276][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:25,277][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:30,278][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:35,279][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:40,280][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:45,281][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:50,282][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:57:55,283][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:00,284][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:05,285][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:10,287][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:15,288][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:20,290][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:25,291][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:30,292][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:35,293][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:40,294][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:45,295][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:50,296][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:58:55,297][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:00,298][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:05,300][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:10,301][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:15,302][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:20,303][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:25,305][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:30,307][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:35,308][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:40,309][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:45,310][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:50,312][ INFO][PID:4085415] Checking for cancel request [2026-01-01 02:59:55,313][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:00,314][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:05,316][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:10,317][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:15,318][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:20,319][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:25,320][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:30,321][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:35,322][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:40,327][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:45,328][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:50,329][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:00:55,330][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:00,340][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:05,345][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:10,347][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:15,348][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:20,350][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:25,352][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:30,353][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:35,354][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:40,355][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:45,356][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:50,357][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:01:55,358][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:00,359][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:05,361][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:10,362][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:15,363][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:20,364][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:25,366][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:30,368][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:35,372][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:40,373][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:45,375][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:50,376][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:02:55,378][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:00,383][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:05,391][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:10,393][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:15,394][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:20,395][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:25,397][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:30,404][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:35,405][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:40,409][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:45,411][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:50,412][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:03:55,414][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:00,423][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:05,424][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:10,428][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:15,432][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:20,435][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:25,442][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:30,458][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:35,460][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:40,465][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:45,471][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:50,476][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:04:55,481][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:00,482][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:05,483][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:10,485][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:15,487][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:20,489][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:25,490][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:30,491][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:35,492][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:40,493][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:45,495][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:50,500][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:05:55,501][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:00,538][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:05,539][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:10,540][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:15,542][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:20,545][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:25,546][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:30,574][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:35,576][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:40,577][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:45,578][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:50,579][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:06:55,580][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:00,581][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:05,586][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:10,588][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:15,590][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:20,601][ INFO][PID:4085415] Periodic builder liveness probe: alive [2026-01-01 03:07:20,601][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:25,606][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:30,608][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:35,645][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:40,647][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:45,708][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:50,710][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:07:55,893][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:00,946][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:05,947][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:10,949][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:15,950][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:20,951][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:25,953][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:31,035][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:36,118][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:41,119][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:46,131][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:51,132][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:08:56,135][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:01,149][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:06,193][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:11,196][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:16,197][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:21,199][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:26,201][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:31,203][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:36,209][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:41,211][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:46,212][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:51,219][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:09:56,221][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:10:01,259][ INFO][PID:4085415] Checking for cancel request [2026-01-01 03:10:02,106][ INFO][PID:4085415] Downloading results from builder [2026-01-01 03:10:02,107][ INFO][PID:4085415] rsyncing of mockbuilder@140.211.168.243:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar started [2026-01-01 03:10:02,108][ INFO][PID:4085415] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.243:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/build-09966429.rsync.log [2026-01-01 03:10:05,105][ INFO][PID:4085415] rsyncing finished. [2026-01-01 03:10:05,106][ INFO][PID:4085415] Releasing VM back to pool [2026-01-01 03:10:05,117][ INFO][PID:4085415] Searching for 'success' file in resultdir [2026-01-01 03:10:05,117][ INFO][PID:4085415] Going to sign pkgs from source: 9966429-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le [2026-01-01 03:10:05,118][ INFO][PID:4085415] Calling '/bin/sign -u keithbowes#deponejo@copr.fedorahosted.org -p' (attempt #1) [2026-01-01 03:10:05,388][ INFO][PID:4085415] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-0.14.0-1.2.fc44.ppc64le.rpm' (attempt #1) [2026-01-01 03:10:06,365][ INFO][PID:4085415] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-0.14.0-1.2.fc44.ppc64le.rpm [2026-01-01 03:10:06,366][ INFO][PID:4085415] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-debugsource-0.14.0-1.2.fc44.ppc64le.rpm' (attempt #1) [2026-01-01 03:10:07,086][ INFO][PID:4085415] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-debugsource-0.14.0-1.2.fc44.ppc64le.rpm [2026-01-01 03:10:07,087][ INFO][PID:4085415] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-0.14.0-1.2.fc44.src.rpm' (attempt #1) [2026-01-01 03:10:07,898][ INFO][PID:4085415] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-0.14.0-1.2.fc44.src.rpm [2026-01-01 03:10:07,900][ INFO][PID:4085415] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-debuginfo-0.14.0-1.2.fc44.ppc64le.rpm' (attempt #1) [2026-01-01 03:10:08,928][ INFO][PID:4085415] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/waybar-debuginfo-0.14.0-1.2.fc44.ppc64le.rpm [2026-01-01 03:10:08,930][ INFO][PID:4085415] Sign done [2026-01-01 03:10:08,933][ INFO][PID:4085415] Incremental createrepo run, adding 09966429-waybar into https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/fedora-rawhide-ppc64le, (auto-create-repo=True) [2026-01-01 03:10:08,939][ INFO][PID:4085415] Running command 'copr-repo --batched /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le --add 09966429-waybar' as PID 109592 [2026-01-01 03:10:43,169][ INFO][PID:4085415] Finished after 34 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le --add 09966429-waybar) [2026-01-01 03:10:43,170][ INFO][PID:4085415] Getting build details [2026-01-01 03:10:43,171][ INFO][PID:4085415] Listing built binary packages in /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar [2026-01-01 03:10:43,171][ INFO][PID:4085415] Built packages: ['waybar-debuginfo 0.14.0', 'waybar 0.14.0', 'waybar-debugsource 0.14.0'] [2026-01-01 03:10:43,172][ INFO][PID:4085415] build details: {'built_packages': 'waybar-debuginfo 0.14.0\nwaybar 0.14.0\nwaybar-debugsource 0.14.0'} [2026-01-01 03:10:43,172][ INFO][PID:4085415] Retrieving pubkey [2026-01-01 03:10:43,173][ INFO][PID:4085415] Calling '/bin/sign -u keithbowes#deponejo@copr.fedorahosted.org -p' (attempt #1) [2026-01-01 03:10:43,370][ INFO][PID:4085415] Added pubkey for user keithbowes project deponejo into: /var/lib/copr/public_html/results/keithbowes/deponejo/pubkey.gpg [2026-01-01 03:10:43,371][ INFO][PID:4085415] Finished build: id=9966429 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/keithbowes/deponejo chroot=fedora-rawhide-ppc64le [2026-01-01 03:10:43,375][ INFO][PID:4085415] Worker succeeded build, took 809.4689054489136 [2026-01-01 03:10:43,376][ INFO][PID:4085415] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "keithbowes", "project_name": "deponejo", "project_dirname": "deponejo", "submitter": "keithbowes", "ended_on": 1767237043.3751254, "started_on": 1767236233.90622, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9966429-fedora-rawhide-ppc64le", "build_id": 9966429, "package_name": "waybar", "package_version": "0.14.0-1.2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/waybar", "git_hash": "9f96e88653bb068dc6792f2ec5cd5aeb90e2625e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "keithbowes/deponejo--keithbowes", "results": { "packages": [ { "name": "waybar-debuginfo", "epoch": null, "version": "0.14.0", "release": "1.2.fc44", "arch": "ppc64le" }, { "name": "waybar", "epoch": null, "version": "0.14.0", "release": "1.2.fc44", "arch": "ppc64le" }, { "name": "waybar-debugsource", "epoch": null, "version": "0.14.0", "release": "1.2.fc44", "arch": "ppc64le" }, { "name": "waybar", "epoch": null, "version": "0.14.0", "release": "1.2.fc44", "arch": "src" } ] }, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo", "result_dir": "09966429-waybar", "built_packages": "waybar-debuginfo 0.14.0\nwaybar 0.14.0\nwaybar-debugsource 0.14.0", "id": 9966429, "mockchain_macros": { "copr_username": "keithbowes", "copr_projectname": "deponejo", "vendor": "Fedora Project COPR (keithbowes/deponejo)" } } ] } [2026-01-01 03:10:43,475][ INFO][PID:4085415] Sending fedora-messaging bus message in build.end [2026-01-01 03:10:43,510][ INFO][PID:4085415] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/builder-live.log by gzip [2026-01-01 03:10:43,516][ INFO][PID:4085415] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/builder-live.log' as PID 114007 [2026-01-01 03:10:43,572][ INFO][PID:4085415] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/builder-live.log) [2026-01-01 03:10:43,573][ INFO][PID:4085415] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/backend.log by gzip [2026-01-01 03:10:43,575][ INFO][PID:4085415] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/fedora-rawhide-ppc64le/09966429-waybar/backend.log' as PID 114021