[2026-01-12 13:55:44,069][ INFO][PID:41806] Marking build as starting [2026-01-12 13:55:44,145][ INFO][PID:41806] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-rawhide-ppc64le//repodata/repomd.xml exists [2026-01-12 13:55:44,558][ INFO][PID:41806] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le//repodata/repomd.xml exists [2026-01-12 13:55:45,068][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:55:45,089][ INFO][PID:41806] VM allocation process starts [2026-01-12 13:55:45,131][ INFO][PID:41806] Trying to allocate VM: ResallocHost, ticket_id=777202, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 13:55:48,255][ INFO][PID:41806] Allocated host ResallocHost, ticket_id=777202, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_01147285_20260112_134828, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 13:55:48,256][ INFO][PID:41806] Allocating ssh connection to builder [2026-01-12 13:55:48,257][ INFO][PID:41806] Checking that builder machine is OK [2026-01-12 13:55:49,252][ INFO][PID:41806] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-12 13:55:49,829][ INFO][PID:41806] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-12 13:55:49,831][ INFO][PID:41806] Filling build.info file with builder info [2026-01-12 13:55:49,832][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:55:49,837][ INFO][PID:41806] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": null, "started_on": 1768226149.8370037, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10000949-fedora-rawhide-ppc64le", "build_id": 10000949, "package_name": "copr-cli", "package_version": "2.4.post1-1.git.16.0474e57", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/copr-cli", "git_hash": "049517af3793a351bcfa7785beb8ea4ee928a340", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--778da624-a730-4448-bda3-053e537b31fc", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-rawhide-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "10000949-copr-cli", "built_packages": "", "id": 10000949, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-12 13:55:49,938][ INFO][PID:41806] Sending fedora-messaging bus message in build.start [2026-01-12 13:55:51,046][ INFO][PID:41806] Sending fedora-messaging bus message in chroot.start [2026-01-12 13:55:51,097][ INFO][PID:41806] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10000949-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-12 13:55:52,169][ INFO][PID:41806] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts. [2026-01-12 13:55:52,172][ INFO][PID:41806] Downloading the builder-live.log file, attempt 1 [2026-01-12 13:55:52,175][ INFO][PID:41806] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2026-01-12 13:55:57,213][ INFO][PID:41806] Periodic builder liveness probe: alive [2026-01-12 13:55:57,215][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:02,223][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:07,229][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:12,232][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:17,233][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:22,236][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:27,257][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:32,260][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:37,262][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:42,266][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:47,270][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:52,275][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:56:57,282][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:02,284][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:07,288][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:12,307][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:17,313][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:22,316][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:27,334][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:32,338][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:37,346][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:42,347][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:47,352][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:52,355][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:57:57,361][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:02,363][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:07,367][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:12,371][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:17,374][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:22,380][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:27,387][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:32,388][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:37,393][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:42,394][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:47,400][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:52,403][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:58:57,444][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:02,446][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:07,449][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:12,454][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:17,457][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:22,467][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:27,468][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:32,470][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:37,477][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:42,484][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:47,512][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:51,381][ ERROR][PID:41806] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 13:59:52,516][ INFO][PID:41806] Checking for cancel request [2026-01-12 13:59:57,521][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:01,391][WARNING][PID:41806] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:00:02,527][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:07,538][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:11,393][ INFO][PID:41806] Downloading the builder-live.log file, attempt 2 [2026-01-12 14:00:11,397][ INFO][PID:41806] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2026-01-12 14:00:12,541][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:17,546][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:22,552][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:27,568][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:32,574][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:37,580][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:42,583][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:47,589][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:52,592][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:00:57,598][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:02,600][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:07,603][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:11,499][ ERROR][PID:41806] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:01:12,605][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:17,608][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:21,544][WARNING][PID:41806] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:01:22,612][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:27,614][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:31,545][ INFO][PID:41806] Downloading the builder-live.log file, attempt 3 [2026-01-12 14:01:31,552][ INFO][PID:41806] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2026-01-12 14:01:32,633][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:37,635][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:42,648][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:47,652][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:52,659][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:01:57,661][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:02,662][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:07,664][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:12,666][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:17,668][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:22,671][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:27,673][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:31,633][ ERROR][PID:41806] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:02:32,677][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:37,678][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:41,644][WARNING][PID:41806] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:02:42,680][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:47,687][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:51,646][ INFO][PID:41806] Downloading the builder-live.log file, attempt 4 [2026-01-12 14:02:51,649][ INFO][PID:41806] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2026-01-12 14:02:52,690][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:02:57,693][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:02,695][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:07,700][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:12,712][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:17,713][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:22,714][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:27,738][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:32,752][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:37,797][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:42,799][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:47,801][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:51,723][ ERROR][PID:41806] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:03:52,821][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:03:57,823][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:01,755][ ERROR][PID:41806] Giving up for unstable SSH, failures: 1768226401.3912175, 1768226481.5448387, 1768226561.6449487, 1768226641.7552133 [2026-01-12 14:04:01,756][ ERROR][PID:41806] Re-try request for task on 'ResallocHost, ticket_id=777202, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_01147285_20260112_134828, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-12 14:04:01,757][ INFO][PID:41806] Releasing VM back to pool [2026-01-12 14:04:01,795][ INFO][PID:41806] Retry #1 (on other host) [2026-01-12 14:04:01,797][ INFO][PID:41806] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-rawhide-ppc64le//repodata/repomd.xml exists [2026-01-12 14:04:02,193][ INFO][PID:41806] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le//repodata/repomd.xml exists [2026-01-12 14:04:02,453][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:02,456][ INFO][PID:41806] VM allocation process starts [2026-01-12 14:04:02,476][ INFO][PID:41806] Trying to allocate VM: ResallocHost, ticket_id=777372, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:04:07,482][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:12,485][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:17,487][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:22,495][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:27,498][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:32,502][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:37,505][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:42,509][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:47,514][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:52,515][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:04:57,520][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:02,521][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:07,522][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:12,523][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:17,525][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:22,535][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:27,540][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:32,543][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:37,561][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:42,568][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:47,569][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:52,573][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:05:57,579][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:02,585][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:07,586][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:12,587][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:17,589][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:22,593][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:27,596][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:32,597][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:37,603][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:42,604][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:47,637][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:52,655][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:06:57,662][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:02,663][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:07,665][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:12,667][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:17,669][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:20,720][ INFO][PID:41806] Allocated host ResallocHost, ticket_id=777372, hostname=140.211.168.61, name=copr_osuosl_p09_prod_01148675_20260112_140308, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:07:20,721][ INFO][PID:41806] Allocating ssh connection to builder [2026-01-12 14:07:20,722][ INFO][PID:41806] Checking that builder machine is OK [2026-01-12 14:07:22,097][ INFO][PID:41806] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-12 14:07:23,107][ INFO][PID:41806] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-12 14:07:23,292][ INFO][PID:41806] Filling build.info file with builder info [2026-01-12 14:07:23,375][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:23,380][ INFO][PID:41806] Not re-notifying FE and msg buses for the new host. [2026-01-12 14:07:23,382][ INFO][PID:41806] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10000949-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-12 14:07:24,871][ INFO][PID:41806] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.61' (ED25519) to the list of known hosts. [2026-01-12 14:07:24,872][ INFO][PID:41806] Downloading the builder-live.log file, attempt 1 [2026-01-12 14:07:24,873][ INFO][PID:41806] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2026-01-12 14:07:29,883][ INFO][PID:41806] Periodic builder liveness probe: alive [2026-01-12 14:07:29,884][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:34,887][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:39,892][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:44,897][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:49,899][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:54,902][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:07:59,903][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:04,904][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:09,906][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:14,907][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:19,910][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:24,912][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:29,915][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:34,920][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:39,923][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:44,925][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:49,941][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:54,942][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:08:59,970][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:09:04,972][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:09:10,031][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:09:15,035][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:09:20,048][ INFO][PID:41806] Checking for cancel request [2026-01-12 14:09:21,783][ INFO][PID:41806] Downloading results from builder [2026-01-12 14:09:21,784][ INFO][PID:41806] rsyncing of mockbuilder@140.211.168.61:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli started [2026-01-12 14:09:21,794][ INFO][PID:41806] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.61:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/build-10000949.rsync.log [2026-01-12 14:09:23,963][ INFO][PID:41806] rsyncing finished. [2026-01-12 14:09:23,964][ INFO][PID:41806] Releasing VM back to pool [2026-01-12 14:09:24,041][ INFO][PID:41806] Searching for 'success' file in resultdir [2026-01-12 14:09:24,043][ INFO][PID:41806] Going to sign pkgs from source: 10000949-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le [2026-01-12 14:09:24,045][ INFO][PID:41806] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-12 14:09:24,344][ INFO][PID:41806] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.src.rpm' (attempt #1) [2026-01-12 14:09:25,124][ INFO][PID:41806] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.src.rpm [2026-01-12 14:09:25,128][ INFO][PID:41806] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.noarch.rpm' (attempt #1) [2026-01-12 14:09:25,910][ INFO][PID:41806] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.noarch.rpm [2026-01-12 14:09:25,915][ INFO][PID:41806] Sign done [2026-01-12 14:09:25,929][ INFO][PID:41806] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.src.rpm [2026-01-12 14:09:26,330][ INFO][PID:41806] [1/2] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.src.rpm [2026-01-12 14:09:26,334][ INFO][PID:41806] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.noarch.rpm [2026-01-12 14:09:26,869][ INFO][PID:41806] [2/2] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.noarch.rpm [2026-01-12 14:09:26,906][ INFO][PID:41806] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-pull-requests%3Apr%3A4115%2Ffedora-rawhide-ppc64le&offset=0&limit=1 [2026-01-12 14:09:27,745][ INFO][PID:41806] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28a-508d-7100-b583-32866c0d48e4/ [2026-01-12 14:09:27,754][ INFO][PID:41806] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28a-508d-7100-b583-32866c0d48e4/ [2026-01-12 14:09:32,956][ INFO][PID:41806] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28a-508d-7100-b583-32866c0d48e4/ [2026-01-12 14:09:32,963][ INFO][PID:41806] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28a-508d-7100-b583-32866c0d48e4/ [2026-01-12 14:09:33,398][ INFO][PID:41806] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-d2ef-79ff-961e-51af2754ebac/ [2026-01-12 14:09:33,399][ INFO][PID:41806] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-d2ef-79ff-961e-51af2754ebac/ [2026-01-12 14:09:33,568][ INFO][PID:41806] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28a-6762-7f20-8304-ed97ca694edb/ [2026-01-12 14:09:33,569][ INFO][PID:41806] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28a-6762-7f20-8304-ed97ca694edb/ [2026-01-12 14:09:38,886][ INFO][PID:41806] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28a-6762-7f20-8304-ed97ca694edb/ [2026-01-12 14:09:38,890][ INFO][PID:41806] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28a-6762-7f20-8304-ed97ca694edb/ [2026-01-12 14:09:39,139][ INFO][PID:41806] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-d2ef-79ff-961e-51af2754ebac/ [2026-01-12 14:09:39,154][ INFO][PID:41806] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-d2ef-79ff-961e-51af2754ebac/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019bb28a-4ae2-7bc4-b60b-1d90b86f9906/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019bb28a-4cf8-74ef-960a-de688e64eb78/']) [2026-01-12 14:09:39,161][ INFO][PID:41806] Getting build details [2026-01-12 14:09:39,167][ INFO][PID:41806] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli [2026-01-12 14:09:39,170][ INFO][PID:41806] Built packages: ['copr-cli 2.4.post1'] [2026-01-12 14:09:39,171][ INFO][PID:41806] build details: {'built_packages': 'copr-cli 2.4.post1'} [2026-01-12 14:09:39,173][ INFO][PID:41806] Retrieving pubkey [2026-01-12 14:09:39,176][ INFO][PID:41806] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-12 14:09:39,481][ INFO][PID:41806] Added pubkey for user @copr project copr-pull-requests into: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/pubkey.gpg [2026-01-12 14:09:39,482][ INFO][PID:41806] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.src.rpm, it is stored in Pulp [2026-01-12 14:09:39,484][ INFO][PID:41806] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/copr-cli-2.4.post1-1.git.16.0474e57.fc44.noarch.rpm, it is stored in Pulp [2026-01-12 14:09:39,487][ INFO][PID:41806] Finished build: id=10000949 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115 chroot=fedora-rawhide-ppc64le [2026-01-12 14:09:39,493][ INFO][PID:41806] Worker succeeded build, took 136.11343955993652 [2026-01-12 14:09:39,494][ INFO][PID:41806] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": 1768226979.4934175, "started_on": 1768226843.379978, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10000949-fedora-rawhide-ppc64le", "build_id": 10000949, "package_name": "copr-cli", "package_version": "2.4.post1-1.git.16.0474e57", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/copr-cli", "git_hash": "049517af3793a351bcfa7785beb8ea4ee928a340", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--778da624-a730-4448-bda3-053e537b31fc", "results": { "packages": [ { "name": "copr-cli", "epoch": null, "version": "2.4.post1", "release": "1.git.16.0474e57.fc44", "arch": "noarch" }, { "name": "copr-cli", "epoch": null, "version": "2.4.post1", "release": "1.git.16.0474e57.fc44", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-rawhide-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "10000949-copr-cli", "built_packages": "copr-cli 2.4.post1", "id": 10000949, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-12 14:09:39,604][ INFO][PID:41806] Sending fedora-messaging bus message in build.end [2026-01-12 14:09:39,651][ INFO][PID:41806] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/builder-live.log by gzip [2026-01-12 14:09:39,656][ INFO][PID:41806] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/builder-live.log' as PID 197196 [2026-01-12 14:09:39,737][ INFO][PID:41806] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/builder-live.log) [2026-01-12 14:09:39,738][ INFO][PID:41806] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/backend.log by gzip [2026-01-12 14:09:39,744][ INFO][PID:41806] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-rawhide-ppc64le/10000949-copr-cli/backend.log' as PID 197214