[2026-01-12 13:59:56,962][ INFO][PID:89076] Marking build as starting [2026-01-12 13:59:57,070][ INFO][PID:89076] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 13:59:57,783][ INFO][PID:89076] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 13:59:58,590][ INFO][PID:89076] Checking for cancel request [2026-01-12 13:59:58,600][ INFO][PID:89076] VM allocation process starts [2026-01-12 13:59:58,684][ INFO][PID:89076] Trying to allocate VM: ResallocHost, ticket_id=777307, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:00:03,691][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:08,694][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:13,697][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:18,700][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:23,702][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:28,709][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:33,723][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:38,725][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:43,728][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:48,730][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:53,732][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:00:58,735][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:03,738][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:08,743][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:13,745][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:18,747][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:23,753][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:28,757][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:33,759][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:38,764][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:43,789][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:47,010][ INFO][PID:89076] Allocated host ResallocHost, ticket_id=777307, hostname=2620:52:6:1161:dead:beef:cafe:c14b, name=vmhost_p09_03_prod_01147843_20260112_135532, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:01:47,011][ INFO][PID:89076] Allocating ssh connection to builder [2026-01-12 14:01:47,020][ INFO][PID:89076] Checking that builder machine is OK [2026-01-12 14:01:48,044][ INFO][PID:89076] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 14:01:48,598][ INFO][PID:89076] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 14:01:48,600][ INFO][PID:89076] Filling build.info file with builder info [2026-01-12 14:01:48,603][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:01:48,605][ INFO][PID:89076] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": null, "started_on": 1768226508.6053586, "submitted_on": null, "status": 3, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10000958-fedora-43-ppc64le", "build_id": 10000958, "package_name": "python-copr", "package_version": "2.5.post1-1.git.14.3f3d561", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/python-copr", "git_hash": "489bee82655ffbc2be1c15a0198516be8358017f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--16371bb1-17bc-431d-af4c-6c5bb8b9f906", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-43-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "10000958-python-copr", "built_packages": "", "id": 10000958, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-12 14:01:48,714][ INFO][PID:89076] Sending fedora-messaging bus message in build.start [2026-01-12 14:01:49,559][ INFO][PID:89076] Sending fedora-messaging bus message in chroot.start [2026-01-12 14:01:49,600][ INFO][PID:89076] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10000958-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 14:01:50,680][ INFO][PID:89076] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14b' (ED25519) to the list of known hosts. [2026-01-12 14:01:50,682][ INFO][PID:89076] Downloading the builder-live.log file, attempt 1 [2026-01-12 14:01:50,687][ INFO][PID:89076] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log [2026-01-12 14:01:55,693][ INFO][PID:89076] Periodic builder liveness probe: alive [2026-01-12 14:01:55,694][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:00,695][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:05,697][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:10,700][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:15,703][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:20,705][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:25,711][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:30,713][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:35,716][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:40,721][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:45,726][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:50,735][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:02:55,738][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:00,740][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:05,741][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:10,746][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:15,748][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:20,752][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:25,754][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:30,758][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:35,761][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:40,762][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:45,778][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:50,780][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:03:55,782][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:00,784][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:05,786][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:10,794][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:15,798][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:20,825][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:25,831][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:30,837][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:35,842][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:40,845][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:45,856][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:46,420][ ERROR][PID:89076] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:04:50,862][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:55,865][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:04:56,421][WARNING][PID:89076] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:05:00,867][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:05,868][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:06,423][ INFO][PID:89076] Downloading the builder-live.log file, attempt 2 [2026-01-12 14:05:06,424][ INFO][PID:89076] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log [2026-01-12 14:05:10,872][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:15,884][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:20,886][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:25,890][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:30,891][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:35,895][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:40,901][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:45,904][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:50,905][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:05:55,909][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:00,915][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:05,918][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:06,497][ ERROR][PID:89076] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:06:10,923][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:15,924][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:16,519][WARNING][PID:89076] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:06:20,926][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:25,927][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:26,520][ INFO][PID:89076] Downloading the builder-live.log file, attempt 3 [2026-01-12 14:06:26,522][ INFO][PID:89076] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log [2026-01-12 14:06:30,928][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:35,943][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:40,948][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:45,954][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:50,967][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:06:55,968][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:00,970][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:05,974][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:10,977][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:15,980][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:20,983][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:25,985][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:26,610][ ERROR][PID:89076] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:07:30,987][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:35,991][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:36,618][WARNING][PID:89076] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:07:40,995][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:45,999][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:46,619][ INFO][PID:89076] Downloading the builder-live.log file, attempt 4 [2026-01-12 14:07:46,621][ INFO][PID:89076] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log [2026-01-12 14:07:51,002][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:07:56,004][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:01,005][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:06,008][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:11,010][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:16,011][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:21,016][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:26,021][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:31,022][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:36,025][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:41,028][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:46,033][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:46,694][ ERROR][PID:89076] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:08:51,068][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:56,091][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:56,695][ ERROR][PID:89076] Giving up for unstable SSH, failures: 1768226696.421786, 1768226776.51982, 1768226856.6185052, 1768226936.6956944 [2026-01-12 14:08:56,697][ ERROR][PID:89076] Re-try request for task on 'ResallocHost, ticket_id=777307, hostname=2620:52:6:1161:dead:beef:cafe:c14b, name=vmhost_p09_03_prod_01147843_20260112_135532, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-12 14:08:56,698][ INFO][PID:89076] Releasing VM back to pool [2026-01-12 14:08:56,769][ INFO][PID:89076] Retry #1 (on other host) [2026-01-12 14:08:56,770][ INFO][PID:89076] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 14:08:57,067][ INFO][PID:89076] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 14:08:57,496][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:08:57,499][ INFO][PID:89076] VM allocation process starts [2026-01-12 14:08:57,518][ INFO][PID:89076] Trying to allocate VM: ResallocHost, ticket_id=777535, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:09:02,523][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:07,526][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:12,550][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:17,555][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:22,564][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:25,632][ INFO][PID:89076] Allocated host ResallocHost, ticket_id=777535, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_01148837_20260112_140434, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:09:25,634][ INFO][PID:89076] Allocating ssh connection to builder [2026-01-12 14:09:25,636][ INFO][PID:89076] Checking that builder machine is OK [2026-01-12 14:09:26,759][ INFO][PID:89076] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 14:09:27,304][ INFO][PID:89076] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 14:09:27,305][ INFO][PID:89076] Filling build.info file with builder info [2026-01-12 14:09:27,378][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:27,384][ INFO][PID:89076] Not re-notifying FE and msg buses for the new host. [2026-01-12 14:09:27,385][ INFO][PID:89076] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10000958-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 14:09:28,550][ INFO][PID:89076] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18a' (ED25519) to the list of known hosts. [2026-01-12 14:09:28,555][ INFO][PID:89076] Downloading the builder-live.log file, attempt 1 [2026-01-12 14:09:28,560][ INFO][PID:89076] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log [2026-01-12 14:09:33,564][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:38,567][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:43,571][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:48,573][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:53,577][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:09:58,583][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:03,585][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:08,601][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:13,606][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:18,608][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:23,609][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:28,617][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:33,622][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:38,624][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:43,627][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:48,629][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:53,632][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:10:58,637][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:03,640][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:08,643][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:13,645][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:18,648][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:23,652][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:28,655][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:33,656][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:38,658][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:43,661][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:48,664][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:53,668][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:11:58,687][ INFO][PID:89076] Periodic builder liveness probe: alive [2026-01-12 14:11:58,692][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:03,693][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:08,694][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:13,701][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:18,702][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:23,708][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:28,710][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:33,712][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:38,714][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:43,721][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:48,724][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:53,725][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:12:58,728][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:03,731][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:08,732][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:13,733][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:18,735][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:23,737][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:28,770][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:33,772][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:38,774][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:43,777][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:48,779][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:53,781][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:13:58,782][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:03,784][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:08,785][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:13,786][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:18,789][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:23,790][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:28,791][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:33,792][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:38,794][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:43,797][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:48,798][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:53,799][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:14:58,800][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:03,840][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:08,859][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:13,863][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:18,865][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:23,866][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:28,868][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:33,895][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:38,896][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:43,901][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:48,905][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:53,907][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:15:58,908][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:03,909][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:08,916][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:14,088][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:19,095][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:24,100][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:29,105][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:34,106][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:39,109][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:44,113][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:49,116][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:54,124][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:16:59,127][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:17:04,128][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:17:09,134][ INFO][PID:89076] Checking for cancel request [2026-01-12 14:17:11,464][ INFO][PID:89076] Downloading results from builder [2026-01-12 14:17:11,465][ INFO][PID:89076] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr started [2026-01-12 14:17:11,466][ INFO][PID:89076] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/build-10000958.rsync.log [2026-01-12 14:17:12,263][ INFO][PID:89076] rsyncing finished. [2026-01-12 14:17:12,264][ INFO][PID:89076] Releasing VM back to pool [2026-01-12 14:17:12,276][ INFO][PID:89076] Searching for 'success' file in resultdir [2026-01-12 14:17:12,276][ INFO][PID:89076] Going to sign pkgs from source: 10000958-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le [2026-01-12 14:17:12,277][ INFO][PID:89076] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-12 14:17:12,550][ INFO][PID:89076] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-doc-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm' (attempt #1) [2026-01-12 14:17:13,282][ INFO][PID:89076] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-doc-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm [2026-01-12 14:17:13,286][ INFO][PID:89076] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-2.5.post1-1.git.14.3f3d561.fc43.src.rpm' (attempt #1) [2026-01-12 14:17:14,022][ INFO][PID:89076] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-2.5.post1-1.git.14.3f3d561.fc43.src.rpm [2026-01-12 14:17:14,023][ INFO][PID:89076] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python3-copr-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm' (attempt #1) [2026-01-12 14:17:14,754][ INFO][PID:89076] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python3-copr-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm [2026-01-12 14:17:14,755][ INFO][PID:89076] Sign done [2026-01-12 14:17:14,756][ INFO][PID:89076] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-doc-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm [2026-01-12 14:17:15,083][ INFO][PID:89076] [1/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-doc-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm [2026-01-12 14:17:15,084][ INFO][PID:89076] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-2.5.post1-1.git.14.3f3d561.fc43.src.rpm [2026-01-12 14:17:15,586][ INFO][PID:89076] [2/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-2.5.post1-1.git.14.3f3d561.fc43.src.rpm [2026-01-12 14:17:15,587][ INFO][PID:89076] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python3-copr-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm [2026-01-12 14:17:15,937][ INFO][PID:89076] [3/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python3-copr-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm [2026-01-12 14:17:15,943][ INFO][PID:89076] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-pull-requests%3Apr%3A4115%2Ffedora-43-ppc64le&offset=0&limit=1 [2026-01-12 14:17:16,251][ INFO][PID:89076] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb291-76b8-768a-b34f-65e348840620/ [2026-01-12 14:17:16,251][ INFO][PID:89076] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb291-76b8-768a-b34f-65e348840620/ [2026-01-12 14:17:21,376][ INFO][PID:89076] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb291-76b8-768a-b34f-65e348840620/ [2026-01-12 14:17:21,377][ INFO][PID:89076] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb291-76b8-768a-b34f-65e348840620/ [2026-01-12 14:17:21,595][ INFO][PID:89076] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-12 14:17:21,597][ INFO][PID:89076] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-12 14:17:21,839][ INFO][PID:89076] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb291-8c75-7480-a390-8db9cfff491d/ [2026-01-12 14:17:21,839][ INFO][PID:89076] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb291-8c75-7480-a390-8db9cfff491d/ [2026-01-12 14:17:27,116][ INFO][PID:89076] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb291-8c75-7480-a390-8db9cfff491d/ [2026-01-12 14:17:27,118][ INFO][PID:89076] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb291-8c75-7480-a390-8db9cfff491d/ [2026-01-12 14:17:27,336][ INFO][PID:89076] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-12 14:17:27,343][ INFO][PID:89076] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019bb291-7202-77d3-8e77-5bba1f82f1a8/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019bb291-73b3-7309-89c1-3d9e69d00e6c/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019bb291-7538-778e-8f1a-bd1263d0f396/']) [2026-01-12 14:17:27,347][ INFO][PID:89076] Getting build details [2026-01-12 14:17:27,350][ INFO][PID:89076] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr [2026-01-12 14:17:27,351][ INFO][PID:89076] Built packages: ['python-copr-doc 2.5.post1', 'python3-copr 2.5.post1'] [2026-01-12 14:17:27,351][ INFO][PID:89076] build details: {'built_packages': 'python-copr-doc 2.5.post1\npython3-copr 2.5.post1'} [2026-01-12 14:17:27,352][ INFO][PID:89076] Retrieving pubkey [2026-01-12 14:17:27,352][ INFO][PID:89076] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-12 14:17:27,630][ INFO][PID:89076] Added pubkey for user @copr project copr-pull-requests into: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/pubkey.gpg [2026-01-12 14:17:27,632][ INFO][PID:89076] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-doc-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm, it is stored in Pulp [2026-01-12 14:17:27,632][ INFO][PID:89076] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python-copr-2.5.post1-1.git.14.3f3d561.fc43.src.rpm, it is stored in Pulp [2026-01-12 14:17:27,633][ INFO][PID:89076] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/python3-copr-2.5.post1-1.git.14.3f3d561.fc43.noarch.rpm, it is stored in Pulp [2026-01-12 14:17:27,634][ INFO][PID:89076] Finished build: id=10000958 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115 chroot=fedora-43-ppc64le [2026-01-12 14:17:27,640][ INFO][PID:89076] Worker succeeded build, took 480.2558157444 [2026-01-12 14:17:27,641][ INFO][PID:89076] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": 1768227447.6402712, "started_on": 1768226967.3844554, "submitted_on": null, "status": 1, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10000958-fedora-43-ppc64le", "build_id": 10000958, "package_name": "python-copr", "package_version": "2.5.post1-1.git.14.3f3d561", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/python-copr", "git_hash": "489bee82655ffbc2be1c15a0198516be8358017f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--16371bb1-17bc-431d-af4c-6c5bb8b9f906", "results": { "packages": [ { "name": "python-copr", "epoch": null, "version": "2.5.post1", "release": "1.git.14.3f3d561.fc43", "arch": "src" }, { "name": "python-copr-doc", "epoch": null, "version": "2.5.post1", "release": "1.git.14.3f3d561.fc43", "arch": "noarch" }, { "name": "python3-copr", "epoch": null, "version": "2.5.post1", "release": "1.git.14.3f3d561.fc43", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-43-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "10000958-python-copr", "built_packages": "python-copr-doc 2.5.post1\npython3-copr 2.5.post1", "id": 10000958, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-12 14:17:27,779][ INFO][PID:89076] Sending fedora-messaging bus message in build.end [2026-01-12 14:17:27,810][ INFO][PID:89076] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/builder-live.log by gzip [2026-01-12 14:17:27,811][ INFO][PID:89076] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/builder-live.log' as PID 272863 [2026-01-12 14:17:27,827][ INFO][PID:89076] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/builder-live.log) [2026-01-12 14:17:27,828][ INFO][PID:89076] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/backend.log by gzip [2026-01-12 14:17:27,830][ INFO][PID:89076] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000958-python-copr/backend.log' as PID 272868