[2026-01-10 17:25:10,359][ INFO][PID:1162999] Marking build as starting [2026-01-10 17:25:10,664][ INFO][PID:1162999] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-10 17:25:11,025][ INFO][PID:1162999] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-10 17:25:11,267][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:11,268][ INFO][PID:1162999] VM allocation process starts [2026-01-10 17:25:11,286][ INFO][PID:1162999] Trying to allocate VM: ResallocHost, ticket_id=749372, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-10 17:25:14,300][ INFO][PID:1162999] Allocated host ResallocHost, ticket_id=749372, hostname=2620:52:6:1161:dead:beef:cafe:c150, name=vmhost_p09_03_prod_01081801_20260110_171933, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-10 17:25:14,301][ INFO][PID:1162999] Allocating ssh connection to builder [2026-01-10 17:25:14,301][ INFO][PID:1162999] Checking that builder machine is OK [2026-01-10 17:25:15,338][ INFO][PID:1162999] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-10 17:25:15,865][ INFO][PID:1162999] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-10 17:25:15,865][ INFO][PID:1162999] Filling build.info file with builder info [2026-01-10 17:25:15,866][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:15,867][ INFO][PID:1162999] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": null, "started_on": 1768065915.867282, "submitted_on": null, "status": 3, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9994357-fedora-43-ppc64le", "build_id": 9994357, "package_name": "python-copr", "package_version": "2.5.post1-1.git.12.37dd39c", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/python-copr", "git_hash": "dbc05201f9550f293ae76dec0c0d69fc2366ffef", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--836663c1-2037-47ca-b586-fbf5c221882c", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-43-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "09994357-python-copr", "built_packages": "", "id": 9994357, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-10 17:25:15,945][ INFO][PID:1162999] Sending fedora-messaging bus message in build.start [2026-01-10 17:25:16,508][ INFO][PID:1162999] Sending fedora-messaging bus message in chroot.start [2026-01-10 17:25:16,539][ INFO][PID:1162999] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9994357-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-10 17:25:17,485][ INFO][PID:1162999] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c150' (ED25519) to the list of known hosts. [2026-01-10 17:25:17,486][ INFO][PID:1162999] Downloading the builder-live.log file, attempt 1 [2026-01-10 17:25:17,487][ INFO][PID:1162999] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c150 copr-rpmbuild-log [2026-01-10 17:25:22,491][ INFO][PID:1162999] Periodic builder liveness probe: alive [2026-01-10 17:25:22,491][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:27,492][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:32,493][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:37,494][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:42,495][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:47,496][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:52,497][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:25:57,498][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:02,499][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:07,500][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:12,501][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:17,502][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:22,503][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:27,504][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:32,505][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:37,506][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:42,507][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:47,507][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:52,508][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:26:57,509][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:02,510][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:07,511][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:12,512][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:17,513][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:22,514][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:27,515][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:32,516][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:37,517][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:42,518][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:47,519][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:52,521][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:27:57,523][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:02,524][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:07,525][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:12,526][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:17,527][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:22,528][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:27,529][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:32,530][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:37,531][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:42,533][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:47,535][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:52,536][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:57,537][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:28:59,370][ ERROR][PID:1162999] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-10 17:29:02,538][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:07,539][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:09,371][WARNING][PID:1162999] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-10 17:29:12,540][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:17,541][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:19,372][ INFO][PID:1162999] Downloading the builder-live.log file, attempt 2 [2026-01-10 17:29:19,373][ INFO][PID:1162999] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c150 copr-rpmbuild-log [2026-01-10 17:29:22,542][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:27,543][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:32,544][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:37,545][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:42,546][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:47,547][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:52,548][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:29:57,549][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:02,550][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:07,551][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:12,552][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:17,552][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:19,440][ ERROR][PID:1162999] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-10 17:30:22,554][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:27,555][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:29,449][WARNING][PID:1162999] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-10 17:30:32,556][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:37,557][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:39,450][ INFO][PID:1162999] Downloading the builder-live.log file, attempt 3 [2026-01-10 17:30:39,451][ INFO][PID:1162999] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c150 copr-rpmbuild-log [2026-01-10 17:30:42,558][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:47,559][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:52,560][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:30:57,561][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:02,562][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:07,563][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:12,564][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:17,565][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:22,566][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:27,567][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:32,568][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:37,569][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:39,485][ ERROR][PID:1162999] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-10 17:31:42,570][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:47,571][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:49,493][WARNING][PID:1162999] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-10 17:31:52,572][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:57,573][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:31:59,738][ INFO][PID:1162999] Downloading the builder-live.log file, attempt 4 [2026-01-10 17:31:59,739][ INFO][PID:1162999] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c150 copr-rpmbuild-log [2026-01-10 17:32:02,576][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:07,577][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:12,578][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:17,579][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:22,580][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:27,581][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:32,582][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:37,583][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:42,584][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:47,585][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:52,586][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:57,587][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:32:59,806][ ERROR][PID:1162999] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-10 17:33:02,588][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:07,589][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:10,082][ ERROR][PID:1162999] Giving up for unstable SSH, failures: 1768066149.3717003, 1768066229.4497805, 1768066309.4937072, 1768066390.0821943 [2026-01-10 17:33:10,083][ ERROR][PID:1162999] Re-try request for task on 'ResallocHost, ticket_id=749372, hostname=2620:52:6:1161:dead:beef:cafe:c150, name=vmhost_p09_03_prod_01081801_20260110_171933, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-10 17:33:10,083][ INFO][PID:1162999] Releasing VM back to pool [2026-01-10 17:33:10,091][ INFO][PID:1162999] Retry #1 (on other host) [2026-01-10 17:33:10,092][ INFO][PID:1162999] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-10 17:33:10,248][ INFO][PID:1162999] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-10 17:33:11,244][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:11,245][ INFO][PID:1162999] VM allocation process starts [2026-01-10 17:33:11,254][ INFO][PID:1162999] Trying to allocate VM: ResallocHost, ticket_id=749446, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-10 17:33:14,286][ INFO][PID:1162999] Allocated host ResallocHost, ticket_id=749446, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_01081828_20260110_172521, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-10 17:33:14,483][ INFO][PID:1162999] Allocating ssh connection to builder [2026-01-10 17:33:14,484][ INFO][PID:1162999] Checking that builder machine is OK [2026-01-10 17:33:15,588][ INFO][PID:1162999] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-10 17:33:16,121][ INFO][PID:1162999] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-10 17:33:16,122][ INFO][PID:1162999] Filling build.info file with builder info [2026-01-10 17:33:16,125][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:16,126][ INFO][PID:1162999] Not re-notifying FE and msg buses for the new host. [2026-01-10 17:33:16,127][ INFO][PID:1162999] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9994357-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-10 17:33:17,226][ INFO][PID:1162999] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c194' (ED25519) to the list of known hosts. [2026-01-10 17:33:17,227][ INFO][PID:1162999] Downloading the builder-live.log file, attempt 1 [2026-01-10 17:33:17,228][ INFO][PID:1162999] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c194 copr-rpmbuild-log [2026-01-10 17:33:22,227][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:27,228][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:32,229][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:37,230][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:42,231][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:47,232][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:52,233][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:33:57,234][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:02,235][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:07,236][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:12,237][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:17,238][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:22,239][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:27,240][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:32,241][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:37,242][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:42,243][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:47,244][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:52,245][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:34:57,246][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:02,247][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:07,247][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:12,248][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:17,249][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:22,250][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:27,256][ INFO][PID:1162999] Periodic builder liveness probe: alive [2026-01-10 17:35:27,257][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:32,258][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:37,258][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:42,259][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:47,260][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:52,261][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:35:57,262][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:02,263][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:07,264][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:12,265][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:17,266][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:22,267][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:27,268][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:32,269][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:37,270][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:42,270][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:47,271][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:52,272][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:36:57,273][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:02,274][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:07,275][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:12,276][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:17,277][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:22,278][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:27,279][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:32,280][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:37,280][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:42,281][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:47,282][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:52,283][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:37:57,284][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:02,285][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:07,286][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:12,287][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:17,288][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:22,289][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:27,290][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:32,291][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:37,292][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:42,293][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:47,294][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:52,295][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:38:57,295][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:02,296][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:07,297][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:12,298][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:17,299][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:22,300][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:27,301][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:32,302][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:37,302][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:42,303][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:47,304][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:52,305][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:39:57,306][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:02,307][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:07,308][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:12,309][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:17,310][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:22,310][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:27,311][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:32,312][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:37,313][ INFO][PID:1162999] Checking for cancel request [2026-01-10 17:40:38,293][ INFO][PID:1162999] Downloading results from builder [2026-01-10 17:40:38,294][ INFO][PID:1162999] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr started [2026-01-10 17:40:38,294][ INFO][PID:1162999] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/build-09994357.rsync.log [2026-01-10 17:40:39,101][ INFO][PID:1162999] rsyncing finished. [2026-01-10 17:40:39,102][ INFO][PID:1162999] Releasing VM back to pool [2026-01-10 17:40:39,110][ INFO][PID:1162999] Searching for 'success' file in resultdir [2026-01-10 17:40:39,110][ INFO][PID:1162999] Going to sign pkgs from source: 9994357-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le [2026-01-10 17:40:39,111][ INFO][PID:1162999] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-10 17:40:39,381][ INFO][PID:1162999] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-doc-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm' (attempt #1) [2026-01-10 17:40:40,114][ INFO][PID:1162999] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-doc-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm [2026-01-10 17:40:40,115][ INFO][PID:1162999] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-2.5.post1-1.git.12.37dd39c.fc43.src.rpm' (attempt #1) [2026-01-10 17:40:40,834][ INFO][PID:1162999] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-2.5.post1-1.git.12.37dd39c.fc43.src.rpm [2026-01-10 17:40:40,835][ INFO][PID:1162999] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python3-copr-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm' (attempt #1) [2026-01-10 17:40:41,577][ INFO][PID:1162999] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python3-copr-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm [2026-01-10 17:40:41,577][ INFO][PID:1162999] Sign done [2026-01-10 17:40:41,579][ INFO][PID:1162999] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-doc-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm [2026-01-10 17:40:41,932][ INFO][PID:1162999] [1/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-doc-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm [2026-01-10 17:40:41,933][ INFO][PID:1162999] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-2.5.post1-1.git.12.37dd39c.fc43.src.rpm [2026-01-10 17:40:42,276][ INFO][PID:1162999] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python3-copr-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm [2026-01-10 17:40:42,277][ INFO][PID:1162999] [2/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-2.5.post1-1.git.12.37dd39c.fc43.src.rpm [2026-01-10 17:40:42,567][ INFO][PID:1162999] [3/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python3-copr-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm [2026-01-10 17:40:42,572][ INFO][PID:1162999] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-pull-requests%3Apr%3A4115%2Ffedora-43-ppc64le&offset=0&limit=1 [2026-01-10 17:40:42,899][ INFO][PID:1162999] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019ba8ff-00f3-7670-b1dd-6ea092462656/ [2026-01-10 17:40:42,900][ INFO][PID:1162999] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019ba8ff-00f3-7670-b1dd-6ea092462656/ [2026-01-10 17:40:48,032][ INFO][PID:1162999] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019ba8ff-00f3-7670-b1dd-6ea092462656/ [2026-01-10 17:40:48,052][ INFO][PID:1162999] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019ba8ff-00f3-7670-b1dd-6ea092462656/ [2026-01-10 17:40:48,218][ INFO][PID:1162999] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-10 17:40:48,218][ INFO][PID:1162999] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-10 17:40:48,363][ INFO][PID:1162999] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019ba8ff-1646-743e-a78c-e3df6e8523d8/ [2026-01-10 17:40:48,363][ INFO][PID:1162999] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019ba8ff-1646-743e-a78c-e3df6e8523d8/ [2026-01-10 17:40:53,508][ INFO][PID:1162999] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019ba8ff-1646-743e-a78c-e3df6e8523d8/ [2026-01-10 17:40:53,508][ INFO][PID:1162999] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019ba8ff-1646-743e-a78c-e3df6e8523d8/ [2026-01-10 17:40:53,632][ INFO][PID:1162999] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-10 17:40:53,634][ INFO][PID:1162999] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019ba8fe-fcf4-75d5-b125-c8bbb425de78/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019ba8fe-fe46-71ab-89b3-386dba6be994/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019ba8fe-ff80-71bd-8831-d88e8957c9ae/']) [2026-01-10 17:40:53,650][ INFO][PID:1162999] Getting build details [2026-01-10 17:40:53,650][ INFO][PID:1162999] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr [2026-01-10 17:40:53,650][ INFO][PID:1162999] Built packages: ['python-copr-doc 2.5.post1', 'python3-copr 2.5.post1'] [2026-01-10 17:40:53,651][ INFO][PID:1162999] build details: {'built_packages': 'python-copr-doc 2.5.post1\npython3-copr 2.5.post1'} [2026-01-10 17:40:53,651][ INFO][PID:1162999] Retrieving pubkey [2026-01-10 17:40:53,652][ INFO][PID:1162999] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-10 17:40:53,934][ INFO][PID:1162999] Added pubkey for user @copr project copr-pull-requests into: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/pubkey.gpg [2026-01-10 17:40:53,935][ INFO][PID:1162999] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-doc-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm, it is stored in Pulp [2026-01-10 17:40:53,936][ INFO][PID:1162999] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python-copr-2.5.post1-1.git.12.37dd39c.fc43.src.rpm, it is stored in Pulp [2026-01-10 17:40:53,956][ INFO][PID:1162999] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/python3-copr-2.5.post1-1.git.12.37dd39c.fc43.noarch.rpm, it is stored in Pulp [2026-01-10 17:40:53,957][ INFO][PID:1162999] Finished build: id=9994357 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115 chroot=fedora-43-ppc64le [2026-01-10 17:40:53,958][ INFO][PID:1162999] Worker succeeded build, took 457.8320951461792 [2026-01-10 17:40:53,959][ INFO][PID:1162999] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": 1768066853.9586837, "started_on": 1768066396.1265886, "submitted_on": null, "status": 1, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9994357-fedora-43-ppc64le", "build_id": 9994357, "package_name": "python-copr", "package_version": "2.5.post1-1.git.12.37dd39c", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/python-copr", "git_hash": "dbc05201f9550f293ae76dec0c0d69fc2366ffef", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--836663c1-2037-47ca-b586-fbf5c221882c", "results": { "packages": [ { "name": "python-copr", "epoch": null, "version": "2.5.post1", "release": "1.git.12.37dd39c.fc43", "arch": "src" }, { "name": "python-copr-doc", "epoch": null, "version": "2.5.post1", "release": "1.git.12.37dd39c.fc43", "arch": "noarch" }, { "name": "python3-copr", "epoch": null, "version": "2.5.post1", "release": "1.git.12.37dd39c.fc43", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-43-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "09994357-python-copr", "built_packages": "python-copr-doc 2.5.post1\npython3-copr 2.5.post1", "id": 9994357, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-10 17:40:54,047][ INFO][PID:1162999] Sending fedora-messaging bus message in build.end [2026-01-10 17:40:54,074][ INFO][PID:1162999] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/builder-live.log by gzip [2026-01-10 17:40:54,075][ INFO][PID:1162999] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/builder-live.log' as PID 1220055 [2026-01-10 17:40:54,143][ INFO][PID:1162999] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/builder-live.log) [2026-01-10 17:40:54,144][ INFO][PID:1162999] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/backend.log by gzip [2026-01-10 17:40:54,145][ INFO][PID:1162999] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/09994357-python-copr/backend.log' as PID 1220058