[2026-01-06 12:31:36,039][ INFO][PID:3459728] Marking build as starting [2026-01-06 12:31:36,209][ INFO][PID:3459728] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-41-ppc64le//repodata/repomd.xml exists [2026-01-06 12:31:36,971][ INFO][PID:3459728] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le//repodata/repomd.xml exists [2026-01-06 12:31:37,924][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:31:37,925][ INFO][PID:3459728] VM allocation process starts [2026-01-06 12:31:37,935][ INFO][PID:3459728] Trying to allocate VM: ResallocHost, ticket_id=673133, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-06 12:31:40,950][ INFO][PID:3459728] Allocated host ResallocHost, ticket_id=673133, hostname=2620:52:6:1161:dead:beef:cafe:c191, name=vmhost_p09_04_prod_00948235_20260106_121822, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-06 12:31:40,952][ INFO][PID:3459728] Allocating ssh connection to builder [2026-01-06 12:31:40,952][ INFO][PID:3459728] Checking that builder machine is OK [2026-01-06 12:31:41,965][ INFO][PID:3459728] Running remote command: copr-builder-ready fedora-41-ppc64le [2026-01-06 12:31:42,471][ INFO][PID:3459728] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2026-01-06 12:31:42,471][ INFO][PID:3459728] Filling build.info file with builder info [2026-01-06 12:31:42,472][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:31:42,473][ INFO][PID:3459728] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4090", "submitter": null, "ended_on": null, "started_on": 1767702702.4731348, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9978029-fedora-41-ppc64le", "build_id": 9978029, "package_name": "copr-rpmbuild", "package_version": "1.6.post1-1.git.89.1ab6af9", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4090/copr-rpmbuild", "git_hash": "088c8648e8d4e6f45868d882333b1e8ed40174e3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--a3449397-9210-41de-83fc-d6657e9b4601", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-41-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4090", "result_dir": "09978029-copr-rpmbuild", "built_packages": "", "id": 9978029, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-06 12:31:42,524][ INFO][PID:3459728] Sending fedora-messaging bus message in build.start [2026-01-06 12:31:43,085][ INFO][PID:3459728] Sending fedora-messaging bus message in chroot.start [2026-01-06 12:31:43,116][ INFO][PID:3459728] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9978029-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2026-01-06 12:31:44,123][ INFO][PID:3459728] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c191' (ED25519) to the list of known hosts. [2026-01-06 12:31:44,124][ INFO][PID:3459728] Downloading the builder-live.log file, attempt 1 [2026-01-06 12:31:44,126][ INFO][PID:3459728] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c191 copr-rpmbuild-log [2026-01-06 12:31:49,160][ INFO][PID:3459728] Periodic builder liveness probe: alive [2026-01-06 12:31:49,160][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:31:54,161][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:31:59,163][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:04,165][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:09,166][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:14,455][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:19,456][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:24,457][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:29,459][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:34,460][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:39,462][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:44,464][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:49,466][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:54,471][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:32:59,474][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:04,475][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:09,477][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:14,480][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:19,482][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:24,483][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:29,484][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:34,485][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:39,486][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:44,489][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:49,490][ INFO][PID:3459728] Checking for cancel request [2026-01-06 12:33:53,609][ INFO][PID:3459728] Downloading results from builder [2026-01-06 12:33:53,610][ INFO][PID:3459728] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c191]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild started [2026-01-06 12:33:53,612][ INFO][PID:3459728] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c191]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/build-09978029.rsync.log [2026-01-06 12:33:54,237][ INFO][PID:3459728] rsyncing finished. [2026-01-06 12:33:54,238][ INFO][PID:3459728] Releasing VM back to pool [2026-01-06 12:33:54,253][ INFO][PID:3459728] Searching for 'success' file in resultdir [2026-01-06 12:33:54,257][ INFO][PID:3459728] Going to sign pkgs from source: 9978029-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le [2026-01-06 12:33:54,258][ INFO][PID:3459728] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-06 12:33:54,527][ INFO][PID:3459728] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-builder-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm' (attempt #1) [2026-01-06 12:33:55,183][ INFO][PID:3459728] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-builder-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm [2026-01-06 12:33:55,185][ INFO][PID:3459728] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm' (attempt #1) [2026-01-06 12:33:55,862][ INFO][PID:3459728] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm [2026-01-06 12:33:55,863][ INFO][PID:3459728] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.src.rpm' (attempt #1) [2026-01-06 12:33:56,434][ INFO][PID:3459728] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.src.rpm [2026-01-06 12:33:56,435][ INFO][PID:3459728] Sign done [2026-01-06 12:33:56,436][ INFO][PID:3459728] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-builder-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm [2026-01-06 12:33:56,931][ INFO][PID:3459728] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm [2026-01-06 12:33:56,931][ INFO][PID:3459728] [1/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-builder-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm [2026-01-06 12:33:57,422][ INFO][PID:3459728] [2/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm [2026-01-06 12:33:57,423][ INFO][PID:3459728] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.src.rpm [2026-01-06 12:33:58,036][ INFO][PID:3459728] [3/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.src.rpm [2026-01-06 12:33:58,049][ INFO][PID:3459728] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-pull-requests%3Apr%3A4090%2Ffedora-41-ppc64le&offset=0&limit=1 [2026-01-06 12:33:58,438][ INFO][PID:3459728] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019b934c-bc7b-7c5f-a84f-8a569cd85286/ [2026-01-06 12:33:58,439][ INFO][PID:3459728] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019b934c-bc7b-7c5f-a84f-8a569cd85286/ [2026-01-06 12:34:03,597][ INFO][PID:3459728] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019b934c-bc7b-7c5f-a84f-8a569cd85286/ [2026-01-06 12:34:03,598][ INFO][PID:3459728] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019b934c-bc7b-7c5f-a84f-8a569cd85286/ [2026-01-06 12:34:03,780][ INFO][PID:3459728] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019b3596-d6df-7529-a654-8ca7c8425916/ [2026-01-06 12:34:03,780][ INFO][PID:3459728] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019b3596-d6df-7529-a654-8ca7c8425916/ [2026-01-06 12:34:03,978][ INFO][PID:3459728] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019b934c-d217-76fb-a181-b7cbd1e1bd80/ [2026-01-06 12:34:03,979][ INFO][PID:3459728] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019b934c-d217-76fb-a181-b7cbd1e1bd80/ [2026-01-06 12:34:09,693][ INFO][PID:3459728] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019b934c-d217-76fb-a181-b7cbd1e1bd80/ [2026-01-06 12:34:09,694][ INFO][PID:3459728] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019b934c-d217-76fb-a181-b7cbd1e1bd80/ [2026-01-06 12:34:09,891][ INFO][PID:3459728] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019b3596-d6df-7529-a654-8ca7c8425916/ [2026-01-06 12:34:09,893][ INFO][PID:3459728] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019b3596-d6df-7529-a654-8ca7c8425916/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019b934c-b676-704b-9356-2592aa0c09a1/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019b934c-b868-7dc3-ac6a-77bd39147363/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019b934c-ba7e-7551-a844-6e153a5f2d6d/']) [2026-01-06 12:34:09,894][ INFO][PID:3459728] Getting build details [2026-01-06 12:34:09,895][ INFO][PID:3459728] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild [2026-01-06 12:34:09,895][ INFO][PID:3459728] Built packages: ['copr-builder 1.6.post1', 'copr-rpmbuild 1.6.post1'] [2026-01-06 12:34:09,896][ INFO][PID:3459728] build details: {'built_packages': 'copr-builder 1.6.post1\ncopr-rpmbuild 1.6.post1'} [2026-01-06 12:34:09,897][ INFO][PID:3459728] Retrieving pubkey [2026-01-06 12:34:09,897][ INFO][PID:3459728] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-06 12:34:10,177][ INFO][PID:3459728] Added pubkey for user @copr project copr-pull-requests into: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/pubkey.gpg [2026-01-06 12:34:10,178][ INFO][PID:3459728] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-builder-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm, it is stored in Pulp [2026-01-06 12:34:10,179][ INFO][PID:3459728] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.ppc64le.rpm, it is stored in Pulp [2026-01-06 12:34:10,180][ INFO][PID:3459728] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.89.1ab6af9.fc41.src.rpm, it is stored in Pulp [2026-01-06 12:34:10,180][ INFO][PID:3459728] Finished build: id=9978029 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090 chroot=fedora-41-ppc64le [2026-01-06 12:34:10,182][ INFO][PID:3459728] Worker succeeded build, took 147.7096345424652 [2026-01-06 12:34:10,183][ INFO][PID:3459728] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4090", "submitter": null, "ended_on": 1767702850.1827693, "started_on": 1767702702.4731348, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9978029-fedora-41-ppc64le", "build_id": 9978029, "package_name": "copr-rpmbuild", "package_version": "1.6.post1-1.git.89.1ab6af9", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4090/copr-rpmbuild", "git_hash": "088c8648e8d4e6f45868d882333b1e8ed40174e3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--a3449397-9210-41de-83fc-d6657e9b4601", "results": { "packages": [ { "name": "copr-builder", "epoch": null, "version": "1.6.post1", "release": "1.git.89.1ab6af9.fc41", "arch": "ppc64le" }, { "name": "copr-rpmbuild", "epoch": null, "version": "1.6.post1", "release": "1.git.89.1ab6af9.fc41", "arch": "src" }, { "name": "copr-rpmbuild", "epoch": null, "version": "1.6.post1", "release": "1.git.89.1ab6af9.fc41", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-41-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4090", "result_dir": "09978029-copr-rpmbuild", "built_packages": "copr-builder 1.6.post1\ncopr-rpmbuild 1.6.post1", "id": 9978029, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-06 12:34:10,246][ INFO][PID:3459728] Sending fedora-messaging bus message in build.end [2026-01-06 12:34:10,274][ INFO][PID:3459728] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/builder-live.log by gzip [2026-01-06 12:34:10,276][ INFO][PID:3459728] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/builder-live.log' as PID 3481498 [2026-01-06 12:34:10,313][ INFO][PID:3459728] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/builder-live.log) [2026-01-06 12:34:10,314][ INFO][PID:3459728] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/backend.log by gzip [2026-01-06 12:34:10,315][ INFO][PID:3459728] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4090/fedora-41-ppc64le/09978029-copr-rpmbuild/backend.log' as PID 3481506