[2026-01-25 23:07:48,401][ INFO][PID:565653] Marking build as starting [2026-01-25 23:07:48,559][ INFO][PID:565653] Checking that /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-25 23:07:48,575][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:07:48,576][ INFO][PID:565653] VM allocation process starts [2026-01-25 23:07:48,589][ INFO][PID:565653] Trying to allocate VM: ResallocHost, ticket_id=1013732, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-25 23:07:51,617][ INFO][PID:565653] Allocated host ResallocHost, ticket_id=1013732, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_01547832_20260125_224758, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-25 23:07:51,618][ INFO][PID:565653] Allocating ssh connection to builder [2026-01-25 23:07:51,619][ INFO][PID:565653] Checking that builder machine is OK [2026-01-25 23:07:52,682][ INFO][PID:565653] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-25 23:08:52,736][ ERROR][PID:565653] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c154 port 22: Connection timed out [2026-01-25 23:09:02,737][ ERROR][PID:565653] Re-try request for task on 'ResallocHost, ticket_id=1013732, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_01547832_20260125_224758, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-25 23:09:02,738][ INFO][PID:565653] Releasing VM back to pool [2026-01-25 23:09:02,755][ INFO][PID:565653] Retry #1 (on other host) [2026-01-25 23:09:02,757][ INFO][PID:565653] Checking that /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-25 23:09:02,760][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:02,760][ INFO][PID:565653] VM allocation process starts [2026-01-25 23:09:02,778][ INFO][PID:565653] Trying to allocate VM: ResallocHost, ticket_id=1013743, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-25 23:09:05,792][ INFO][PID:565653] Allocated host ResallocHost, ticket_id=1013743, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_01547946_20260125_225023, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-25 23:09:05,793][ INFO][PID:565653] Allocating ssh connection to builder [2026-01-25 23:09:05,793][ INFO][PID:565653] Checking that builder machine is OK [2026-01-25 23:09:06,876][ INFO][PID:565653] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-25 23:09:07,500][ INFO][PID:565653] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-25 23:09:07,501][ INFO][PID:565653] Filling build.info file with builder info [2026-01-25 23:09:07,502][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:07,503][ INFO][PID:565653] Not re-notifying FE and msg buses for the new host. [2026-01-25 23:09:07,504][ INFO][PID:565653] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10056724-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-25 23:09:08,513][ INFO][PID:565653] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts. [2026-01-25 23:09:08,514][ INFO][PID:565653] Downloading the builder-live.log file, attempt 1 [2026-01-25 23:09:08,515][ INFO][PID:565653] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-25 23:09:13,519][ INFO][PID:565653] Periodic builder liveness probe: alive [2026-01-25 23:09:13,519][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:18,520][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:23,521][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:28,522][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:33,523][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:38,525][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:43,526][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:48,527][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:53,528][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:09:58,529][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:03,530][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:08,531][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:13,532][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:18,533][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:23,534][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:28,535][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:33,536][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:38,539][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:43,540][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:48,541][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:53,542][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:10:58,543][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:03,544][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:08,545][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:13,546][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:18,547][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:23,552][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:28,553][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:33,555][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:38,556][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:43,557][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:48,558][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:53,559][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:11:58,560][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:03,561][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:08,562][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:13,563][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:18,564][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:23,565][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:28,566][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:33,567][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:38,568][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:43,569][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:48,571][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:53,572][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:12:58,573][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:03,574][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:08,576][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:13,577][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:18,578][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:23,579][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:28,580][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:33,581][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:38,582][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:43,583][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:48,584][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:53,585][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:13:58,586][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:14:03,587][ INFO][PID:565653] Checking for cancel request [2026-01-25 23:14:07,861][ INFO][PID:565653] Downloading results from builder [2026-01-25 23:14:07,865][ INFO][PID:565653] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman started [2026-01-25 23:14:07,866][ INFO][PID:565653] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/ &> /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/build-10056724.rsync.log [2026-01-25 23:15:07,951][ INFO][PID:565653] rsyncing finished. [2026-01-25 23:15:07,953][ ERROR][PID:565653] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-25 23:15:07,953][ ERROR][PID:565653] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-25 23:15:17,954][ INFO][PID:565653] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman started [2026-01-25 23:15:17,955][ INFO][PID:565653] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/ &> /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/build-10056724.rsync.log [2026-01-25 23:15:19,481][ INFO][PID:565653] rsyncing finished. [2026-01-25 23:15:19,482][ INFO][PID:565653] Releasing VM back to pool [2026-01-25 23:15:19,491][ INFO][PID:565653] Searching for 'success' file in resultdir [2026-01-25 23:15:19,491][ INFO][PID:565653] Going to sign pkgs from source: 10056724-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le [2026-01-25 23:15:19,492][ INFO][PID:565653] Calling '/bin/sign -u herzenschein#qman@copr.fedorahosted.org -p' (attempt #1) [2026-01-25 23:15:19,760][ INFO][PID:565653] Calling '/bin/sign -4 -h sha256 -u herzenschein#qman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-debugsource-1.5.1-1.fc43.ppc64le.rpm' (attempt #1) [2026-01-25 23:15:20,553][ INFO][PID:565653] signed rpm: /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-debugsource-1.5.1-1.fc43.ppc64le.rpm [2026-01-25 23:15:20,553][ INFO][PID:565653] Calling '/bin/sign -4 -h sha256 -u herzenschein#qman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-debuginfo-1.5.1-1.fc43.ppc64le.rpm' (attempt #1) [2026-01-25 23:15:21,344][ INFO][PID:565653] signed rpm: /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-debuginfo-1.5.1-1.fc43.ppc64le.rpm [2026-01-25 23:15:21,345][ INFO][PID:565653] Calling '/bin/sign -4 -h sha256 -u herzenschein#qman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-1.5.1-1.fc43.src.rpm' (attempt #1) [2026-01-25 23:15:22,181][ INFO][PID:565653] signed rpm: /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-1.5.1-1.fc43.src.rpm [2026-01-25 23:15:22,181][ INFO][PID:565653] Calling '/bin/sign -4 -h sha256 -u herzenschein#qman@copr.fedorahosted.org -r /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-1.5.1-1.fc43.ppc64le.rpm' (attempt #1) [2026-01-25 23:15:22,977][ INFO][PID:565653] signed rpm: /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/qman-1.5.1-1.fc43.ppc64le.rpm [2026-01-25 23:15:22,977][ INFO][PID:565653] Sign done [2026-01-25 23:15:22,978][ INFO][PID:565653] Incremental createrepo run, adding 10056724-qman into https://download.copr.fedorainfracloud.org/results/herzenschein/qman/fedora-43-ppc64le, (auto-create-repo=True) [2026-01-25 23:15:22,979][ INFO][PID:565653] Running command 'copr-repo --batched /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le --add 10056724-qman --no-appstream-metadata' as PID 595471 [2026-01-25 23:15:24,063][ INFO][PID:565653] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le --add 10056724-qman --no-appstream-metadata) [2026-01-25 23:15:24,063][ INFO][PID:565653] Getting build details [2026-01-25 23:15:24,064][ INFO][PID:565653] Listing built binary packages in /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman [2026-01-25 23:15:24,064][ INFO][PID:565653] Built packages: ['qman-debugsource 1.5.1', 'qman-debuginfo 1.5.1', 'qman 1.5.1'] [2026-01-25 23:15:24,065][ INFO][PID:565653] build details: {'built_packages': 'qman-debugsource 1.5.1\nqman-debuginfo 1.5.1\nqman 1.5.1'} [2026-01-25 23:15:24,065][ INFO][PID:565653] Retrieving pubkey [2026-01-25 23:15:24,065][ INFO][PID:565653] Calling '/bin/sign -u herzenschein#qman@copr.fedorahosted.org -p' (attempt #1) [2026-01-25 23:15:24,341][ INFO][PID:565653] Added pubkey for user herzenschein project qman into: /var/lib/copr/public_html/results/herzenschein/qman/pubkey.gpg [2026-01-25 23:15:24,342][ INFO][PID:565653] Finished build: id=10056724 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/herzenschein/qman chroot=fedora-43-ppc64le [2026-01-25 23:15:24,344][ INFO][PID:565653] Worker succeeded build, took 376.8408212661743 [2026-01-25 23:15:24,344][ INFO][PID:565653] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "herzenschein", "project_name": "qman", "project_dirname": "qman", "submitter": "herzenschein", "ended_on": 1769382924.3442245, "started_on": 1769382547.5034032, "submitted_on": null, "status": 1, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10056724-fedora-43-ppc64le", "build_id": 10056724, "package_name": "qman", "package_version": "1.5.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/herzenschein/qman/qman", "git_hash": "30e7ee18e8964d4e91c9276bf92c53b6f0b9ebcc", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "herzenschein/qman--herzenschein", "results": { "packages": [ { "name": "qman-debugsource", "epoch": null, "version": "1.5.1", "release": "1.fc43", "arch": "ppc64le" }, { "name": "qman-debuginfo", "epoch": null, "version": "1.5.1", "release": "1.fc43", "arch": "ppc64le" }, { "name": "qman", "epoch": null, "version": "1.5.1", "release": "1.fc43", "arch": "ppc64le" }, { "name": "qman", "epoch": null, "version": "1.5.1", "release": "1.fc43", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/herzenschein/qman/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/herzenschein/qman", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/herzenschein/qman", "result_dir": "10056724-qman", "built_packages": "qman-debugsource 1.5.1\nqman-debuginfo 1.5.1\nqman 1.5.1", "id": 10056724, "mockchain_macros": { "copr_username": "herzenschein", "copr_projectname": "qman", "vendor": "Fedora Project COPR (herzenschein/qman)" } } ] } [2026-01-25 23:15:24,412][ INFO][PID:565653] Sending fedora-messaging bus message in build.end [2026-01-25 23:15:24,943][ INFO][PID:565653] Compressing /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/builder-live.log by gzip [2026-01-25 23:15:24,944][ INFO][PID:565653] Running command 'gzip /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/builder-live.log' as PID 595662 [2026-01-25 23:15:24,950][ INFO][PID:565653] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/builder-live.log) [2026-01-25 23:15:24,950][ INFO][PID:565653] Compressing /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/backend.log by gzip [2026-01-25 23:15:24,951][ INFO][PID:565653] Running command 'gzip /var/lib/copr/public_html/results/herzenschein/qman/fedora-43-ppc64le/10056724-qman/backend.log' as PID 595664