[2026-01-06 10:30:18,522][ INFO][PID:2895646] Marking build as starting [2026-01-06 10:30:18,610][ INFO][PID:2895646] Checking that /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-06 10:30:18,875][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:18,876][ INFO][PID:2895646] VM allocation process starts [2026-01-06 10:30:18,887][ INFO][PID:2895646] Trying to allocate VM: ResallocHost, ticket_id=672046, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-06 10:30:23,889][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:24,910][ INFO][PID:2895646] Allocated host ResallocHost, ticket_id=672046, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00947111_20260106_102202, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-06 10:30:24,911][ INFO][PID:2895646] Allocating ssh connection to builder [2026-01-06 10:30:24,911][ INFO][PID:2895646] Checking that builder machine is OK [2026-01-06 10:30:25,925][ INFO][PID:2895646] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-06 10:30:26,373][ INFO][PID:2895646] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-06 10:30:26,373][ INFO][PID:2895646] Filling build.info file with builder info [2026-01-06 10:30:26,374][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:26,375][ INFO][PID:2895646] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "nucleo", "ended_on": null, "started_on": 1767695426.3748598, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9977728-fedora-rawhide-ppc64le", "build_id": 9977728, "package_name": "freerouter", "package_version": "26.1.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "8a43e2edf1532651b30b45c43487c1ac6b177f31", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--nucleo", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09977728-freerouter", "built_packages": "", "id": 9977728, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2026-01-06 10:30:26,441][ INFO][PID:2895646] Sending fedora-messaging bus message in build.start [2026-01-06 10:30:26,962][ INFO][PID:2895646] Sending fedora-messaging bus message in chroot.start [2026-01-06 10:30:26,990][ INFO][PID:2895646] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9977728-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-06 10:30:27,917][ INFO][PID:2895646] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts. [2026-01-06 10:30:27,918][ INFO][PID:2895646] Downloading the builder-live.log file, attempt 1 [2026-01-06 10:30:27,919][ INFO][PID:2895646] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-06 10:30:32,923][ INFO][PID:2895646] Periodic builder liveness probe: alive [2026-01-06 10:30:32,924][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:37,925][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:42,926][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:47,927][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:52,928][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:30:57,929][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:02,930][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:07,931][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:12,932][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:17,933][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:22,934][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:27,935][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:32,936][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:37,937][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:42,937][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:47,938][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:52,939][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:31:57,940][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:02,941][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:07,942][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:12,943][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:17,944][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:22,945][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:27,946][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:32,948][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:37,949][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:42,950][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:47,951][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:52,952][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:32:57,953][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:02,954][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:07,955][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:12,956][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:17,957][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:22,958][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:27,959][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:32,960][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:37,961][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:42,962][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:47,963][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:50,364][ ERROR][PID:2895646] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-06 10:33:52,964][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:33:57,965][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:00,365][WARNING][PID:2895646] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-06 10:34:02,966][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:07,966][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:10,365][ INFO][PID:2895646] Downloading the builder-live.log file, attempt 2 [2026-01-06 10:34:10,367][ INFO][PID:2895646] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-06 10:34:12,969][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:17,970][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:22,971][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:27,972][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:32,973][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:37,974][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:42,975][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:47,976][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:52,977][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:34:57,978][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:02,979][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:07,980][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:12,981][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:17,982][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:22,983][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:27,984][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:32,985][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:37,986][ INFO][PID:2895646] Checking for cancel request [2026-01-06 10:35:42,463][ INFO][PID:2895646] Downloading results from builder [2026-01-06 10:35:42,464][ INFO][PID:2895646] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter started [2026-01-06 10:35:42,465][ INFO][PID:2895646] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/ &> /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/build-09977728.rsync.log [2026-01-06 10:36:42,627][ INFO][PID:2895646] rsyncing finished. [2026-01-06 10:36:42,643][ ERROR][PID:2895646] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-06 10:36:42,644][ ERROR][PID:2895646] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-06 10:36:52,644][ INFO][PID:2895646] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter started [2026-01-06 10:36:52,645][ INFO][PID:2895646] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/ &> /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/build-09977728.rsync.log [2026-01-06 10:36:53,436][ INFO][PID:2895646] rsyncing finished. [2026-01-06 10:36:53,437][ INFO][PID:2895646] Releasing VM back to pool [2026-01-06 10:36:53,445][ INFO][PID:2895646] Searching for 'success' file in resultdir [2026-01-06 10:36:53,446][ INFO][PID:2895646] Going to sign pkgs from source: 9977728-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le [2026-01-06 10:36:53,446][ INFO][PID:2895646] Calling '/bin/sign -u nucleo#freerouter@copr.fedorahosted.org -p' (attempt #1) [2026-01-06 10:36:53,710][ INFO][PID:2895646] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-native-debuginfo-26.1.5-1.fc44.ppc64le.rpm' (attempt #1) [2026-01-06 10:36:54,831][ INFO][PID:2895646] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-native-debuginfo-26.1.5-1.fc44.ppc64le.rpm [2026-01-06 10:36:54,831][ INFO][PID:2895646] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-native-26.1.5-1.fc44.ppc64le.rpm' (attempt #1) [2026-01-06 10:36:55,560][ INFO][PID:2895646] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-native-26.1.5-1.fc44.ppc64le.rpm [2026-01-06 10:36:55,561][ INFO][PID:2895646] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-26.1.5-1.fc44.ppc64le.rpm' (attempt #1) [2026-01-06 10:36:56,417][ INFO][PID:2895646] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-26.1.5-1.fc44.ppc64le.rpm [2026-01-06 10:36:56,417][ INFO][PID:2895646] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-doc-26.1.5-1.fc44.noarch.rpm' (attempt #1) [2026-01-06 10:36:57,512][ INFO][PID:2895646] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-doc-26.1.5-1.fc44.noarch.rpm [2026-01-06 10:36:57,513][ INFO][PID:2895646] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-26.1.5-1.fc44.src.rpm' (attempt #1) [2026-01-06 10:36:58,324][ INFO][PID:2895646] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/freerouter-26.1.5-1.fc44.src.rpm [2026-01-06 10:36:58,325][ INFO][PID:2895646] Sign done [2026-01-06 10:36:58,325][ INFO][PID:2895646] Incremental createrepo run, adding 09977728-freerouter into https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/fedora-rawhide-ppc64le, (auto-create-repo=True) [2026-01-06 10:36:58,326][ INFO][PID:2895646] Running command 'copr-repo --batched /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le --add 09977728-freerouter --no-appstream-metadata' as PID 2922395 [2026-01-06 10:36:59,728][ INFO][PID:2895646] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le --add 09977728-freerouter --no-appstream-metadata) [2026-01-06 10:36:59,729][ INFO][PID:2895646] Getting build details [2026-01-06 10:36:59,729][ INFO][PID:2895646] Listing built binary packages in /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter [2026-01-06 10:36:59,730][ INFO][PID:2895646] Built packages: ['freerouter-doc 26.1.5', 'freerouter 26.1.5', 'freerouter-native-debuginfo 26.1.5', 'freerouter-native 26.1.5'] [2026-01-06 10:36:59,730][ INFO][PID:2895646] build details: {'built_packages': 'freerouter-doc 26.1.5\nfreerouter 26.1.5\nfreerouter-native-debuginfo 26.1.5\nfreerouter-native 26.1.5'} [2026-01-06 10:36:59,731][ INFO][PID:2895646] Retrieving pubkey [2026-01-06 10:36:59,731][ INFO][PID:2895646] Calling '/bin/sign -u nucleo#freerouter@copr.fedorahosted.org -p' (attempt #1) [2026-01-06 10:37:00,025][ INFO][PID:2895646] Added pubkey for user nucleo project freerouter into: /var/lib/copr/public_html/results/nucleo/freerouter/pubkey.gpg [2026-01-06 10:37:00,026][ INFO][PID:2895646] Finished build: id=9977728 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/nucleo/freerouter chroot=fedora-rawhide-ppc64le [2026-01-06 10:37:00,027][ INFO][PID:2895646] Worker succeeded build, took 393.6528129577637 [2026-01-06 10:37:00,028][ INFO][PID:2895646] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "nucleo", "ended_on": 1767695820.0276728, "started_on": 1767695426.3748598, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9977728-fedora-rawhide-ppc64le", "build_id": 9977728, "package_name": "freerouter", "package_version": "26.1.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "8a43e2edf1532651b30b45c43487c1ac6b177f31", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--nucleo", "results": { "packages": [ { "name": "freerouter-doc", "epoch": null, "version": "26.1.5", "release": "1.fc44", "arch": "noarch" }, { "name": "freerouter", "epoch": null, "version": "26.1.5", "release": "1.fc44", "arch": "ppc64le" }, { "name": "freerouter-native-debuginfo", "epoch": null, "version": "26.1.5", "release": "1.fc44", "arch": "ppc64le" }, { "name": "freerouter-native", "epoch": null, "version": "26.1.5", "release": "1.fc44", "arch": "ppc64le" }, { "name": "freerouter", "epoch": null, "version": "26.1.5", "release": "1.fc44", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09977728-freerouter", "built_packages": "freerouter-doc 26.1.5\nfreerouter 26.1.5\nfreerouter-native-debuginfo 26.1.5\nfreerouter-native 26.1.5", "id": 9977728, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2026-01-06 10:37:00,097][ INFO][PID:2895646] Sending fedora-messaging bus message in build.end [2026-01-06 10:37:00,124][ INFO][PID:2895646] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/builder-live.log by gzip [2026-01-06 10:37:00,125][ INFO][PID:2895646] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/builder-live.log' as PID 2922427 [2026-01-06 10:37:00,184][ INFO][PID:2895646] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/builder-live.log) [2026-01-06 10:37:00,185][ INFO][PID:2895646] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/backend.log by gzip [2026-01-06 10:37:00,186][ INFO][PID:2895646] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/fedora-rawhide-ppc64le/09977728-freerouter/backend.log' as PID 2922428