[2026-01-03 11:10:27,587][ INFO][PID:1856116] Marking build as starting [2026-01-03 11:10:27,733][ INFO][PID:1856116] Checking that /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-03 11:10:27,753][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:10:27,754][ INFO][PID:1856116] VM allocation process starts [2026-01-03 11:10:27,778][ INFO][PID:1856116] Trying to allocate VM: ResallocHost, ticket_id=639061, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-03 11:10:30,803][ INFO][PID:1856116] Allocated host ResallocHost, ticket_id=639061, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_00902906_20260103_110518, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-03 11:10:30,804][ INFO][PID:1856116] Allocating ssh connection to builder [2026-01-03 11:10:30,804][ INFO][PID:1856116] Checking that builder machine is OK [2026-01-03 11:10:31,727][ INFO][PID:1856116] Running remote command: copr-builder-ready epel-9-ppc64le [2026-01-03 11:11:31,815][ ERROR][PID:1856116] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c195 port 22: Connection timed out [2026-01-03 11:11:41,816][ ERROR][PID:1856116] Re-try request for task on 'ResallocHost, ticket_id=639061, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_00902906_20260103_110518, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2026-01-03 11:11:41,816][ INFO][PID:1856116] Releasing VM back to pool [2026-01-03 11:11:41,855][ INFO][PID:1856116] Retry #1 (on other host) [2026-01-03 11:11:41,856][ INFO][PID:1856116] Checking that /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-03 11:11:41,856][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:11:41,857][ INFO][PID:1856116] VM allocation process starts [2026-01-03 11:11:41,870][ INFO][PID:1856116] Trying to allocate VM: ResallocHost, ticket_id=639082, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-03 11:11:46,871][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:11:51,872][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:11:56,873][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:01,874][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:06,875][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:11,876][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:16,877][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:21,878][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:26,880][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:31,881][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:36,882][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:41,883][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:46,884][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:12:49,920][ INFO][PID:1856116] Allocated host ResallocHost, ticket_id=639082, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_00902941_20260103_110706, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-03 11:12:49,921][ INFO][PID:1856116] Allocating ssh connection to builder [2026-01-03 11:12:49,921][ INFO][PID:1856116] Checking that builder machine is OK [2026-01-03 11:12:50,759][ INFO][PID:1856116] Running remote command: copr-builder-ready epel-9-ppc64le [2026-01-03 11:14:51,244][ INFO][PID:1856116] Checking Red Hat subscription (attempt #1) Checking Red Hat subscription (attempt #2) Checking Red Hat subscription (attempt #3) Checking Red Hat subscription (attempt #4) Checking Red Hat subscription (attempt #5) Red Hat subscription active Builder is ready to be used [2026-01-03 11:14:51,247][ INFO][PID:1856116] Filling build.info file with builder info [2026-01-03 11:14:51,247][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:14:51,248][ INFO][PID:1856116] Not re-notifying FE and msg buses for the new host. [2026-01-03 11:14:51,248][ INFO][PID:1856116] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9971749-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2026-01-03 11:15:51,288][ ERROR][PID:1856116] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14d port 22: Connection timed out [2026-01-03 11:16:01,289][ ERROR][PID:1856116] Re-try request for task on 'ResallocHost, ticket_id=639082, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_00902941_20260103_110706, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2026-01-03 11:16:01,289][ INFO][PID:1856116] Releasing VM back to pool [2026-01-03 11:16:01,339][ INFO][PID:1856116] Retry #2 (on other host) [2026-01-03 11:16:01,339][ INFO][PID:1856116] Checking that /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-03 11:16:01,340][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:01,340][ INFO][PID:1856116] VM allocation process starts [2026-01-03 11:16:01,353][ INFO][PID:1856116] Trying to allocate VM: ResallocHost, ticket_id=639140, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-03 11:16:04,368][ INFO][PID:1856116] Allocated host ResallocHost, ticket_id=639140, hostname=140.211.168.104, name=copr_osuosl_p09_prod_00901857_20260103_084038, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-03 11:16:04,368][ INFO][PID:1856116] Allocating ssh connection to builder [2026-01-03 11:16:04,369][ INFO][PID:1856116] Checking that builder machine is OK [2026-01-03 11:16:05,707][ INFO][PID:1856116] Running remote command: copr-builder-ready epel-9-ppc64le [2026-01-03 11:16:06,761][ INFO][PID:1856116] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-01-03 11:16:06,761][ INFO][PID:1856116] Filling build.info file with builder info [2026-01-03 11:16:07,162][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:07,163][ INFO][PID:1856116] Not re-notifying FE and msg buses for the new host. [2026-01-03 11:16:07,164][ INFO][PID:1856116] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9971749-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2026-01-03 11:16:08,532][ INFO][PID:1856116] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.104' (ED25519) to the list of known hosts. [2026-01-03 11:16:08,533][ INFO][PID:1856116] Downloading the builder-live.log file, attempt 1 [2026-01-03 11:16:08,534][ INFO][PID:1856116] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log [2026-01-03 11:16:13,539][ INFO][PID:1856116] Periodic builder liveness probe: alive [2026-01-03 11:16:13,540][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:18,541][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:23,542][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:28,543][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:33,544][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:38,545][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:43,546][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:48,547][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:53,549][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:16:58,551][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:03,552][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:08,553][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:13,554][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:18,555][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:23,555][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:28,556][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:33,557][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:38,558][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:43,559][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:48,560][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:53,561][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:17:58,562][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:03,563][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:08,564][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:13,565][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:18,583][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:23,584][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:28,585][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:33,586][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:38,587][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:43,588][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:48,588][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:53,604][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:18:58,604][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:03,605][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:08,606][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:13,607][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:18,608][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:23,609][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:28,610][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:33,611][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:38,612][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:43,613][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:48,614][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:53,615][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:19:58,616][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:03,617][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:08,618][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:13,619][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:18,620][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:23,620][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:28,621][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:33,622][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:38,623][ INFO][PID:1856116] Checking for cancel request [2026-01-03 11:20:43,032][ INFO][PID:1856116] Downloading results from builder [2026-01-03 11:20:43,033][ INFO][PID:1856116] rsyncing of mockbuilder@140.211.168.104:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter started [2026-01-03 11:20:43,034][ INFO][PID:1856116] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.104:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/ &> /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/build-09971749.rsync.log [2026-01-03 11:20:45,751][ INFO][PID:1856116] rsyncing finished. [2026-01-03 11:20:45,752][ INFO][PID:1856116] Releasing VM back to pool [2026-01-03 11:20:45,759][ INFO][PID:1856116] Searching for 'success' file in resultdir [2026-01-03 11:20:45,760][ INFO][PID:1856116] Going to sign pkgs from source: 9971749-epel-9-ppc64le in chroot: /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le [2026-01-03 11:20:45,760][ INFO][PID:1856116] Calling '/bin/sign -u nucleo#freerouter@copr.fedorahosted.org -p' (attempt #1) [2026-01-03 11:20:46,033][ INFO][PID:1856116] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-26.1.2-1.el9.ppc64le.rpm' (attempt #1) [2026-01-03 11:20:46,903][ INFO][PID:1856116] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-26.1.2-1.el9.ppc64le.rpm [2026-01-03 11:20:46,903][ INFO][PID:1856116] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-native-debuginfo-26.1.2-1.el9.ppc64le.rpm' (attempt #1) [2026-01-03 11:20:47,841][ INFO][PID:1856116] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-native-debuginfo-26.1.2-1.el9.ppc64le.rpm [2026-01-03 11:20:47,842][ INFO][PID:1856116] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-native-26.1.2-1.el9.ppc64le.rpm' (attempt #1) [2026-01-03 11:20:48,579][ INFO][PID:1856116] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-native-26.1.2-1.el9.ppc64le.rpm [2026-01-03 11:20:48,580][ INFO][PID:1856116] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-doc-26.1.2-1.el9.noarch.rpm' (attempt #1) [2026-01-03 11:20:49,342][ INFO][PID:1856116] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-doc-26.1.2-1.el9.noarch.rpm [2026-01-03 11:20:49,343][ INFO][PID:1856116] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-26.1.2-1.el9.src.rpm' (attempt #1) [2026-01-03 11:20:50,175][ INFO][PID:1856116] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/freerouter-26.1.2-1.el9.src.rpm [2026-01-03 11:20:50,175][ INFO][PID:1856116] Sign done [2026-01-03 11:20:50,176][ INFO][PID:1856116] Incremental createrepo run, adding 09971749-freerouter into https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-9-ppc64le, (auto-create-repo=True) [2026-01-03 11:20:50,177][ INFO][PID:1856116] Running command 'copr-repo --batched /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le --add 09971749-freerouter --no-appstream-metadata' as PID 1907710 [2026-01-03 11:20:51,722][ INFO][PID:1856116] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le --add 09971749-freerouter --no-appstream-metadata) [2026-01-03 11:20:51,723][ INFO][PID:1856116] Getting build details [2026-01-03 11:20:51,724][ INFO][PID:1856116] Listing built binary packages in /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter [2026-01-03 11:20:51,724][ INFO][PID:1856116] Built packages: ['freerouter 26.1.2', 'freerouter-native 26.1.2', 'freerouter-doc 26.1.2', 'freerouter-native-debuginfo 26.1.2'] [2026-01-03 11:20:51,724][ INFO][PID:1856116] build details: {'built_packages': 'freerouter 26.1.2\nfreerouter-native 26.1.2\nfreerouter-doc 26.1.2\nfreerouter-native-debuginfo 26.1.2'} [2026-01-03 11:20:51,725][ INFO][PID:1856116] Retrieving pubkey [2026-01-03 11:20:51,725][ INFO][PID:1856116] Calling '/bin/sign -u nucleo#freerouter@copr.fedorahosted.org -p' (attempt #1) [2026-01-03 11:20:52,005][ INFO][PID:1856116] Added pubkey for user nucleo project freerouter into: /var/lib/copr/public_html/results/nucleo/freerouter/pubkey.gpg [2026-01-03 11:20:52,006][ INFO][PID:1856116] Finished build: id=9971749 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/nucleo/freerouter chroot=epel-9-ppc64le [2026-01-03 11:20:52,008][ INFO][PID:1856116] Worker succeeded build, took 284.844279050827 [2026-01-03 11:20:52,008][ INFO][PID:1856116] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "https://api.github.com/users/nuqleo", "ended_on": 1767439252.0079763, "started_on": 1767438967.1636972, "submitted_on": null, "status": 1, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9971749-epel-9-ppc64le", "build_id": 9971749, "package_name": "freerouter", "package_version": "26.1.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "1d8241795df8a007de17f23d5e1def72bbea91f4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo", "results": { "packages": [ { "name": "freerouter", "epoch": null, "version": "26.1.2", "release": "1.el9", "arch": "ppc64le" }, { "name": "freerouter-native", "epoch": null, "version": "26.1.2", "release": "1.el9", "arch": "ppc64le" }, { "name": "freerouter-doc", "epoch": null, "version": "26.1.2", "release": "1.el9", "arch": "noarch" }, { "name": "freerouter", "epoch": null, "version": "26.1.2", "release": "1.el9", "arch": "src" }, { "name": "freerouter-native-debuginfo", "epoch": null, "version": "26.1.2", "release": "1.el9", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09971749-freerouter", "built_packages": "freerouter 26.1.2\nfreerouter-native 26.1.2\nfreerouter-doc 26.1.2\nfreerouter-native-debuginfo 26.1.2", "id": 9971749, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2026-01-03 11:20:52,103][ INFO][PID:1856116] Sending fedora-messaging bus message in build.end [2026-01-03 11:20:52,754][ INFO][PID:1856116] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/builder-live.log by gzip [2026-01-03 11:20:52,756][ INFO][PID:1856116] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/builder-live.log' as PID 1907740 [2026-01-03 11:20:52,869][ INFO][PID:1856116] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/builder-live.log) [2026-01-03 11:20:52,870][ INFO][PID:1856116] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/backend.log by gzip [2026-01-03 11:20:52,871][ INFO][PID:1856116] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-9-ppc64le/09971749-freerouter/backend.log' as PID 1907741