[2026-01-17 06:42:48,436][ INFO][PID:86769] Marking build as starting [2026-01-17 06:42:48,529][ INFO][PID:86769] Checking that /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-17 06:42:48,530][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:42:48,535][ INFO][PID:86769] VM allocation process starts [2026-01-17 06:42:48,557][ INFO][PID:86769] Trying to allocate VM: ResallocHost, ticket_id=877771, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-17 06:42:53,561][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:42:58,563][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:03,564][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:08,565][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:13,576][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:18,680][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:23,728][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:28,729][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:33,792][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:38,796][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:43,797][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:48,800][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:54,072][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:43:59,075][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:04,080][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:09,082][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:14,085][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:19,094][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:24,098][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:29,106][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:34,108][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:44:36,726][ INFO][PID:86769] Allocated host ResallocHost, ticket_id=877771, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01325716_20260117_063955, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-17 06:44:36,728][ INFO][PID:86769] Allocating ssh connection to builder [2026-01-17 06:44:36,729][ INFO][PID:86769] Checking that builder machine is OK [2026-01-17 06:45:36,838][ ERROR][PID:86769] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18f port 22: Connection timed out [2026-01-17 06:45:46,898][ ERROR][PID:86769] Re-try request for task on 'ResallocHost, ticket_id=877771, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01325716_20260117_063955, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2026-01-17 06:45:46,899][ INFO][PID:86769] Releasing VM back to pool [2026-01-17 06:45:46,913][ INFO][PID:86769] Retry #1 (on other host) [2026-01-17 06:45:46,918][ INFO][PID:86769] Checking that /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/repodata/repomd.xml exists [2026-01-17 06:45:46,918][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:45:46,919][ INFO][PID:86769] VM allocation process starts [2026-01-17 06:45:46,936][ INFO][PID:86769] Trying to allocate VM: ResallocHost, ticket_id=877927, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-17 06:45:51,941][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:45:56,943][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:01,946][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:06,954][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:11,965][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:16,966][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:21,967][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:26,969][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:31,973][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:36,975][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:41,983][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:46,988][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:51,993][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:46:56,995][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:01,999][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:07,000][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:12,005][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:17,007][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:22,016][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:27,019][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:32,021][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:37,030][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:42,032][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:47,035][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:52,041][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:47:57,049][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:02,053][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:07,055][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:12,078][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:17,081][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:22,083][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:27,157][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:32,222][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:37,294][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:42,297][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:47,352][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:52,358][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:48:57,360][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:02,363][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:07,365][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:12,366][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:17,367][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:22,369][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:27,373][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:32,378][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:37,386][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:42,389][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:47,392][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:52,393][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:49:57,395][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:02,396][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:05,219][ INFO][PID:86769] Allocated host ResallocHost, ticket_id=877927, hostname=140.211.168.180, name=copr_osuosl_p09_prod_01325914_20260117_064405, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-17 06:50:05,219][ INFO][PID:86769] Allocating ssh connection to builder [2026-01-17 06:50:05,220][ INFO][PID:86769] Checking that builder machine is OK [2026-01-17 06:50:06,668][ INFO][PID:86769] Running remote command: copr-builder-ready epel-9-ppc64le [2026-01-17 06:50:07,644][ INFO][PID:86769] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-01-17 06:50:07,645][ INFO][PID:86769] Filling build.info file with builder info [2026-01-17 06:50:07,688][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:07,696][ INFO][PID:86769] Not re-notifying FE and msg buses for the new host. [2026-01-17 06:50:07,697][ INFO][PID:86769] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10026701-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2026-01-17 06:50:09,406][ INFO][PID:86769] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.180' (ED25519) to the list of known hosts. [2026-01-17 06:50:09,407][ INFO][PID:86769] Downloading the builder-live.log file, attempt 1 [2026-01-17 06:50:09,408][ INFO][PID:86769] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.180 copr-rpmbuild-log [2026-01-17 06:50:14,422][ INFO][PID:86769] Periodic builder liveness probe: alive [2026-01-17 06:50:14,423][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:19,427][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:24,429][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:29,430][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:34,435][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:39,437][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:44,440][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:49,441][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:54,442][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:50:59,444][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:04,446][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:09,448][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:14,449][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:19,450][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:24,502][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:29,503][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:34,549][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:39,550][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:44,551][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:49,554][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:54,555][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:51:59,557][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:04,563][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:09,567][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:14,569][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:19,570][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:24,571][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:29,572][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:34,573][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:39,577][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:44,579][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:49,583][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:54,585][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:52:59,587][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:53:04,588][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:53:09,589][ INFO][PID:86769] Checking for cancel request [2026-01-17 06:53:11,413][ INFO][PID:86769] Downloading results from builder [2026-01-17 06:53:11,414][ INFO][PID:86769] rsyncing of mockbuilder@140.211.168.180:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns started [2026-01-17 06:53:11,415][ INFO][PID:86769] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.180:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/ &> /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/build-10026701.rsync.log [2026-01-17 06:53:13,252][ INFO][PID:86769] rsyncing finished. [2026-01-17 06:53:13,252][ INFO][PID:86769] Releasing VM back to pool [2026-01-17 06:53:13,266][ INFO][PID:86769] Searching for 'success' file in resultdir [2026-01-17 06:53:13,266][ INFO][PID:86769] Going to sign pkgs from source: 10026701-epel-9-ppc64le in chroot: /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le [2026-01-17 06:53:13,267][ INFO][PID:86769] Calling '/bin/sign -u matthewdva#certbot@copr.fedorahosted.org -p' (attempt #1) [2026-01-17 06:53:13,463][ INFO][PID:86769] Calling '/bin/sign -4 -h sha256 -u matthewdva#certbot@copr.fedorahosted.org -r /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/python-certbot-dns-luadns-2.1.0-12.el9.src.rpm' (attempt #1) [2026-01-17 06:53:14,039][ INFO][PID:86769] signed rpm: /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/python-certbot-dns-luadns-2.1.0-12.el9.src.rpm [2026-01-17 06:53:14,040][ INFO][PID:86769] Calling '/bin/sign -4 -h sha256 -u matthewdva#certbot@copr.fedorahosted.org -r /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/python-certbot-dns-luadns-doc-2.1.0-12.el9.noarch.rpm' (attempt #1) [2026-01-17 06:53:14,660][ INFO][PID:86769] signed rpm: /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/python-certbot-dns-luadns-doc-2.1.0-12.el9.noarch.rpm [2026-01-17 06:53:14,661][ INFO][PID:86769] Calling '/bin/sign -4 -h sha256 -u matthewdva#certbot@copr.fedorahosted.org -r /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/python3-certbot-dns-luadns-2.1.0-12.el9.noarch.rpm' (attempt #1) [2026-01-17 06:53:15,118][ INFO][PID:86769] signed rpm: /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/python3-certbot-dns-luadns-2.1.0-12.el9.noarch.rpm [2026-01-17 06:53:15,118][ INFO][PID:86769] Sign done [2026-01-17 06:53:15,120][ INFO][PID:86769] Incremental createrepo run, adding 10026701-python-certbot-dns-luadns into https://download.copr.fedorainfracloud.org/results/matthewdva/certbot/epel-9-ppc64le, (auto-create-repo=True) [2026-01-17 06:53:15,123][ INFO][PID:86769] Running command 'copr-repo --batched /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le --add 10026701-python-certbot-dns-luadns --no-appstream-metadata' as PID 175681 [2026-01-17 06:53:16,666][ INFO][PID:86769] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le --add 10026701-python-certbot-dns-luadns --no-appstream-metadata) [2026-01-17 06:53:16,670][ INFO][PID:86769] Getting build details [2026-01-17 06:53:16,671][ INFO][PID:86769] Listing built binary packages in /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns [2026-01-17 06:53:16,673][ INFO][PID:86769] Built packages: ['python3-certbot-dns-luadns 2.1.0', 'python-certbot-dns-luadns-doc 2.1.0'] [2026-01-17 06:53:16,674][ INFO][PID:86769] build details: {'built_packages': 'python3-certbot-dns-luadns 2.1.0\npython-certbot-dns-luadns-doc 2.1.0'} [2026-01-17 06:53:16,675][ INFO][PID:86769] Retrieving pubkey [2026-01-17 06:53:16,677][ INFO][PID:86769] Calling '/bin/sign -u matthewdva#certbot@copr.fedorahosted.org -p' (attempt #1) [2026-01-17 06:53:17,000][ INFO][PID:86769] Added pubkey for user matthewdva project certbot into: /var/lib/copr/public_html/results/matthewdva/certbot/pubkey.gpg [2026-01-17 06:53:17,001][ INFO][PID:86769] Finished build: id=10026701 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/matthewdva/certbot chroot=epel-9-ppc64le [2026-01-17 06:53:17,006][ INFO][PID:86769] Worker succeeded build, took 189.31020665168762 [2026-01-17 06:53:17,008][ INFO][PID:86769] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "matthewdva", "project_name": "certbot", "project_dirname": "certbot", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": 1768632797.0066242, "started_on": 1768632607.6964176, "submitted_on": null, "status": 1, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10026701-epel-9-ppc64le", "build_id": 10026701, "package_name": "python-certbot-dns-luadns", "package_version": "2.1.0-12", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/matthewdva/certbot/python-certbot-dns-luadns", "git_hash": "109a752f13aedd00e1a075cb17156c5ec9f90653", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "matthewdva/certbot--https://src.fedoraproject.org/user/releng", "results": { "packages": [ { "name": "python3-certbot-dns-luadns", "epoch": null, "version": "2.1.0", "release": "12.el9", "arch": "noarch" }, { "name": "python-certbot-dns-luadns-doc", "epoch": null, "version": "2.1.0", "release": "12.el9", "arch": "noarch" }, { "name": "python-certbot-dns-luadns", "epoch": null, "version": "2.1.0", "release": "12.el9", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://dl.fedoraproject.org/pub/epel/testing/$releasever/Everything/$basearch", "id": "https_dl_fedoraproject_org_pub_epel_testing_releasever_Everything_basearch", "name": "Additional repo https_dl_fedoraproject_org_pub_epel_testing_releasever_Everything_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/matthewdva/certbot", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot", "result_dir": "10026701-python-certbot-dns-luadns", "built_packages": "python3-certbot-dns-luadns 2.1.0\npython-certbot-dns-luadns-doc 2.1.0", "id": 10026701, "mockchain_macros": { "copr_username": "matthewdva", "copr_projectname": "certbot", "vendor": "Fedora Project COPR (matthewdva/certbot)" } } ] } [2026-01-17 06:53:17,113][ INFO][PID:86769] Sending fedora-messaging bus message in build.end [2026-01-17 06:53:18,078][ INFO][PID:86769] Compressing /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/builder-live.log by gzip [2026-01-17 06:53:18,081][ INFO][PID:86769] Running command 'gzip /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/builder-live.log' as PID 176026 [2026-01-17 06:53:18,121][ INFO][PID:86769] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/builder-live.log) [2026-01-17 06:53:18,122][ INFO][PID:86769] Compressing /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/backend.log by gzip [2026-01-17 06:53:18,124][ INFO][PID:86769] Running command 'gzip /var/lib/copr/public_html/results/matthewdva/certbot/epel-9-ppc64le/10026701-python-certbot-dns-luadns/backend.log' as PID 176032