[2025-12-30 03:23:28,841][ INFO][PID:4147569] Marking build as starting [2025-12-30 03:23:28,920][ INFO][PID:4147569] Checking that /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/repodata/repomd.xml exists [2025-12-30 03:23:29,558][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:23:29,559][ INFO][PID:4147569] VM allocation process starts [2025-12-30 03:23:29,571][ INFO][PID:4147569] Trying to allocate VM: ResallocHost, ticket_id=569976, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-30 03:23:34,572][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:23:39,573][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:23:44,574][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:23:49,576][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:23:54,577][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:23:59,578][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:04,579][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:09,580][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:14,580][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:19,581][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:24,582][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:29,583][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:34,584][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:39,585][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:44,587][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:49,588][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:54,589][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:24:59,590][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:04,591][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:09,592][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:14,594][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:19,595][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:24,596][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:29,597][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:34,598][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:39,599][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:44,600][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:49,601][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:54,602][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:25:59,603][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:04,605][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:09,606][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:14,607][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:19,608][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:24,609][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:29,610][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:34,612][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:39,613][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:44,614][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:49,615][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:54,616][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:26:59,617][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:04,618][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:09,619][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:14,620][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:19,621][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:24,622][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:29,623][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:34,624][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:39,635][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:44,640][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:49,642][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:27:54,756][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:00,165][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:05,166][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:10,170][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:15,172][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:20,173][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:25,174][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:30,175][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:35,176][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:40,180][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:45,181][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:50,183][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:28:55,184][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:00,186][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:05,187][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:10,188][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:15,189][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:20,191][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:25,192][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:30,193][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:35,194][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:40,195][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:45,196][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:47,682][ INFO][PID:4147569] Allocated host ResallocHost, ticket_id=569976, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00836551_20251230_032444, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-30 03:29:47,936][ INFO][PID:4147569] Allocating ssh connection to builder [2025-12-30 03:29:47,937][ INFO][PID:4147569] Checking that builder machine is OK [2025-12-30 03:29:48,863][ INFO][PID:4147569] Running remote command: copr-builder-ready epel-10-ppc64le [2025-12-30 03:29:49,362][ INFO][PID:4147569] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-12-30 03:29:49,363][ INFO][PID:4147569] Filling build.info file with builder info [2025-12-30 03:29:49,363][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:29:49,364][ INFO][PID:4147569] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "https://api.github.com/users/nuqleo", "ended_on": null, "started_on": 1767065389.3647726, "submitted_on": null, "status": 3, "chroot": "epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9960154-epel-10-ppc64le", "build_id": 9960154, "package_name": "freerouter", "package_version": "25.12.29-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "ec7d3a1b6e7cf33b0d901cb0b5cdd8b1d608bb36", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09960154-freerouter", "built_packages": "", "id": 9960154, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2025-12-30 03:29:49,464][ INFO][PID:4147569] Sending fedora-messaging bus message in build.start [2025-12-30 03:29:49,979][ INFO][PID:4147569] Sending fedora-messaging bus message in chroot.start [2025-12-30 03:29:50,008][ INFO][PID:4147569] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9960154-epel-10-ppc64le --chroot epel-10-ppc64le --detached [2025-12-30 03:29:50,964][ INFO][PID:4147569] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18a' (ED25519) to the list of known hosts. [2025-12-30 03:29:50,965][ INFO][PID:4147569] Downloading the builder-live.log file, attempt 1 [2025-12-30 03:29:50,967][ INFO][PID:4147569] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log [2025-12-30 03:29:55,976][ INFO][PID:4147569] Periodic builder liveness probe: alive [2025-12-30 03:29:55,977][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:00,978][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:05,979][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:10,980][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:15,981][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:20,982][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:25,983][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:30,984][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:35,987][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:40,988][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:45,989][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:50,990][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:30:55,991][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:00,992][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:05,994][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:10,995][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:15,996][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:20,997][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:25,998][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:30,999][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:36,000][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:41,001][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:46,003][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:51,004][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:31:56,006][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:01,007][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:06,008][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:11,009][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:16,011][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:21,012][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:26,013][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:31,014][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:36,015][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:41,016][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:46,172][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:51,173][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:32:56,174][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:01,175][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:06,177][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:11,178][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:16,191][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:21,227][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:26,262][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:31,263][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:36,264][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:41,623][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:46,753][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:51,755][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:33:56,756][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:01,758][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:06,759][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:11,843][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:16,890][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:21,893][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:26,894][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:31,895][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:36,896][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:41,897][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:47,109][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:52,111][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:57,351][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:34:59,535][ ERROR][PID:4147569] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-30 03:35:02,352][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:07,353][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:09,536][WARNING][PID:4147569] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-30 03:35:12,354][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:17,476][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:19,536][ INFO][PID:4147569] Downloading the builder-live.log file, attempt 2 [2025-12-30 03:35:19,538][ INFO][PID:4147569] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log [2025-12-30 03:35:22,478][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:27,480][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:32,481][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:37,483][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:42,484][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:47,488][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:52,491][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:35:57,492][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:02,493][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:07,494][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:12,495][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:17,496][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:19,589][ ERROR][PID:4147569] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-30 03:36:22,497][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:27,499][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:29,806][WARNING][PID:4147569] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-30 03:36:32,499][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:37,501][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:39,856][ INFO][PID:4147569] Downloading the builder-live.log file, attempt 3 [2025-12-30 03:36:40,174][ INFO][PID:4147569] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log [2025-12-30 03:36:42,502][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:47,503][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:52,504][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:36:57,505][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:02,507][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:07,508][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:12,509][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:17,510][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:22,511][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:27,512][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:32,513][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:37,514][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:40,241][ ERROR][PID:4147569] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-30 03:37:42,516][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:47,517][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:50,275][WARNING][PID:4147569] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-30 03:37:52,519][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:37:57,520][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:00,276][ INFO][PID:4147569] Downloading the builder-live.log file, attempt 4 [2025-12-30 03:38:00,277][ INFO][PID:4147569] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18a copr-rpmbuild-log [2025-12-30 03:38:02,522][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:07,523][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:12,525][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:17,525][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:22,527][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:27,528][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:32,528][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:37,529][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:42,530][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:47,532][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:52,533][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:38:57,534][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:00,335][ ERROR][PID:4147569] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-30 03:39:02,535][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:07,536][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:10,348][ ERROR][PID:4147569] Giving up for unstable SSH, failures: 1767065709.5361733, 1767065789.8059921, 1767065870.2753634, 1767065950.3483632 [2025-12-30 03:39:10,349][ ERROR][PID:4147569] Re-try request for task on 'ResallocHost, ticket_id=569976, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00836551_20251230_032444, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-30 03:39:10,350][ INFO][PID:4147569] Releasing VM back to pool [2025-12-30 03:39:10,360][ INFO][PID:4147569] Retry #1 (on other host) [2025-12-30 03:39:10,361][ INFO][PID:4147569] Checking that /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/repodata/repomd.xml exists [2025-12-30 03:39:10,361][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:10,362][ INFO][PID:4147569] VM allocation process starts [2025-12-30 03:39:10,373][ INFO][PID:4147569] Trying to allocate VM: ResallocHost, ticket_id=570184, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-30 03:39:15,374][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:20,375][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:25,376][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:30,377][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:35,378][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:40,379][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:45,380][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:50,381][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:39:55,382][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:00,387][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:05,388][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:10,389][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:15,390][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:20,391][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:25,392][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:30,428][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:35,429][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:38,465][ INFO][PID:4147569] Allocated host ResallocHost, ticket_id=570184, hostname=140.211.168.229, name=copr_osuosl_p09_prod_00836737_20251230_033702, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-30 03:40:38,466][ INFO][PID:4147569] Allocating ssh connection to builder [2025-12-30 03:40:38,467][ INFO][PID:4147569] Checking that builder machine is OK [2025-12-30 03:40:40,108][ INFO][PID:4147569] Running remote command: copr-builder-ready epel-10-ppc64le [2025-12-30 03:40:41,151][ INFO][PID:4147569] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-12-30 03:40:41,152][ INFO][PID:4147569] Filling build.info file with builder info [2025-12-30 03:40:41,165][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:41,167][ INFO][PID:4147569] Not re-notifying FE and msg buses for the new host. [2025-12-30 03:40:41,167][ INFO][PID:4147569] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9960154-epel-10-ppc64le --chroot epel-10-ppc64le --detached [2025-12-30 03:40:42,731][ INFO][PID:4147569] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.229' (ED25519) to the list of known hosts. [2025-12-30 03:40:42,732][ INFO][PID:4147569] Downloading the builder-live.log file, attempt 1 [2025-12-30 03:40:42,733][ INFO][PID:4147569] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log [2025-12-30 03:40:47,771][ INFO][PID:4147569] Periodic builder liveness probe: alive [2025-12-30 03:40:47,772][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:52,772][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:40:57,774][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:02,775][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:07,776][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:12,777][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:17,778][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:22,779][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:27,780][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:32,781][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:37,784][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:42,788][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:47,793][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:52,794][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:41:57,796][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:02,797][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:07,798][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:12,799][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:17,800][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:22,802][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:27,803][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:32,805][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:37,806][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:42,807][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:47,808][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:52,809][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:42:57,810][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:02,812][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:07,813][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:12,815][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:17,816][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:22,817][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:27,818][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:32,819][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:37,821][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:42,822][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:47,825][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:52,827][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:43:57,828][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:02,828][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:07,829][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:12,830][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:17,831][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:22,832][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:27,834][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:32,835][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:37,837][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:42,847][ INFO][PID:4147569] Checking for cancel request [2025-12-30 03:44:44,495][ INFO][PID:4147569] Downloading results from builder [2025-12-30 03:44:44,496][ INFO][PID:4147569] rsyncing of mockbuilder@140.211.168.229:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter started [2025-12-30 03:44:44,497][ INFO][PID:4147569] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.229:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/ &> /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/build-09960154.rsync.log [2025-12-30 03:44:47,246][ INFO][PID:4147569] rsyncing finished. [2025-12-30 03:44:47,247][ INFO][PID:4147569] Releasing VM back to pool [2025-12-30 03:44:47,256][ INFO][PID:4147569] Searching for 'success' file in resultdir [2025-12-30 03:44:47,257][ INFO][PID:4147569] Going to sign pkgs from source: 9960154-epel-10-ppc64le in chroot: /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le [2025-12-30 03:44:47,258][ INFO][PID:4147569] Calling '/bin/sign -u nucleo#freerouter@copr.fedorahosted.org -p' (attempt #1) [2025-12-30 03:44:47,449][ INFO][PID:4147569] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-native-25.12.29-1.el10.ppc64le.rpm' (attempt #1) [2025-12-30 03:44:47,944][ INFO][PID:4147569] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-native-25.12.29-1.el10.ppc64le.rpm [2025-12-30 03:44:47,945][ INFO][PID:4147569] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-native-debuginfo-25.12.29-1.el10.ppc64le.rpm' (attempt #1) [2025-12-30 03:44:48,516][ INFO][PID:4147569] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-native-debuginfo-25.12.29-1.el10.ppc64le.rpm [2025-12-30 03:44:48,517][ INFO][PID:4147569] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-doc-25.12.29-1.el10.noarch.rpm' (attempt #1) [2025-12-30 03:44:49,199][ INFO][PID:4147569] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-doc-25.12.29-1.el10.noarch.rpm [2025-12-30 03:44:49,199][ INFO][PID:4147569] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-25.12.29-1.el10.src.rpm' (attempt #1) [2025-12-30 03:44:50,076][ INFO][PID:4147569] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-25.12.29-1.el10.src.rpm [2025-12-30 03:44:50,078][ INFO][PID:4147569] Calling '/bin/sign -4 -h sha256 -u nucleo#freerouter@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-25.12.29-1.el10.ppc64le.rpm' (attempt #1) [2025-12-30 03:44:51,058][ INFO][PID:4147569] signed rpm: /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/freerouter-25.12.29-1.el10.ppc64le.rpm [2025-12-30 03:44:51,058][ INFO][PID:4147569] Sign done [2025-12-30 03:44:51,059][ INFO][PID:4147569] Incremental createrepo run, adding 09960154-freerouter into https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-10-ppc64le, (auto-create-repo=True) [2025-12-30 03:44:51,059][ INFO][PID:4147569] Running command 'copr-repo --batched /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le --add 09960154-freerouter --no-appstream-metadata' as PID 68975 [2025-12-30 03:44:52,122][ INFO][PID:4147569] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le --add 09960154-freerouter --no-appstream-metadata) [2025-12-30 03:44:52,123][ INFO][PID:4147569] Getting build details [2025-12-30 03:44:52,123][ INFO][PID:4147569] Listing built binary packages in /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter [2025-12-30 03:44:52,124][ INFO][PID:4147569] Built packages: ['freerouter 25.12.29', 'freerouter-doc 25.12.29', 'freerouter-native-debuginfo 25.12.29', 'freerouter-native 25.12.29'] [2025-12-30 03:44:52,125][ INFO][PID:4147569] build details: {'built_packages': 'freerouter 25.12.29\nfreerouter-doc 25.12.29\nfreerouter-native-debuginfo 25.12.29\nfreerouter-native 25.12.29'} [2025-12-30 03:44:52,125][ INFO][PID:4147569] Retrieving pubkey [2025-12-30 03:44:52,125][ INFO][PID:4147569] Calling '/bin/sign -u nucleo#freerouter@copr.fedorahosted.org -p' (attempt #1) [2025-12-30 03:44:52,420][ INFO][PID:4147569] Added pubkey for user nucleo project freerouter into: /var/lib/copr/public_html/results/nucleo/freerouter/pubkey.gpg [2025-12-30 03:44:52,421][ INFO][PID:4147569] Finished build: id=9960154 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/nucleo/freerouter chroot=epel-10-ppc64le [2025-12-30 03:44:52,423][ INFO][PID:4147569] Worker succeeded build, took 251.25659728050232 [2025-12-30 03:44:52,424][ INFO][PID:4147569] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "freerouter", "project_dirname": "freerouter", "submitter": "https://api.github.com/users/nuqleo", "ended_on": 1767066292.4237187, "started_on": 1767066041.1671214, "submitted_on": null, "status": 1, "chroot": "epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9960154-epel-10-ppc64le", "build_id": 9960154, "package_name": "freerouter", "package_version": "25.12.29-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter", "git_hash": "ec7d3a1b6e7cf33b0d901cb0b5cdd8b1d608bb36", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo", "results": { "packages": [ { "name": "freerouter", "epoch": null, "version": "25.12.29", "release": "1.el10", "arch": "ppc64le" }, { "name": "freerouter-doc", "epoch": null, "version": "25.12.29", "release": "1.el10", "arch": "noarch" }, { "name": "freerouter", "epoch": null, "version": "25.12.29", "release": "1.el10", "arch": "src" }, { "name": "freerouter-native-debuginfo", "epoch": null, "version": "25.12.29", "release": "1.el10", "arch": "ppc64le" }, { "name": "freerouter-native", "epoch": null, "version": "25.12.29", "release": "1.el10", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter", "result_dir": "09960154-freerouter", "built_packages": "freerouter 25.12.29\nfreerouter-doc 25.12.29\nfreerouter-native-debuginfo 25.12.29\nfreerouter-native 25.12.29", "id": 9960154, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "freerouter", "vendor": "Fedora Project COPR (nucleo/freerouter)" } } ] } [2025-12-30 03:44:52,546][ INFO][PID:4147569] Sending fedora-messaging bus message in build.end [2025-12-30 03:44:52,576][ INFO][PID:4147569] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/builder-live.log by gzip [2025-12-30 03:44:52,577][ INFO][PID:4147569] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/builder-live.log' as PID 69111 [2025-12-30 03:44:52,608][ INFO][PID:4147569] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/builder-live.log) [2025-12-30 03:44:52,609][ INFO][PID:4147569] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/backend.log by gzip [2025-12-30 03:44:52,610][ INFO][PID:4147569] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09960154-freerouter/backend.log' as PID 69128