[2025-07-14 17:02:27,769][ INFO][PID:389650] Marking build as starting [2025-07-14 17:02:27,833][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:02:27,834][ INFO][PID:389650] VM allocation process starts [2025-07-14 17:02:27,861][ INFO][PID:389650] Trying to allocate VM: ResallocHost, ticket_id=3923105, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-14 17:02:32,865][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:02:37,870][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:02:42,873][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:02:47,874][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:02:52,876][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:02:57,881][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:02,882][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:07,885][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:12,887][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:17,889][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:22,895][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:27,901][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:32,907][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:37,909][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:42,910][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:47,911][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:52,914][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:03:57,916][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:02,920][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:07,921][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:12,925][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:17,931][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:22,934][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:27,936][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:32,938][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:37,941][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:42,945][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:47,948][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:52,950][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:04:57,952][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:02,954][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:07,955][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:12,956][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:17,958][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:22,959][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:27,961][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:32,962][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:37,963][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:42,965][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:46,133][ INFO][PID:389650] Allocated host ResallocHost, ticket_id=3923105, hostname=140.211.168.81, name=copr_osuosl_p09_prod_05381561_20250714_170129, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-14 17:05:46,135][ INFO][PID:389650] Allocating ssh connection to builder [2025-07-14 17:05:46,137][ INFO][PID:389650] Checking that builder machine is OK [2025-07-14 17:05:47,769][ INFO][PID:389650] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-14 17:05:48,875][ INFO][PID:389650] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-14 17:05:48,876][ INFO][PID:389650] Filling build.info file with builder info [2025-07-14 17:05:48,878][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:05:48,880][ INFO][PID:389650] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "dwmw2", "project_name": "openconnect", "project_dirname": "openconnect", "submitter": null, "ended_on": null, "started_on": 1752512748.8803325, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9272615-fedora-42-ppc64le", "build_id": 9272615, "package_name": "NetworkManager-openconnect", "package_version": "1.2.10.git.67.4ee0443-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/dwmw2/openconnect/NetworkManager-openconnect", "git_hash": "3f1c03acbf501763cb5dd3a364ad16e623ae9a13", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "dwmw2/openconnect--8617d713-cb1e-432c-8abe-77e70a0a900e", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/dwmw2/openconnect", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect", "result_dir": "09272615-NetworkManager-openconnect", "built_packages": "", "id": 9272615, "mockchain_macros": { "copr_username": "dwmw2", "copr_projectname": "openconnect", "vendor": "Fedora Project COPR (dwmw2/openconnect)" } } ] } [2025-07-14 17:05:49,004][ INFO][PID:389650] Sending fedora-messaging bus message in build.start [2025-07-14 17:05:50,203][ INFO][PID:389650] Sending fedora-messaging bus message in chroot.start [2025-07-14 17:05:50,262][ INFO][PID:389650] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272615-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-14 17:05:51,625][ INFO][PID:389650] Downloading the builder-live.log file, attempt 1 [2025-07-14 17:05:51,635][ INFO][PID:389650] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-14 17:05:56,636][ INFO][PID:389650] Periodic builder liveness probe: alive [2025-07-14 17:05:56,637][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:01,638][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:06,640][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:11,667][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:16,674][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:21,676][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:26,678][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:31,680][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:36,681][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:41,684][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:46,688][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:51,691][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:06:56,692][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:01,694][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:06,699][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:11,702][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:16,703][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:21,711][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:26,715][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:31,717][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:36,720][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:41,726][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:46,727][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:51,731][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:07:56,732][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:01,735][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:06,740][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:11,744][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:16,748][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:21,755][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:26,760][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:31,769][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:36,772][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:41,775][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:46,783][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:51,787][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:08:56,789][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:01,791][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:06,793][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:11,805][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:16,808][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:21,817][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:26,823][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:27,140][ ERROR][PID:389650] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 17:09:31,825][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:36,827][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:37,142][WARNING][PID:389650] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 17:09:41,830][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:46,837][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:47,143][ INFO][PID:389650] Downloading the builder-live.log file, attempt 2 [2025-07-14 17:09:47,145][ INFO][PID:389650] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-14 17:09:51,839][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:09:56,841][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:01,845][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:06,847][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:11,850][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:16,852][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:21,854][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:26,865][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:31,872][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:36,875][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:41,877][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:46,880][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:47,288][ ERROR][PID:389650] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 17:10:51,884][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:56,887][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:10:57,292][WARNING][PID:389650] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 17:11:01,890][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:06,893][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:07,295][ INFO][PID:389650] Downloading the builder-live.log file, attempt 3 [2025-07-14 17:11:07,297][ INFO][PID:389650] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-14 17:11:11,894][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:16,896][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:21,897][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:26,900][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:31,905][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:36,907][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:41,909][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:46,915][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:51,917][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:11:56,922][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:01,925][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:06,930][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:07,439][ ERROR][PID:389650] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 17:12:11,934][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:16,935][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:17,465][WARNING][PID:389650] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 17:12:21,937][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:26,940][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:27,467][ INFO][PID:389650] Downloading the builder-live.log file, attempt 4 [2025-07-14 17:12:27,468][ INFO][PID:389650] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.81 copr-rpmbuild-log [2025-07-14 17:12:31,943][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:36,944][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:41,946][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:46,949][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:51,951][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:12:56,958][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:01,960][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:06,961][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:11,963][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:16,966][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:21,967][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:26,971][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:27,607][ ERROR][PID:389650] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 17:13:31,979][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:36,985][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:37,697][ ERROR][PID:389650] Giving up for unstable SSH, failures: 1752512977.1421354, 1752513057.2925148, 1752513137.4658544, 1752513217.6970196 [2025-07-14 17:13:37,698][ ERROR][PID:389650] Re-try request for task on 'ResallocHost, ticket_id=3923105, hostname=140.211.168.81, name=copr_osuosl_p09_prod_05381561_20250714_170129, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-14 17:13:37,699][ INFO][PID:389650] Releasing VM back to pool [2025-07-14 17:13:37,723][ INFO][PID:389650] Retry #1 (on other host) [2025-07-14 17:13:37,723][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:37,724][ INFO][PID:389650] VM allocation process starts [2025-07-14 17:13:37,751][ INFO][PID:389650] Trying to allocate VM: ResallocHost, ticket_id=3923434, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-14 17:13:42,753][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:47,755][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:52,756][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:13:57,758][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:02,763][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:07,767][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:12,775][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:17,777][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:22,780][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:27,781][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:32,782][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:37,784][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:42,787][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:47,792][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:52,795][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:14:57,796][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:02,797][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:07,806][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:12,808][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:17,809][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:22,811][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:27,817][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:32,822][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:37,824][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:42,826][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:47,828][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:52,832][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:15:57,833][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:02,834][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:07,836][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:12,838][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:17,840][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:22,841][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:27,842][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:32,844][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:37,846][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:42,849][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:47,855][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:52,856][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:16:57,858][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:02,860][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:07,865][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:12,866][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:17,884][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:22,885][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:27,889][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:32,892][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:37,893][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:42,898][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:47,900][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:52,904][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:17:57,906][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:02,907][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:07,909][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:12,912][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:17,914][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:22,917][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:27,919][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:32,925][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:37,931][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:42,936][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:47,939][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:52,940][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:18:57,943][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:02,946][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:07,963][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:12,965][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:17,966][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:22,968][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:27,969][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:32,972][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:37,973][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:42,974][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:47,976][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:52,977][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:19:57,979][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:02,980][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:07,982][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:12,988][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:17,992][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:22,996][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:27,998][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:32,999][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:38,001][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:43,004][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:48,011][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:53,015][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:20:58,023][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:03,028][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:08,037][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:13,042][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:18,043][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:23,045][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:28,048][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:33,049][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:38,051][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:43,054][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:48,067][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:53,069][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:21:58,076][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:03,079][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:08,087][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:13,089][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:18,091][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:23,093][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:28,094][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:33,103][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:38,104][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:43,105][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:48,112][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:53,114][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:56,007][ INFO][PID:389650] Allocated host ResallocHost, ticket_id=3923434, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_05382778_20250714_172133, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-14 17:22:56,008][ INFO][PID:389650] Allocating ssh connection to builder [2025-07-14 17:22:56,009][ INFO][PID:389650] Checking that builder machine is OK [2025-07-14 17:22:56,806][ INFO][PID:389650] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-14 17:22:57,259][ INFO][PID:389650] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-14 17:22:57,260][ INFO][PID:389650] Filling build.info file with builder info [2025-07-14 17:22:57,265][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:22:57,266][ INFO][PID:389650] Not re-notifying FE and msg buses for the new host. [2025-07-14 17:22:57,266][ INFO][PID:389650] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272615-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-14 17:22:57,988][ INFO][PID:389650] Downloading the builder-live.log file, attempt 1 [2025-07-14 17:22:57,990][ INFO][PID:389650] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-07-14 17:23:03,006][ INFO][PID:389650] Periodic builder liveness probe: alive [2025-07-14 17:23:03,007][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:08,009][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:13,010][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:18,013][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:23,014][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:28,016][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:33,020][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:38,028][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:43,029][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:48,041][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:53,046][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:23:58,050][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:03,052][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:08,054][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:13,060][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:18,062][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:23,064][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:28,070][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:33,076][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:38,081][ INFO][PID:389650] Checking for cancel request [2025-07-14 17:24:38,423][ INFO][PID:389650] Downloading results from builder [2025-07-14 17:24:38,425][ INFO][PID:389650] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c288]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect started [2025-07-14 17:24:38,427][ INFO][PID:389650] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c288]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/ &> /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/build-09272615.rsync.log [2025-07-14 17:24:39,094][ INFO][PID:389650] rsyncing finished. [2025-07-14 17:24:39,096][ INFO][PID:389650] Releasing VM back to pool [2025-07-14 17:24:39,119][ INFO][PID:389650] Searching for 'success' file in resultdir [2025-07-14 17:24:39,120][ INFO][PID:389650] Going to sign pkgs from source: 9272615-fedora-42-ppc64le in chroot: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le [2025-07-14 17:24:39,120][ INFO][PID:389650] Calling '/bin/sign -u dwmw2#openconnect@copr.fedorahosted.org -p' (attempt #1) [2025-07-14 17:24:39,460][ INFO][PID:389650] Calling '/bin/sign -4 -h sha256 -u dwmw2#openconnect@copr.fedorahosted.org -r /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm' (attempt #1) [2025-07-14 17:24:40,081][ INFO][PID:389650] signed rpm: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm [2025-07-14 17:24:40,085][ INFO][PID:389650] Calling '/bin/sign -4 -h sha256 -u dwmw2#openconnect@copr.fedorahosted.org -r /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-debuginfo-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm' (attempt #1) [2025-07-14 17:24:40,531][ INFO][PID:389650] signed rpm: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-debuginfo-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm [2025-07-14 17:24:40,531][ INFO][PID:389650] Calling '/bin/sign -4 -h sha256 -u dwmw2#openconnect@copr.fedorahosted.org -r /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-gnome-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm' (attempt #1) [2025-07-14 17:24:41,108][ INFO][PID:389650] signed rpm: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-gnome-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm [2025-07-14 17:24:41,109][ INFO][PID:389650] Calling '/bin/sign -4 -h sha256 -u dwmw2#openconnect@copr.fedorahosted.org -r /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-gnome-debuginfo-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm' (attempt #1) [2025-07-14 17:24:41,847][ INFO][PID:389650] signed rpm: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-gnome-debuginfo-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm [2025-07-14 17:24:41,848][ INFO][PID:389650] Calling '/bin/sign -4 -h sha256 -u dwmw2#openconnect@copr.fedorahosted.org -r /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-debugsource-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm' (attempt #1) [2025-07-14 17:24:42,429][ INFO][PID:389650] signed rpm: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-debugsource-1.2.10.git.67.4ee0443-0.fc42.ppc64le.rpm [2025-07-14 17:24:42,430][ INFO][PID:389650] Calling '/bin/sign -4 -h sha256 -u dwmw2#openconnect@copr.fedorahosted.org -r /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-1.2.10.git.67.4ee0443-0.fc42.src.rpm' (attempt #1) [2025-07-14 17:24:43,110][ INFO][PID:389650] signed rpm: /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/NetworkManager-openconnect-1.2.10.git.67.4ee0443-0.fc42.src.rpm [2025-07-14 17:24:43,111][ INFO][PID:389650] Sign done [2025-07-14 17:24:43,112][ INFO][PID:389650] Incremental createrepo run, adding 09272615-NetworkManager-openconnect into https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect/fedora-42-ppc64le, (auto-create-repo=True) [2025-07-14 17:24:43,114][ INFO][PID:389650] Running command 'copr-repo --batched /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le --add 09272615-NetworkManager-openconnect --no-appstream-metadata' as PID 620233 [2025-07-14 17:24:44,341][ INFO][PID:389650] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le --add 09272615-NetworkManager-openconnect --no-appstream-metadata) [2025-07-14 17:24:44,342][ INFO][PID:389650] Getting build details [2025-07-14 17:24:44,344][ INFO][PID:389650] Listing built binary packages in /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect [2025-07-14 17:24:44,344][ INFO][PID:389650] Built packages: ['NetworkManager-openconnect-debuginfo 1.2.10.git.67.4ee0443', 'NetworkManager-openconnect-debugsource 1.2.10.git.67.4ee0443', 'NetworkManager-openconnect 1.2.10.git.67.4ee0443', 'NetworkManager-openconnect-gnome 1.2.10.git.67.4ee0443', 'NetworkManager-openconnect-gnome-debuginfo 1.2.10.git.67.4ee0443'] [2025-07-14 17:24:44,346][ INFO][PID:389650] build details: {'built_packages': 'NetworkManager-openconnect-debuginfo 1.2.10.git.67.4ee0443\nNetworkManager-openconnect-debugsource 1.2.10.git.67.4ee0443\nNetworkManager-openconnect 1.2.10.git.67.4ee0443\nNetworkManager-openconnect-gnome 1.2.10.git.67.4ee0443\nNetworkManager-openconnect-gnome-debuginfo 1.2.10.git.67.4ee0443'} [2025-07-14 17:24:44,351][ INFO][PID:389650] Retrieving pubkey [2025-07-14 17:24:44,352][ INFO][PID:389650] Calling '/bin/sign -u dwmw2#openconnect@copr.fedorahosted.org -p' (attempt #1) [2025-07-14 17:24:44,710][ INFO][PID:389650] Added pubkey for user dwmw2 project openconnect into: /var/lib/copr/public_html/results/dwmw2/openconnect/pubkey.gpg [2025-07-14 17:24:44,712][ INFO][PID:389650] Finished build: id=9272615 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/dwmw2/openconnect chroot=fedora-42-ppc64le [2025-07-14 17:24:44,717][ INFO][PID:389650] Worker succeeded build, took 107.45095491409302 [2025-07-14 17:24:44,719][ INFO][PID:389650] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "dwmw2", "project_name": "openconnect", "project_dirname": "openconnect", "submitter": null, "ended_on": 1752513884.717049, "started_on": 1752513777.266094, "submitted_on": null, "status": 1, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9272615-fedora-42-ppc64le", "build_id": 9272615, "package_name": "NetworkManager-openconnect", "package_version": "1.2.10.git.67.4ee0443-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/dwmw2/openconnect/NetworkManager-openconnect", "git_hash": "3f1c03acbf501763cb5dd3a364ad16e623ae9a13", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "dwmw2/openconnect--8617d713-cb1e-432c-8abe-77e70a0a900e", "results": { "packages": [ { "name": "NetworkManager-openconnect-debuginfo", "epoch": null, "version": "1.2.10.git.67.4ee0443", "release": "0.fc42", "arch": "ppc64le" }, { "name": "NetworkManager-openconnect-debugsource", "epoch": null, "version": "1.2.10.git.67.4ee0443", "release": "0.fc42", "arch": "ppc64le" }, { "name": "NetworkManager-openconnect", "epoch": null, "version": "1.2.10.git.67.4ee0443", "release": "0.fc42", "arch": "ppc64le" }, { "name": "NetworkManager-openconnect-gnome", "epoch": null, "version": "1.2.10.git.67.4ee0443", "release": "0.fc42", "arch": "ppc64le" }, { "name": "NetworkManager-openconnect-gnome-debuginfo", "epoch": null, "version": "1.2.10.git.67.4ee0443", "release": "0.fc42", "arch": "ppc64le" }, { "name": "NetworkManager-openconnect", "epoch": null, "version": "1.2.10.git.67.4ee0443", "release": "0.fc42", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/dwmw2/openconnect", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect", "result_dir": "09272615-NetworkManager-openconnect", "built_packages": "NetworkManager-openconnect-debuginfo 1.2.10.git.67.4ee0443\nNetworkManager-openconnect-debugsource 1.2.10.git.67.4ee0443\nNetworkManager-openconnect 1.2.10.git.67.4ee0443\nNetworkManager-openconnect-gnome 1.2.10.git.67.4ee0443\nNetworkManager-openconnect-gnome-debuginfo 1.2.10.git.67.4ee0443", "id": 9272615, "mockchain_macros": { "copr_username": "dwmw2", "copr_projectname": "openconnect", "vendor": "Fedora Project COPR (dwmw2/openconnect)" } } ] } [2025-07-14 17:24:44,774][ INFO][PID:389650] Sending fedora-messaging bus message in build.end [2025-07-14 17:24:44,805][ INFO][PID:389650] Compressing /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/builder-live.log by gzip [2025-07-14 17:24:44,807][ INFO][PID:389650] Running command 'gzip /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/builder-live.log' as PID 620371 [2025-07-14 17:24:44,820][ INFO][PID:389650] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/builder-live.log) [2025-07-14 17:24:44,821][ INFO][PID:389650] Compressing /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/backend.log by gzip [2025-07-14 17:24:44,823][ INFO][PID:389650] Running command 'gzip /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/09272615-NetworkManager-openconnect/backend.log' as PID 620375