[2026-04-01 10:46:35,824][ INFO][PID:2046523] Marking build as starting [2026-04-01 10:46:35,927][ INFO][PID:2046523] Checking that /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-01 10:46:36,034][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:46:36,037][ INFO][PID:2046523] VM allocation process starts [2026-04-01 10:46:36,060][ INFO][PID:2046523] Trying to allocate VM: ResallocHost, ticket_id=2131220, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-01 10:46:39,154][ INFO][PID:2046523] Allocated host ResallocHost, ticket_id=2131220, hostname=18.206.187.155, name=aws_x86_64_spot_prod_04448839_20260401_104354, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-01 10:46:39,155][ INFO][PID:2046523] Allocating ssh connection to builder [2026-04-01 10:46:39,156][ INFO][PID:2046523] Checking that builder machine is OK [2026-04-01 10:46:39,483][ INFO][PID:2046523] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-01 10:46:39,753][ INFO][PID:2046523] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-01 10:46:39,754][ INFO][PID:2046523] Filling build.info file with builder info [2026-04-01 10:46:39,755][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:46:39,763][ INFO][PID:2046523] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "lecris", "project_name": "nightly", "project_dirname": "nightly", "submitter": "packit", "ended_on": null, "started_on": 1775040399.7634077, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10282424-fedora-rawhide-x86_64", "build_id": 10282424, "package_name": "cp2k", "package_version": "0.0.0-1.20260401104610381033.master", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lecris/nightly/cp2k", "git_hash": "8fa9521f28b43ee6ccf212466ffb46e314879af0", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "lecris/nightly--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/lecris/nightly/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/lecris/nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lecris/nightly", "result_dir": "10282424-cp2k", "built_packages": "", "id": 10282424, "mockchain_macros": { "copr_username": "lecris", "copr_projectname": "nightly", "vendor": "Fedora Project COPR (lecris/nightly)" } } ] } [2026-04-01 10:46:39,825][ INFO][PID:2046523] Sending fedora-messaging bus message in build.start [2026-04-01 10:46:40,874][ INFO][PID:2046523] Sending fedora-messaging bus message in chroot.start [2026-04-01 10:46:40,943][ INFO][PID:2046523] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10282424-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-01 10:46:41,320][ INFO][PID:2046523] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '18.206.187.155' (ED25519) to the list of known hosts. [2026-04-01 10:46:41,320][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 1 [2026-04-01 10:46:41,327][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.206.187.155 copr-rpmbuild-log [2026-04-01 10:46:46,332][ INFO][PID:2046523] Periodic builder liveness probe: alive [2026-04-01 10:46:46,332][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:46:51,333][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:46:56,335][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:01,342][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:06,345][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:11,346][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:16,347][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:21,350][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:26,351][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:31,352][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:36,353][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:41,354][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:46,407][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:51,408][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:47:56,409][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:01,413][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:06,414][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:11,416][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:16,417][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:21,460][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:26,461][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:31,462][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:36,463][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:41,464][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:46,465][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:51,466][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:48:56,467][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:01,468][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:06,469][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:11,470][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:16,471][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:21,472][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:26,473][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:31,473][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:36,474][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:41,475][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:46,476][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:51,477][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:49:56,478][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:01,479][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:06,480][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:11,481][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:16,482][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:21,483][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:26,484][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:31,485][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:36,486][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:41,488][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:46,489][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:51,490][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:50:56,491][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:01,492][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:06,493][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:11,494][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:16,495][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:21,697][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:26,698][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:31,700][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:36,701][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:41,702][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:46,703][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:51,704][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:51:56,705][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:01,706][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:06,707][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:11,709][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:16,710][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:21,711][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:26,713][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:31,714][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:36,715][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:41,716][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:46,720][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:51,721][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:52:56,723][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:01,725][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:06,726][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:11,727][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:16,728][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:21,730][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:26,731][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:31,732][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:36,733][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:41,734][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:46,735][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:51,736][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:53:56,737][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:01,738][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:06,739][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:11,740][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:16,741][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:21,742][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:26,743][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:31,744][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:36,745][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:41,747][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:46,748][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:51,752][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:54:56,754][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:01,757][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:06,761][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:11,763][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:16,766][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:21,767][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:26,768][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:31,770][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:36,772][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:41,774][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:46,776][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:51,778][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:55:56,780][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:01,783][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:06,784][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:11,786][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:16,787][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:21,791][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:26,803][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:31,807][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:36,882][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:41,916][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:46,926][ INFO][PID:2046523] Periodic builder liveness probe: alive [2026-04-01 10:56:46,927][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:51,928][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:56:56,929][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:01,931][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:06,932][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:11,943][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:16,994][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:21,995][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:26,996][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:31,997][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:37,000][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:42,006][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:47,007][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:52,027][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:57:57,028][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:02,029][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:07,030][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:12,031][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:17,032][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:22,033][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:27,127][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:32,128][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:37,129][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:42,131][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:47,132][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:52,133][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:58:57,134][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:02,135][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:07,136][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:12,137][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:17,138][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:22,139][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:27,140][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:32,141][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:37,142][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:42,143][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:47,144][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:52,145][ INFO][PID:2046523] Checking for cancel request [2026-04-01 10:59:57,146][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:02,148][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:07,149][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:12,149][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:17,150][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:22,152][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:27,153][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:32,154][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:37,155][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:42,156][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:47,158][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:52,162][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:00:57,167][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:02,168][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:07,169][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:12,170][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:17,216][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:22,219][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:27,221][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:32,223][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:37,225][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:42,226][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:47,228][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:52,242][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:01:57,243][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:02,243][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:07,245][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:12,246][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:17,247][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:22,248][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:27,511][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:32,711][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:37,770][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:42,771][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:47,773][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:52,903][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:02:57,983][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:03,235][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:08,330][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:13,338][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:18,373][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:23,627][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:28,629][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:33,630][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:38,714][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:43,716][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:48,718][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:53,720][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:03:58,745][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:03,751][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:08,754][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:13,757][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:18,758][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:23,761][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:29,082][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:34,084][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:39,089][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:44,090][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:49,093][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:54,097][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:04:59,099][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:04,101][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:09,103][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:14,104][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:19,114][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:24,118][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:29,122][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:34,126][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:39,129][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:44,141][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:49,144][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:54,145][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:05:59,148][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:04,150][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:09,151][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:14,155][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:19,157][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:24,158][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:29,160][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:34,161][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:39,162][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:44,163][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:49,172][ INFO][PID:2046523] Periodic builder liveness probe: alive [2026-04-01 11:06:49,297][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:54,300][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:06:59,336][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:04,339][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:09,340][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:14,341][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:19,342][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:24,343][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:29,344][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:34,598][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:39,603][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:44,612][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:49,614][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:54,641][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:07:59,653][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:04,825][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:09,827][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:14,831][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:19,837][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:24,848][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:29,851][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:34,852][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:39,919][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:44,928][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:49,933][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:54,948][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:08:59,957][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:04,974][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:09,986][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:14,989][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:19,993][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:24,999][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:30,006][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:35,015][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:40,019][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:45,027][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:50,036][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:09:55,162][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:00,173][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:05,182][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:10,198][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:15,204][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:20,211][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:25,217][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:30,493][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:35,498][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:40,504][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:45,507][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:50,514][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:10:55,516][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:00,518][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:05,520][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:10,524][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:15,533][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:20,552][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:25,571][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:30,579][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:35,585][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:40,587][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:45,621][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:50,622][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:11:55,630][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:00,632][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:05,674][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:10,691][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:15,704][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:20,716][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:25,725][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:30,856][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:35,860][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:40,871][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:45,877][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:50,878][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:12:56,248][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:01,267][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:06,397][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:10,845][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:13:11,808][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:16,812][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:20,859][WARNING][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:13:21,813][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:26,814][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:30,860][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 2 [2026-04-01 11:13:31,086][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.206.187.155 copr-rpmbuild-log [2026-04-01 11:13:31,817][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:36,818][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:41,819][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:46,823][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:51,824][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:13:56,827][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:01,829][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:06,830][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:11,831][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:16,837][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:21,838][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:26,840][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:31,155][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:14:31,841][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:36,842][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:41,160][WARNING][PID:2046523] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:14:41,843][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:46,845][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:51,161][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 3 [2026-04-01 11:14:51,162][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.206.187.155 copr-rpmbuild-log [2026-04-01 11:14:51,867][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:14:56,869][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:01,870][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:06,871][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:11,873][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:16,874][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:21,986][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:27,098][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:32,100][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:37,101][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:42,102][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:47,103][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:51,224][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:15:52,104][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:15:57,105][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:01,273][WARNING][PID:2046523] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:16:02,179][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:07,180][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:11,273][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 4 [2026-04-01 11:16:11,275][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.206.187.155 copr-rpmbuild-log [2026-04-01 11:16:12,182][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:17,183][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:22,184][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:27,185][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:32,186][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:37,187][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:42,188][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:47,189][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:52,209][ INFO][PID:2046523] Periodic builder liveness probe: alive [2026-04-01 11:16:52,209][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:16:57,210][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:02,212][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:07,214][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:11,331][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:17:12,289][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:17,290][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:21,358][ ERROR][PID:2046523] Giving up for unstable SSH, failures: 1775042000.859703, 1775042081.1603496, 1775042161.2730966, 1775042241.3578196 [2026-04-01 11:17:21,361][ ERROR][PID:2046523] Re-try request for task on 'ResallocHost, ticket_id=2131220, hostname=18.206.187.155, name=aws_x86_64_spot_prod_04448839_20260401_104354, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-01 11:17:21,364][ INFO][PID:2046523] Releasing VM back to pool [2026-04-01 11:17:21,377][ INFO][PID:2046523] Retry #1 (on other host) [2026-04-01 11:17:21,378][ INFO][PID:2046523] Checking that /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-01 11:17:21,813][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:21,815][ INFO][PID:2046523] VM allocation process starts [2026-04-01 11:17:21,827][ INFO][PID:2046523] Trying to allocate VM: ResallocHost, ticket_id=2131923, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-01 11:17:26,829][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:27,875][ INFO][PID:2046523] Allocated host ResallocHost, ticket_id=2131923, hostname=98.84.107.248, name=aws_x86_64_spot_prod_04449367_20260401_110838, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-01 11:17:27,877][ INFO][PID:2046523] Allocating ssh connection to builder [2026-04-01 11:17:27,878][ INFO][PID:2046523] Checking that builder machine is OK [2026-04-01 11:17:28,295][ INFO][PID:2046523] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-01 11:17:28,532][ INFO][PID:2046523] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-01 11:17:28,532][ INFO][PID:2046523] Filling build.info file with builder info [2026-04-01 11:17:28,624][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:28,627][ INFO][PID:2046523] Not re-notifying FE and msg buses for the new host. [2026-04-01 11:17:28,628][ INFO][PID:2046523] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10282424-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-01 11:17:29,012][ INFO][PID:2046523] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.84.107.248' (ED25519) to the list of known hosts. [2026-04-01 11:17:29,013][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 1 [2026-04-01 11:17:29,016][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.107.248 copr-rpmbuild-log [2026-04-01 11:17:34,016][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:39,017][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:44,020][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:49,200][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:54,202][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:17:59,203][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:04,204][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:09,208][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:14,210][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:19,211][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:24,212][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:29,213][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:34,214][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:39,254][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:44,255][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:49,256][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:54,257][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:18:59,258][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:04,259][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:09,260][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:14,283][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:19,284][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:24,285][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:29,286][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:30,412][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:19:34,287][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:39,288][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:40,413][WARNING][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:19:44,289][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:49,290][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:50,414][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 2 [2026-04-01 11:19:50,415][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.107.248 copr-rpmbuild-log [2026-04-01 11:19:54,299][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:19:59,300][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:04,301][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:09,302][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:14,333][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:19,334][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:24,336][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:29,390][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:34,480][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:39,481][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:44,482][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:49,483][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:50,486][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:20:54,514][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:20:59,516][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:00,500][WARNING][PID:2046523] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:21:04,517][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:09,519][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:10,501][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 3 [2026-04-01 11:21:10,502][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.107.248 copr-rpmbuild-log [2026-04-01 11:21:14,520][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:19,521][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:24,522][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:29,524][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:34,525][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:39,526][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:44,576][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:49,594][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:54,595][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:21:59,596][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:04,597][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:09,603][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:10,573][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:22:14,604][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:19,605][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:20,579][WARNING][PID:2046523] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:22:24,606][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:29,640][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:30,580][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 4 [2026-04-01 11:22:30,581][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.107.248 copr-rpmbuild-log [2026-04-01 11:22:34,649][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:39,650][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:44,662][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:49,685][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:54,686][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:22:59,687][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:04,689][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:09,692][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:14,694][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:19,695][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:24,702][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:29,703][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:30,686][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:23:34,707][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:39,717][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:40,748][ ERROR][PID:2046523] Giving up for unstable SSH, failures: 1775042380.4135437, 1775042460.5007205, 1775042540.579793, 1775042620.7481482 [2026-04-01 11:23:40,749][ ERROR][PID:2046523] Re-try request for task on 'ResallocHost, ticket_id=2131923, hostname=98.84.107.248, name=aws_x86_64_spot_prod_04449367_20260401_110838, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-01 11:23:40,750][ INFO][PID:2046523] Releasing VM back to pool [2026-04-01 11:23:40,768][ INFO][PID:2046523] Retry #2 (on other host) [2026-04-01 11:23:40,768][ INFO][PID:2046523] Checking that /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-01 11:23:40,803][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:40,809][ INFO][PID:2046523] VM allocation process starts [2026-04-01 11:23:40,822][ INFO][PID:2046523] Trying to allocate VM: ResallocHost, ticket_id=2132041, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-01 11:23:43,869][ INFO][PID:2046523] Allocated host ResallocHost, ticket_id=2132041, hostname=34.202.160.239, name=aws_x86_64_spot_prod_04449566_20260401_112219, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-01 11:23:44,212][ INFO][PID:2046523] Allocating ssh connection to builder [2026-04-01 11:23:44,215][ INFO][PID:2046523] Checking that builder machine is OK [2026-04-01 11:23:44,561][ INFO][PID:2046523] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-01 11:23:44,793][ INFO][PID:2046523] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-01 11:23:44,794][ INFO][PID:2046523] Filling build.info file with builder info [2026-04-01 11:23:44,925][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:44,927][ INFO][PID:2046523] Not re-notifying FE and msg buses for the new host. [2026-04-01 11:23:44,928][ INFO][PID:2046523] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10282424-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-01 11:23:45,280][ INFO][PID:2046523] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.202.160.239' (ED25519) to the list of known hosts. [2026-04-01 11:23:45,281][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 1 [2026-04-01 11:23:45,283][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.202.160.239 copr-rpmbuild-log [2026-04-01 11:23:50,281][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:23:55,285][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:00,287][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:05,288][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:10,289][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:15,290][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:20,295][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:25,297][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:30,300][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:35,304][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:40,306][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:45,308][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:50,313][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:24:55,315][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:00,316][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:05,319][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:10,325][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:15,327][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:20,328][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:25,329][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:30,331][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:35,332][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:40,333][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:45,335][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:50,338][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:25:55,339][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:00,340][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:05,342][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:10,389][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:15,390][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:20,394][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:25,397][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:30,399][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:35,402][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:40,404][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:45,429][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:50,430][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:26:55,436][ INFO][PID:2046523] Periodic builder liveness probe: alive [2026-04-01 11:26:55,437][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:00,438][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:05,439][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:10,440][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:15,441][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:20,442][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:25,554][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:30,555][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:35,556][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:40,573][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:45,575][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:50,579][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:27:55,581][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:00,583][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:05,584][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:10,585][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:15,609][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:20,610][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:25,611][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:27,613][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:28:30,612][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:35,613][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:37,647][WARNING][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:28:40,614][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:45,615][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:47,648][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 2 [2026-04-01 11:28:47,649][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.202.160.239 copr-rpmbuild-log [2026-04-01 11:28:50,616][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:28:55,617][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:00,618][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:05,761][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:10,762][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:15,763][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:20,765][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:25,777][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:30,778][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:35,779][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:40,780][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:45,781][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:47,716][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:29:50,782][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:55,985][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:29:57,726][WARNING][PID:2046523] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:30:00,986][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:06,016][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:07,727][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 3 [2026-04-01 11:30:07,728][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.202.160.239 copr-rpmbuild-log [2026-04-01 11:30:11,019][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:16,020][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:21,020][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:26,021][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:31,028][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:36,035][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:41,036][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:46,037][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:51,100][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:30:56,103][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:01,105][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:06,106][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:07,792][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:31:11,107][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:16,108][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:17,823][WARNING][PID:2046523] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-01 11:31:21,110][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:26,111][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:27,824][ INFO][PID:2046523] Downloading the builder-live.log file, attempt 4 [2026-04-01 11:31:27,827][ INFO][PID:2046523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.202.160.239 copr-rpmbuild-log [2026-04-01 11:31:31,112][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:36,114][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:41,115][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:46,116][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:51,117][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:31:56,118][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:01,119][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:06,120][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:11,121][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:16,122][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:21,124][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:26,125][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:27,900][ ERROR][PID:2046523] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-01 11:32:31,126][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:36,128][ INFO][PID:2046523] Checking for cancel request [2026-04-01 11:32:37,915][ ERROR][PID:2046523] Giving up for unstable SSH, failures: 1775042917.6472538, 1775042997.7265306, 1775043077.823723, 1775043157.9155016 [2026-04-01 11:32:37,916][ ERROR][PID:2046523] Re-try request for task on 'ResallocHost, ticket_id=2132041, hostname=34.202.160.239, name=aws_x86_64_spot_prod_04449566_20260401_112219, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-01 11:32:37,916][ INFO][PID:2046523] Releasing VM back to pool [2026-04-01 11:32:37,926][ ERROR][PID:2046523] Backend process error: Three host tried without success: {'18.206.187.155', '98.84.107.248', '34.202.160.239'} [2026-04-01 11:32:37,926][WARNING][PID:2046523] Switching not-finished job state to 'failed' [2026-04-01 11:32:37,927][ INFO][PID:2046523] Worker failed build, took 532.9990129470825 [2026-04-01 11:32:37,927][ INFO][PID:2046523] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "lecris", "project_name": "nightly", "project_dirname": "nightly", "submitter": "packit", "ended_on": 1775043157.9267337, "started_on": 1775042624.9277208, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10282424-fedora-rawhide-x86_64", "build_id": 10282424, "package_name": "cp2k", "package_version": "0.0.0-1.20260401104610381033.master", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lecris/nightly/cp2k", "git_hash": "8fa9521f28b43ee6ccf212466ffb46e314879af0", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "lecris/nightly--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/lecris/nightly/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/lecris/nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lecris/nightly", "result_dir": "10282424-cp2k", "built_packages": "", "id": 10282424, "mockchain_macros": { "copr_username": "lecris", "copr_projectname": "nightly", "vendor": "Fedora Project COPR (lecris/nightly)" } } ] } [2026-04-01 11:32:37,976][ INFO][PID:2046523] Sending fedora-messaging bus message in build.end [2026-04-01 11:32:38,034][ INFO][PID:2046523] Compressing /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/10282424-cp2k/builder-live.log by gzip [2026-04-01 11:32:38,035][ INFO][PID:2046523] Running command 'gzip /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/10282424-cp2k/builder-live.log' as PID 2354231 [2026-04-01 11:32:38,073][ INFO][PID:2046523] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/10282424-cp2k/builder-live.log) [2026-04-01 11:32:38,074][ INFO][PID:2046523] Compressing /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/10282424-cp2k/backend.log by gzip [2026-04-01 11:32:38,075][ INFO][PID:2046523] Running command 'gzip /var/lib/copr/public_html/results/lecris/nightly/fedora-rawhide-x86_64/10282424-cp2k/backend.log' as PID 2354238