[2026-03-26 13:08:25,040][ INFO][PID:2598552] Marking build as starting [2026-03-26 13:08:25,224][ INFO][PID:2598552] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/repodata/repomd.xml exists [2026-03-26 13:08:25,303][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:08:25,305][ INFO][PID:2598552] VM allocation process starts [2026-03-26 13:08:25,323][ INFO][PID:2598552] Trying to allocate VM: ResallocHost, ticket_id=2040097, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-26 13:08:28,348][ INFO][PID:2598552] Allocated host ResallocHost, ticket_id=2040097, hostname=54.174.163.156, name=aws_x86_64_spot_prod_04287506_20260326_130536, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-26 13:08:28,348][ INFO][PID:2598552] Allocating ssh connection to builder [2026-03-26 13:08:28,349][ INFO][PID:2598552] Checking that builder machine is OK [2026-03-26 13:08:28,662][ INFO][PID:2598552] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2026-03-26 13:08:28,869][ INFO][PID:2598552] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2026-03-26 13:08:28,871][ INFO][PID:2598552] Filling build.info file with builder info [2026-03-26 13:08:28,872][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:08:28,874][ INFO][PID:2598552] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": null, "started_on": 1774530508.873706, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10263825-centos-stream-9-x86_64", "build_id": 10263825, "package_name": "bootc", "package_version": "202603261259.g5cbb111de0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "d459631bac6722f3ebcdcc3109b9d73b9e207068", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "10263825-bootc", "built_packages": "", "id": 10263825, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2026-03-26 13:08:29,089][ INFO][PID:2598552] Sending fedora-messaging bus message in build.start [2026-03-26 13:08:30,096][ INFO][PID:2598552] Sending fedora-messaging bus message in chroot.start [2026-03-26 13:08:30,133][ INFO][PID:2598552] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10263825-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2026-03-26 13:08:30,507][ INFO][PID:2598552] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.174.163.156' (ED25519) to the list of known hosts. [2026-03-26 13:08:30,509][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 1 [2026-03-26 13:08:30,515][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.163.156 copr-rpmbuild-log [2026-03-26 13:08:35,519][ INFO][PID:2598552] Periodic builder liveness probe: alive [2026-03-26 13:08:35,520][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:08:40,520][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:08:45,523][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:08:50,527][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:08:55,529][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:00,533][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:05,534][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:10,535][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:15,537][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:19,056][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:09:20,538][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:25,539][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:29,057][WARNING][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-26 13:09:30,540][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:35,541][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:39,058][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 2 [2026-03-26 13:09:39,060][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.163.156 copr-rpmbuild-log [2026-03-26 13:09:40,543][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:45,544][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:50,545][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:09:55,546][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:00,547][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:05,550][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:10,554][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:15,555][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:20,556][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:25,557][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:30,559][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:35,560][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:39,126][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:10:40,562][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:45,563][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:49,148][WARNING][PID:2598552] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-26 13:10:50,564][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:55,566][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:10:59,149][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 3 [2026-03-26 13:10:59,150][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.163.156 copr-rpmbuild-log [2026-03-26 13:11:00,569][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:05,570][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:10,571][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:15,572][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:20,573][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:25,574][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:30,575][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:35,576][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:40,577][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:45,578][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:50,580][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:55,582][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:11:59,217][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:12:00,600][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:05,601][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:09,226][WARNING][PID:2598552] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-26 13:12:10,602][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:15,603][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:19,226][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 4 [2026-03-26 13:12:19,228][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.174.163.156 copr-rpmbuild-log [2026-03-26 13:12:20,604][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:25,605][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:30,606][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:35,607][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:40,608][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:45,609][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:50,610][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:12:55,611][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:00,612][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:05,613][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:10,614][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:15,615][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:19,267][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:13:20,616][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:25,618][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:29,291][ ERROR][PID:2598552] Giving up for unstable SSH, failures: 1774530569.0575733, 1774530649.1481733, 1774530729.2260678, 1774530809.2916424 [2026-03-26 13:13:29,293][ ERROR][PID:2598552] Re-try request for task on 'ResallocHost, ticket_id=2040097, hostname=54.174.163.156, name=aws_x86_64_spot_prod_04287506_20260326_130536, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-03-26 13:13:29,293][ INFO][PID:2598552] Releasing VM back to pool [2026-03-26 13:13:29,308][ INFO][PID:2598552] Retry #1 (on other host) [2026-03-26 13:13:29,309][ INFO][PID:2598552] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/repodata/repomd.xml exists [2026-03-26 13:13:29,309][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:29,310][ INFO][PID:2598552] VM allocation process starts [2026-03-26 13:13:29,322][ INFO][PID:2598552] Trying to allocate VM: ResallocHost, ticket_id=2040207, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-26 13:13:34,323][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:39,324][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:44,325][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:49,326][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:54,327][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:13:59,328][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:04,330][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:09,331][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:14,332][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:19,334][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:24,335][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:29,336][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:34,337][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:39,338][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:44,341][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:49,349][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:54,350][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:14:59,351][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:04,352][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:09,353][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:14,354][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:17,391][ INFO][PID:2598552] Allocated host ResallocHost, ticket_id=2040207, hostname=100.48.21.68, name=aws_x86_64_spot_prod_04288168_20260326_131328, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-26 13:15:17,392][ INFO][PID:2598552] Allocating ssh connection to builder [2026-03-26 13:15:17,392][ INFO][PID:2598552] Checking that builder machine is OK [2026-03-26 13:15:17,755][ INFO][PID:2598552] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2026-03-26 13:15:17,976][ INFO][PID:2598552] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2026-03-26 13:15:17,977][ INFO][PID:2598552] Filling build.info file with builder info [2026-03-26 13:15:17,997][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:17,999][ INFO][PID:2598552] Not re-notifying FE and msg buses for the new host. [2026-03-26 13:15:18,001][ INFO][PID:2598552] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10263825-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2026-03-26 13:15:18,382][ INFO][PID:2598552] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.48.21.68' (ED25519) to the list of known hosts. [2026-03-26 13:15:18,383][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 1 [2026-03-26 13:15:18,384][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.48.21.68 copr-rpmbuild-log [2026-03-26 13:15:23,385][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:28,387][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:33,388][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:38,391][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:43,393][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:48,394][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:53,397][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:15:58,398][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:03,400][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:08,401][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:13,406][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:18,407][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:23,408][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:28,409][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:33,411][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:38,412][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:43,415][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:48,416][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:53,417][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:16:58,418][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:03,419][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:08,420][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:13,421][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:18,422][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:23,424][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:28,427][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:33,429][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:38,459][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:43,463][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:48,465][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:53,466][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:17:58,468][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:03,470][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:08,476][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:13,477][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:18,721][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:23,725][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:28,726][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:33,727][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:38,734][ INFO][PID:2598552] Periodic builder liveness probe: alive [2026-03-26 13:18:38,735][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:43,735][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:48,737][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:53,738][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:18:58,744][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:03,746][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:08,884][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:13,886][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:18,902][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:23,903][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:28,905][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:33,908][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:38,911][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:43,912][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:48,913][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:53,914][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:19:58,918][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:03,930][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:08,933][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:13,934][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:18,938][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:23,948][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:28,951][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:33,955][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:38,960][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:43,963][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:48,973][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:53,975][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:20:58,977][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:03,981][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:08,986][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:13,992][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:18,996][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:24,000][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:29,001][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:34,003][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:39,004][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:44,009][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:48,940][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:21:49,012][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:54,022][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:21:58,948][WARNING][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-26 13:21:59,023][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:04,024][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:08,990][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 2 [2026-03-26 13:22:08,993][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.48.21.68 copr-rpmbuild-log [2026-03-26 13:22:09,026][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:14,028][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:19,030][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:24,031][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:29,033][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:34,113][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:39,115][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:44,119][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:49,123][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:54,125][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:22:59,127][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:04,128][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:09,065][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:23:09,703][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:14,704][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:19,211][WARNING][PID:2598552] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-26 13:23:19,753][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:24,754][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:29,212][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 3 [2026-03-26 13:23:29,219][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.48.21.68 copr-rpmbuild-log [2026-03-26 13:23:29,803][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:34,810][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:39,835][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:44,841][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:49,867][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:54,880][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:23:59,893][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:04,899][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:09,901][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:14,917][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:19,993][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:25,016][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:29,299][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:24:30,087][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:35,101][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:39,301][WARNING][PID:2598552] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-26 13:24:40,117][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:45,119][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:49,330][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 4 [2026-03-26 13:24:49,333][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.48.21.68 copr-rpmbuild-log [2026-03-26 13:24:50,129][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:24:55,139][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:00,143][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:05,147][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:10,150][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:15,151][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:20,154][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:25,183][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:30,188][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:35,193][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:40,294][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:45,340][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:49,410][ ERROR][PID:2598552] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-26 13:25:50,373][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:55,375][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:59,441][ ERROR][PID:2598552] Giving up for unstable SSH, failures: 1774531318.9483905, 1774531399.2112567, 1774531479.301113, 1774531559.4412487 [2026-03-26 13:25:59,442][ ERROR][PID:2598552] Re-try request for task on 'ResallocHost, ticket_id=2040207, hostname=100.48.21.68, name=aws_x86_64_spot_prod_04288168_20260326_131328, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-03-26 13:25:59,443][ INFO][PID:2598552] Releasing VM back to pool [2026-03-26 13:25:59,460][ INFO][PID:2598552] Retry #2 (on other host) [2026-03-26 13:25:59,461][ INFO][PID:2598552] Checking that /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/repodata/repomd.xml exists [2026-03-26 13:25:59,462][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:25:59,463][ INFO][PID:2598552] VM allocation process starts [2026-03-26 13:25:59,474][ INFO][PID:2598552] Trying to allocate VM: ResallocHost, ticket_id=2040448, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-26 13:26:02,486][ INFO][PID:2598552] Allocated host ResallocHost, ticket_id=2040448, hostname=34.236.243.181, name=aws_x86_64_normal_prod_04288903_20260326_132420, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-26 13:26:02,487][ INFO][PID:2598552] Allocating ssh connection to builder [2026-03-26 13:26:02,487][ INFO][PID:2598552] Checking that builder machine is OK [2026-03-26 13:26:02,830][ INFO][PID:2598552] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2026-03-26 13:26:03,111][ INFO][PID:2598552] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2026-03-26 13:26:03,112][ INFO][PID:2598552] Filling build.info file with builder info [2026-03-26 13:26:03,115][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:03,116][ INFO][PID:2598552] Not re-notifying FE and msg buses for the new host. [2026-03-26 13:26:03,117][ INFO][PID:2598552] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10263825-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2026-03-26 13:26:03,456][ INFO][PID:2598552] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.236.243.181' (ED25519) to the list of known hosts. [2026-03-26 13:26:03,458][ INFO][PID:2598552] Downloading the builder-live.log file, attempt 1 [2026-03-26 13:26:03,459][ INFO][PID:2598552] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.236.243.181 copr-rpmbuild-log [2026-03-26 13:26:08,458][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:13,459][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:18,460][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:23,461][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:28,462][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:33,463][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:38,466][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:43,472][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:48,479][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:53,481][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:26:58,482][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:03,483][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:08,485][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:13,486][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:18,487][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:23,488][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:28,489][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:33,490][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:38,492][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:43,498][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:48,499][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:53,501][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:27:58,503][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:03,504][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:08,506][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:13,508][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:18,509][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:23,511][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:28,516][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:33,517][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:38,519][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:43,535][ INFO][PID:2598552] Periodic builder liveness probe: alive [2026-03-26 13:28:43,562][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:48,564][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:53,589][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:28:58,606][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:03,625][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:08,628][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:13,630][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:18,632][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:23,635][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:28,636][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:33,638][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:38,640][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:43,641][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:48,643][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:53,644][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:29:58,645][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:03,646][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:08,647][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:13,648][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:18,649][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:23,651][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:28,653][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:33,655][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:38,656][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:43,658][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:48,660][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:53,661][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:30:58,662][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:03,664][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:08,666][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:13,668][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:18,671][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:23,672][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:28,674][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:33,675][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:38,677][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:43,679][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:48,680][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:53,681][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:31:58,682][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:03,683][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:08,685][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:13,688][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:18,690][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:23,692][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:28,694][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:33,696][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:38,702][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:43,705][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:48,707][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:53,708][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:32:58,714][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:03,717][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:08,718][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:13,720][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:18,733][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:23,737][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:28,739][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:33,740][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:38,744][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:43,748][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:48,751][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:53,756][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:33:58,758][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:03,759][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:08,764][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:13,766][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:18,768][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:23,770][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:28,771][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:33,784][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:38,785][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:43,787][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:48,789][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:53,791][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:34:58,794][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:03,795][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:08,798][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:13,802][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:18,806][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:23,807][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:28,809][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:33,823][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:38,825][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:43,826][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:48,827][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:53,865][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:35:58,867][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:03,868][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:08,869][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:13,871][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:18,874][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:23,875][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:28,876][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:33,877][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:38,879][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:43,881][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:48,905][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:53,914][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:36:58,932][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:03,936][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:08,937][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:13,938][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:18,939][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:23,941][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:28,942][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:33,984][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:38,985][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:43,986][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:48,987][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:53,989][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:37:58,990][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:03,991][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:08,992][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:14,055][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:19,061][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:24,064][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:29,066][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:34,067][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:39,068][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:44,077][ INFO][PID:2598552] Periodic builder liveness probe: alive [2026-03-26 13:38:44,078][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:49,079][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:54,080][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:38:59,089][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:04,095][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:09,097][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:14,098][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:19,099][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:24,100][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:29,102][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:34,103][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:39,104][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:44,105][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:49,107][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:54,109][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:39:59,111][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:04,114][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:09,115][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:14,117][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:19,118][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:24,119][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:29,120][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:34,121][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:39,122][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:44,124][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:49,130][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:54,131][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:40:59,132][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:04,134][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:09,137][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:14,146][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:19,147][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:24,148][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:29,150][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:34,152][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:39,154][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:44,155][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:49,182][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:54,184][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:41:59,190][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:04,195][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:09,196][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:14,199][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:19,200][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:24,204][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:29,205][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:34,207][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:39,212][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:44,214][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:49,221][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:54,305][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:42:59,307][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:04,313][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:09,314][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:14,315][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:19,355][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:24,357][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:29,358][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:34,669][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:39,671][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:44,677][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:49,682][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:54,688][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:43:59,689][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:04,692][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:09,731][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:14,732][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:19,849][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:24,853][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:29,862][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:34,863][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:39,864][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:45,098][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:50,101][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:44:55,102][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:00,103][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:05,104][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:10,107][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:15,108][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:20,109][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:25,110][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:30,111][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:35,112][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:40,113][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:45,114][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:50,116][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:45:55,122][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:00,125][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:05,126][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:10,131][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:15,133][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:20,134][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:25,217][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:30,220][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:35,224][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:40,226][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:45,246][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:50,250][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:46:55,258][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:00,260][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:05,261][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:10,267][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:15,269][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:20,291][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:25,294][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:30,299][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:35,301][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:40,304][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:45,305][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:50,306][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:47:55,307][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:00,309][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:05,310][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:10,312][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:15,315][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:20,320][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:25,383][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:30,459][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:35,465][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:40,466][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:45,480][ INFO][PID:2598552] Periodic builder liveness probe: alive [2026-03-26 13:48:45,480][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:50,481][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:48:55,485][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:00,488][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:05,490][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:10,492][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:15,497][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:20,498][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:25,501][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:30,503][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:35,505][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:40,507][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:45,511][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:50,513][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:49:55,514][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:00,515][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:05,516][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:10,518][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:15,540][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:20,541][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:25,542][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:30,545][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:35,546][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:40,547][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:45,549][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:50,550][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:50:55,551][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:00,552][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:05,553][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:10,554][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:15,556][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:20,557][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:25,558][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:30,559][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:35,564][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:40,565][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:45,567][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:50,569][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:51:55,570][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:52:00,571][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:52:05,572][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:52:10,577][ INFO][PID:2598552] Checking for cancel request [2026-03-26 13:52:11,893][ INFO][PID:2598552] Downloading results from builder [2026-03-26 13:52:11,894][ INFO][PID:2598552] rsyncing of mockbuilder@34.236.243.181:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc started [2026-03-26 13:52:11,895][ INFO][PID:2598552] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.236.243.181:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/ &> /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/build-10263825.rsync.log [2026-03-26 13:52:13,235][ INFO][PID:2598552] rsyncing finished. [2026-03-26 13:52:13,236][ INFO][PID:2598552] Releasing VM back to pool [2026-03-26 13:52:13,257][ INFO][PID:2598552] Searching for 'success' file in resultdir [2026-03-26 13:52:13,263][ INFO][PID:2598552] Going to sign pkgs from source: 10263825-centos-stream-9-x86_64 in chroot: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64 [2026-03-26 13:52:13,266][ INFO][PID:2598552] Calling '/bin/sign -u rhcontainerbot#bootc@copr.fedorahosted.org -p' (attempt #1) [2026-03-26 13:52:13,549][ INFO][PID:2598552] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-202603261259.g5cbb111de0-1.el9.x86_64.rpm' (attempt #1) [2026-03-26 13:52:14,332][ INFO][PID:2598552] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-202603261259.g5cbb111de0-1.el9.x86_64.rpm [2026-03-26 13:52:14,332][ INFO][PID:2598552] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-debuginfo-202603261259.g5cbb111de0-1.el9.x86_64.rpm' (attempt #1) [2026-03-26 13:52:15,719][ INFO][PID:2598552] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-debuginfo-202603261259.g5cbb111de0-1.el9.x86_64.rpm [2026-03-26 13:52:15,719][ INFO][PID:2598552] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-debugsource-202603261259.g5cbb111de0-1.el9.x86_64.rpm' (attempt #1) [2026-03-26 13:52:16,576][ INFO][PID:2598552] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-debugsource-202603261259.g5cbb111de0-1.el9.x86_64.rpm [2026-03-26 13:52:16,577][ INFO][PID:2598552] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/system-reinstall-bootc-debuginfo-202603261259.g5cbb111de0-1.el9.x86_64.rpm' (attempt #1) [2026-03-26 13:52:17,235][ INFO][PID:2598552] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/system-reinstall-bootc-debuginfo-202603261259.g5cbb111de0-1.el9.x86_64.rpm [2026-03-26 13:52:17,235][ INFO][PID:2598552] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-202603261259.g5cbb111de0-1.el9.src.rpm' (attempt #1) [2026-03-26 13:52:18,386][ INFO][PID:2598552] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/bootc-202603261259.g5cbb111de0-1.el9.src.rpm [2026-03-26 13:52:18,387][ INFO][PID:2598552] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/system-reinstall-bootc-202603261259.g5cbb111de0-1.el9.x86_64.rpm' (attempt #1) [2026-03-26 13:52:18,999][ INFO][PID:2598552] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/system-reinstall-bootc-202603261259.g5cbb111de0-1.el9.x86_64.rpm [2026-03-26 13:52:19,000][ INFO][PID:2598552] Sign done [2026-03-26 13:52:19,000][ INFO][PID:2598552] Incremental createrepo run, adding 10263825-bootc into https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-x86_64, (auto-create-repo=True) [2026-03-26 13:52:19,001][ INFO][PID:2598552] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64 --add 10263825-bootc --no-appstream-metadata' as PID 2933168 [2026-03-26 13:52:21,220][ INFO][PID:2598552] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64 --add 10263825-bootc --no-appstream-metadata) [2026-03-26 13:52:21,221][ INFO][PID:2598552] Getting build details [2026-03-26 13:52:21,222][ INFO][PID:2598552] Listing built binary packages in /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc [2026-03-26 13:52:21,222][ INFO][PID:2598552] Built packages: ['bootc-debugsource 202603261259.g5cbb111de0', 'bootc-debuginfo 202603261259.g5cbb111de0', 'system-reinstall-bootc 202603261259.g5cbb111de0', 'system-reinstall-bootc-debuginfo 202603261259.g5cbb111de0', 'bootc 202603261259.g5cbb111de0'] [2026-03-26 13:52:21,223][ INFO][PID:2598552] build details: {'built_packages': 'bootc-debugsource 202603261259.g5cbb111de0\nbootc-debuginfo 202603261259.g5cbb111de0\nsystem-reinstall-bootc 202603261259.g5cbb111de0\nsystem-reinstall-bootc-debuginfo 202603261259.g5cbb111de0\nbootc 202603261259.g5cbb111de0'} [2026-03-26 13:52:21,224][ INFO][PID:2598552] Retrieving pubkey [2026-03-26 13:52:21,224][ INFO][PID:2598552] Calling '/bin/sign -u rhcontainerbot#bootc@copr.fedorahosted.org -p' (attempt #1) [2026-03-26 13:52:21,518][ INFO][PID:2598552] Added pubkey for user rhcontainerbot project bootc into: /var/lib/copr/public_html/results/rhcontainerbot/bootc/pubkey.gpg [2026-03-26 13:52:21,521][ INFO][PID:2598552] Finished build: id=10263825 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/rhcontainerbot/bootc chroot=centos-stream-9-x86_64 [2026-03-26 13:52:21,527][ INFO][PID:2598552] Worker succeeded build, took 1578.410323381424 [2026-03-26 13:52:21,528][ INFO][PID:2598552] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": 1774533141.5269682, "started_on": 1774531563.1166449, "submitted_on": null, "status": 1, "chroot": "centos-stream-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10263825-centos-stream-9-x86_64", "build_id": 10263825, "package_name": "bootc", "package_version": "202603261259.g5cbb111de0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "d459631bac6722f3ebcdcc3109b9d73b9e207068", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": { "packages": [ { "name": "bootc-debugsource", "epoch": null, "version": "202603261259.g5cbb111de0", "release": "1.el9", "arch": "x86_64" }, { "name": "bootc-debuginfo", "epoch": null, "version": "202603261259.g5cbb111de0", "release": "1.el9", "arch": "x86_64" }, { "name": "system-reinstall-bootc", "epoch": null, "version": "202603261259.g5cbb111de0", "release": "1.el9", "arch": "x86_64" }, { "name": "system-reinstall-bootc-debuginfo", "epoch": null, "version": "202603261259.g5cbb111de0", "release": "1.el9", "arch": "x86_64" }, { "name": "bootc", "epoch": null, "version": "202603261259.g5cbb111de0", "release": "1.el9", "arch": "x86_64" }, { "name": "bootc", "epoch": null, "version": "202603261259.g5cbb111de0", "release": "1.el9", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "10263825-bootc", "built_packages": "bootc-debugsource 202603261259.g5cbb111de0\nbootc-debuginfo 202603261259.g5cbb111de0\nsystem-reinstall-bootc 202603261259.g5cbb111de0\nsystem-reinstall-bootc-debuginfo 202603261259.g5cbb111de0\nbootc 202603261259.g5cbb111de0", "id": 10263825, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2026-03-26 13:52:21,775][ INFO][PID:2598552] Sending fedora-messaging bus message in build.end [2026-03-26 13:52:21,813][ INFO][PID:2598552] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/builder-live.log by gzip [2026-03-26 13:52:21,815][ INFO][PID:2598552] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/builder-live.log' as PID 2933477 [2026-03-26 13:52:22,019][ INFO][PID:2598552] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/builder-live.log) [2026-03-26 13:52:22,020][ INFO][PID:2598552] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/backend.log by gzip [2026-03-26 13:52:22,022][ INFO][PID:2598552] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-x86_64/10263825-bootc/backend.log' as PID 2933495