[2025-07-25 15:48:12,679][ INFO][PID:1824438] Marking build as starting [2025-07-25 15:48:12,747][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:12,750][ INFO][PID:1824438] VM allocation process starts [2025-07-25 15:48:12,771][ INFO][PID:1824438] Trying to allocate VM: ResallocHost, ticket_id=4147835, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 15:48:17,781][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:22,786][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:27,793][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:32,795][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:37,796][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:42,804][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:47,808][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:52,812][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:48:57,819][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:02,821][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:07,830][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:12,834][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:17,843][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:22,848][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:27,852][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:32,853][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:37,857][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:42,859][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:47,863][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:52,868][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:49:57,869][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:02,871][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:07,875][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:12,877][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:17,887][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:22,889][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:27,892][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:31,033][ INFO][PID:1824438] Allocated host ResallocHost, ticket_id=4147835, hostname=52.91.252.206, name=aws_x86_64_spot_prod_05878289_20250725_154825, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 15:50:31,034][ INFO][PID:1824438] Allocating ssh connection to builder [2025-07-25 15:50:31,036][ INFO][PID:1824438] Checking that builder machine is OK [2025-07-25 15:50:31,538][ INFO][PID:1824438] Running remote command: copr-builder-ready rhel-10-x86_64 [2025-07-25 15:50:31,840][ INFO][PID:1824438] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-07-25 15:50:31,841][ INFO][PID:1824438] Filling build.info file with builder info [2025-07-25 15:50:31,843][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:31,849][ INFO][PID:1824438] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "brycensranch", "project_name": "snapx", "project_dirname": "snapx", "submitter": "https://api.github.com/users/BrycensRanch", "ended_on": null, "started_on": 1753458631.8489568, "submitted_on": null, "status": 3, "chroot": "rhel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9337657-rhel-10-x86_64", "build_id": 9337657, "package_name": "snapx", "package_version": "0.4.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/brycensranch/snapx/snapx", "git_hash": "562a3ec9d73c2df6dcd52e5332e386d207bfba51", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "brycensranch/snapx--https://api.github.com/users/BrycensRanch", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx/rhel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://packages.microsoft.com/opensuse/15/prod", "id": "https_packages_microsoft_com_opensuse_15_prod", "name": "Additional repo https_packages_microsoft_com_opensuse_15_prod" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/brycensranch/snapx", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx", "result_dir": "09337657-snapx", "built_packages": "", "id": 9337657, "mockchain_macros": { "copr_username": "brycensranch", "copr_projectname": "snapx", "vendor": "Fedora Project COPR (brycensranch/snapx)" } } ] } [2025-07-25 15:50:31,924][ INFO][PID:1824438] Sending fedora-messaging bus message in build.start [2025-07-25 15:50:33,616][ INFO][PID:1824438] Sending fedora-messaging bus message in chroot.start [2025-07-25 15:50:33,652][ INFO][PID:1824438] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9337657-rhel-10-x86_64 --chroot rhel-10-x86_64 --detached [2025-07-25 15:50:34,079][ INFO][PID:1824438] Downloading the builder-live.log file, attempt 1 [2025-07-25 15:50:34,082][ INFO][PID:1824438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.252.206 copr-rpmbuild-log [2025-07-25 15:50:39,096][ INFO][PID:1824438] Periodic builder liveness probe: alive [2025-07-25 15:50:39,100][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:44,110][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:49,119][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:54,120][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:50:59,127][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:04,134][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:09,142][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:14,143][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:19,147][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:24,156][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:29,161][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:34,166][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:39,169][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:44,172][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:49,175][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:54,180][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:51:59,182][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:04,184][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:09,189][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:14,191][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:19,192][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:24,194][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:29,196][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:34,198][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:39,201][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:44,202][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:49,204][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:54,206][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:52:59,209][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:04,211][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:09,214][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:14,215][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:19,217][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:24,219][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:29,221][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:34,224][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:39,226][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:44,229][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:49,235][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:54,243][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:53:59,245][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:04,248][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:04,662][ ERROR][PID:1824438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 15:54:09,249][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:14,252][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:14,664][WARNING][PID:1824438] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-25 15:54:19,253][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:24,254][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:24,668][ INFO][PID:1824438] Downloading the builder-live.log file, attempt 2 [2025-07-25 15:54:24,676][ INFO][PID:1824438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.252.206 copr-rpmbuild-log [2025-07-25 15:54:29,256][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:34,257][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:39,259][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:44,262][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:49,264][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:54,265][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:54:59,266][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:04,272][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:09,280][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:14,288][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:19,290][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:24,293][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:24,758][ ERROR][PID:1824438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 15:55:29,296][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:34,303][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:34,763][WARNING][PID:1824438] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-25 15:55:39,305][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:44,308][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:44,763][ INFO][PID:1824438] Downloading the builder-live.log file, attempt 3 [2025-07-25 15:55:44,768][ INFO][PID:1824438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.252.206 copr-rpmbuild-log [2025-07-25 15:55:49,310][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:54,312][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:55:59,316][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:04,320][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:09,321][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:14,323][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:19,325][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:24,327][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:29,332][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:34,340][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:39,344][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:44,346][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:44,839][ ERROR][PID:1824438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 15:56:49,351][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:54,352][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:56:54,841][WARNING][PID:1824438] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-25 15:56:59,354][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:04,356][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:04,843][ INFO][PID:1824438] Downloading the builder-live.log file, attempt 4 [2025-07-25 15:57:04,845][ INFO][PID:1824438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.252.206 copr-rpmbuild-log [2025-07-25 15:57:09,357][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:14,359][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:19,369][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:24,370][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:29,371][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:34,373][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:39,374][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:44,377][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:49,378][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:54,380][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:57:59,382][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:04,387][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:04,922][ ERROR][PID:1824438] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 15:58:09,390][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:14,392][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:14,924][ ERROR][PID:1824438] Giving up for unstable SSH, failures: 1753458854.6641533, 1753458934.7631257, 1753459014.8414955, 1753459094.9245956 [2025-07-25 15:58:14,928][ ERROR][PID:1824438] Re-try request for task on 'ResallocHost, ticket_id=4147835, hostname=52.91.252.206, name=aws_x86_64_spot_prod_05878289_20250725_154825, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-25 15:58:14,931][ INFO][PID:1824438] Releasing VM back to pool [2025-07-25 15:58:14,964][ INFO][PID:1824438] Retry #1 (on other host) [2025-07-25 15:58:14,966][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:14,970][ INFO][PID:1824438] VM allocation process starts [2025-07-25 15:58:14,999][ INFO][PID:1824438] Trying to allocate VM: ResallocHost, ticket_id=4148148, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 15:58:20,004][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:25,016][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:30,019][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:35,024][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:40,026][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:45,027][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:50,032][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:58:55,033][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:00,036][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:05,050][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:10,052][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:15,060][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:20,063][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:23,193][ INFO][PID:1824438] Allocated host ResallocHost, ticket_id=4148148, hostname=52.205.37.230, name=aws_x86_64_normalreserved_prod_05878623_20250725_155741, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 15:59:23,194][ INFO][PID:1824438] Allocating ssh connection to builder [2025-07-25 15:59:23,194][ INFO][PID:1824438] Checking that builder machine is OK [2025-07-25 15:59:23,674][ INFO][PID:1824438] Running remote command: copr-builder-ready rhel-10-x86_64 [2025-07-25 15:59:23,973][ INFO][PID:1824438] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-07-25 15:59:23,977][ INFO][PID:1824438] Filling build.info file with builder info [2025-07-25 15:59:23,981][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:23,983][ INFO][PID:1824438] Not re-notifying FE and msg buses for the new host. [2025-07-25 15:59:23,984][ INFO][PID:1824438] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9337657-rhel-10-x86_64 --chroot rhel-10-x86_64 --detached [2025-07-25 15:59:24,397][ INFO][PID:1824438] Downloading the builder-live.log file, attempt 1 [2025-07-25 15:59:24,407][ INFO][PID:1824438] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.205.37.230 copr-rpmbuild-log [2025-07-25 15:59:29,400][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:34,405][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:39,411][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:44,412][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:49,417][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:54,421][ INFO][PID:1824438] Checking for cancel request [2025-07-25 15:59:59,425][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:04,430][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:09,440][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:14,444][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:19,448][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:24,463][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:29,467][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:34,469][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:39,498][ INFO][PID:1824438] Periodic builder liveness probe: alive [2025-07-25 16:00:39,501][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:44,509][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:49,515][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:54,519][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:00:59,520][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:04,524][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:09,532][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:14,543][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:19,547][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:24,551][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:29,553][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:34,563][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:39,565][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:44,570][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:49,575][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:54,578][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:01:59,592][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:04,594][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:09,595][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:14,601][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:19,603][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:24,605][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:29,607][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:34,611][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:39,615][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:44,620][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:49,621][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:54,625][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:02:59,630][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:04,635][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:09,637][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:14,641][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:19,643][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:24,645][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:29,649][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:34,651][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:39,655][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:44,660][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:49,662][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:54,663][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:03:59,665][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:04,666][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:09,673][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:14,675][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:19,680][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:24,690][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:29,693][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:34,698][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:39,704][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:44,721][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:49,724][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:54,732][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:04:59,741][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:04,746][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:09,754][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:14,760][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:19,764][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:24,770][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:29,772][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:34,774][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:39,778][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:44,782][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:49,785][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:54,791][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:05:59,795][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:04,801][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:09,805][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:14,810][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:19,814][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:24,819][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:29,820][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:34,822][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:39,834][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:44,839][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:49,840][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:54,842][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:06:59,852][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:04,855][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:09,859][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:14,863][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:19,865][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:24,873][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:29,881][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:34,886][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:39,887][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:44,889][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:49,890][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:54,896][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:07:59,900][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:04,902][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:09,908][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:14,914][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:19,927][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:24,930][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:29,932][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:34,938][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:39,943][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:44,947][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:49,949][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:54,952][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:08:59,958][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:04,962][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:09,969][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:14,976][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:19,983][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:24,991][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:29,994][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:34,996][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:40,013][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:45,022][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:50,025][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:09:55,036][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:00,040][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:05,046][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:10,052][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:15,054][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:20,057][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:25,063][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:30,069][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:35,075][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:40,102][ INFO][PID:1824438] Periodic builder liveness probe: alive [2025-07-25 16:10:40,104][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:45,107][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:50,111][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:10:55,118][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:00,125][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:05,129][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:10,131][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:15,136][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:20,140][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:25,161][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:30,164][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:35,175][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:40,177][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:45,181][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:50,184][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:11:55,191][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:00,194][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:05,197][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:10,198][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:15,200][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:20,203][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:25,205][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:30,209][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:35,225][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:40,227][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:45,229][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:50,234][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:12:55,236][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:00,241][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:05,245][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:10,249][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:15,250][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:20,252][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:25,256][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:30,258][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:35,260][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:40,265][ INFO][PID:1824438] Checking for cancel request [2025-07-25 16:13:40,481][ INFO][PID:1824438] Downloading results from builder [2025-07-25 16:13:40,482][ INFO][PID:1824438] rsyncing of mockbuilder@52.205.37.230:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx started [2025-07-25 16:13:40,496][ INFO][PID:1824438] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@52.205.37.230:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/ &> /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/build-09337657.rsync.log [2025-07-25 16:13:47,374][ INFO][PID:1824438] rsyncing finished. [2025-07-25 16:13:47,375][ INFO][PID:1824438] Releasing VM back to pool [2025-07-25 16:13:47,397][ INFO][PID:1824438] Searching for 'success' file in resultdir [2025-07-25 16:13:47,398][ INFO][PID:1824438] Going to sign pkgs from source: 9337657-rhel-10-x86_64 in chroot: /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64 [2025-07-25 16:13:47,399][ INFO][PID:1824438] Calling '/bin/sign -u brycensranch#snapx@copr.fedorahosted.org -p' (attempt #1) [2025-07-25 16:13:47,583][ INFO][PID:1824438] Calling '/bin/sign -4 -h sha256 -u brycensranch#snapx@copr.fedorahosted.org -r /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/snapx-0.4.0-2.el10.src.rpm' (attempt #1) [2025-07-25 16:13:48,213][ INFO][PID:1824438] signed rpm: /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/snapx-0.4.0-2.el10.src.rpm [2025-07-25 16:13:48,214][ INFO][PID:1824438] Calling '/bin/sign -4 -h sha256 -u brycensranch#snapx@copr.fedorahosted.org -r /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/snapx-0.4.0-2.el10.x86_64.rpm' (attempt #1) [2025-07-25 16:14:04,834][ INFO][PID:1824438] signed rpm: /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/snapx-0.4.0-2.el10.x86_64.rpm [2025-07-25 16:14:04,835][ INFO][PID:1824438] Calling '/bin/sign -4 -h sha256 -u brycensranch#snapx@copr.fedorahosted.org -r /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/snapx-ui-0.4.0-2.el10.x86_64.rpm' (attempt #1) [2025-07-25 16:14:05,541][ INFO][PID:1824438] signed rpm: /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/snapx-ui-0.4.0-2.el10.x86_64.rpm [2025-07-25 16:14:05,542][ INFO][PID:1824438] Sign done [2025-07-25 16:14:05,543][ INFO][PID:1824438] Incremental createrepo run, adding 09337657-snapx into https://download.copr.fedorainfracloud.org/results/brycensranch/snapx/rhel-10-x86_64, (auto-create-repo=True) [2025-07-25 16:14:05,545][ INFO][PID:1824438] Running command 'copr-repo --batched /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64 --add 09337657-snapx --no-appstream-metadata' as PID 2090937 [2025-07-25 16:14:08,443][ INFO][PID:1824438] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64 --add 09337657-snapx --no-appstream-metadata) [2025-07-25 16:14:08,450][ INFO][PID:1824438] Getting build details [2025-07-25 16:14:08,458][ INFO][PID:1824438] Listing built binary packages in /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx [2025-07-25 16:14:08,459][ INFO][PID:1824438] Built packages: ['snapx-ui 0.4.0', 'snapx 0.4.0'] [2025-07-25 16:14:08,459][ INFO][PID:1824438] build details: {'built_packages': 'snapx-ui 0.4.0\nsnapx 0.4.0'} [2025-07-25 16:14:08,463][ INFO][PID:1824438] Retrieving pubkey [2025-07-25 16:14:08,463][ INFO][PID:1824438] Calling '/bin/sign -u brycensranch#snapx@copr.fedorahosted.org -p' (attempt #1) [2025-07-25 16:14:08,660][ INFO][PID:1824438] Added pubkey for user brycensranch project snapx into: /var/lib/copr/public_html/results/brycensranch/snapx/pubkey.gpg [2025-07-25 16:14:08,661][ INFO][PID:1824438] Finished build: id=9337657 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/brycensranch/snapx chroot=rhel-10-x86_64 [2025-07-25 16:14:08,677][ INFO][PID:1824438] Worker succeeded build, took 884.6937861442566 [2025-07-25 16:14:08,683][ INFO][PID:1824438] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "brycensranch", "project_name": "snapx", "project_dirname": "snapx", "submitter": "https://api.github.com/users/BrycensRanch", "ended_on": 1753460048.677278, "started_on": 1753459163.983492, "submitted_on": null, "status": 1, "chroot": "rhel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9337657-rhel-10-x86_64", "build_id": 9337657, "package_name": "snapx", "package_version": "0.4.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/brycensranch/snapx/snapx", "git_hash": "562a3ec9d73c2df6dcd52e5332e386d207bfba51", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "brycensranch/snapx--https://api.github.com/users/BrycensRanch", "results": { "packages": [ { "name": "snapx-ui", "epoch": null, "version": "0.4.0", "release": "2.el10", "arch": "x86_64" }, { "name": "snapx", "epoch": null, "version": "0.4.0", "release": "2.el10", "arch": "src" }, { "name": "snapx", "epoch": null, "version": "0.4.0", "release": "2.el10", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx/rhel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://packages.microsoft.com/opensuse/15/prod", "id": "https_packages_microsoft_com_opensuse_15_prod", "name": "Additional repo https_packages_microsoft_com_opensuse_15_prod" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/brycensranch/snapx", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx", "result_dir": "09337657-snapx", "built_packages": "snapx-ui 0.4.0\nsnapx 0.4.0", "id": 9337657, "mockchain_macros": { "copr_username": "brycensranch", "copr_projectname": "snapx", "vendor": "Fedora Project COPR (brycensranch/snapx)" } } ] } [2025-07-25 16:14:08,790][ INFO][PID:1824438] Sending fedora-messaging bus message in build.end [2025-07-25 16:14:08,841][ INFO][PID:1824438] Compressing /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/builder-live.log by gzip [2025-07-25 16:14:08,842][ INFO][PID:1824438] Running command 'gzip /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/builder-live.log' as PID 2091464 [2025-07-25 16:14:08,920][ INFO][PID:1824438] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/builder-live.log) [2025-07-25 16:14:08,922][ INFO][PID:1824438] Compressing /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/backend.log by gzip [2025-07-25 16:14:08,925][ INFO][PID:1824438] Running command 'gzip /var/lib/copr/public_html/results/brycensranch/snapx/rhel-10-x86_64/09337657-snapx/backend.log' as PID 2091473