[2026-04-09 14:40:41,640][ INFO][PID:1031142] Marking build as starting [2026-04-09 14:40:41,717][ INFO][PID:1031142] Checking that /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/repodata/repomd.xml exists [2026-04-09 14:40:41,727][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:40:41,730][ INFO][PID:1031142] VM allocation process starts [2026-04-09 14:40:41,755][ INFO][PID:1031142] Trying to allocate VM: ResallocHost, ticket_id=2247816, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-09 14:40:46,763][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:40:51,770][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:40:53,867][ INFO][PID:1031142] Allocated host ResallocHost, ticket_id=2247816, hostname=3.235.236.205, name=aws_x86_64_spot_prod_05960027_20260409_143838, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-09 14:40:53,868][ INFO][PID:1031142] Allocating ssh connection to builder [2026-04-09 14:40:53,869][ INFO][PID:1031142] Checking that builder machine is OK [2026-04-09 14:40:54,283][ INFO][PID:1031142] Running remote command: copr-builder-ready epel-10-x86_64 [2026-04-09 14:40:54,664][ INFO][PID:1031142] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-04-09 14:40:54,667][ INFO][PID:1031142] Filling build.info file with builder info [2026-04-09 14:40:54,670][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:40:54,671][ INFO][PID:1031142] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "yselkowitz", "project_name": "cosmic-epel", "project_dirname": "cosmic-epel", "submitter": "https://src.fedoraproject.org/user/ryanabx", "ended_on": null, "started_on": 1775745654.6715474, "submitted_on": null, "status": 3, "chroot": "epel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10308561-epel-10-x86_64", "build_id": 10308561, "package_name": "cosmic-panel", "package_version": "1.0.9-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/yselkowitz/cosmic-epel/cosmic-panel", "git_hash": "a4b135d85732016a6b58eacfb150b57f2ca0fe26", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "yselkowitz/cosmic-epel--https://src.fedoraproject.org/user/ryanabx", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/yselkowitz/cosmic-epel/epel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/yselkowitz/cosmic-epel", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/yselkowitz/cosmic-epel", "result_dir": "10308561-cosmic-panel", "built_packages": "", "id": 10308561, "mockchain_macros": { "copr_username": "yselkowitz", "copr_projectname": "cosmic-epel", "vendor": "Fedora Project COPR (yselkowitz/cosmic-epel)" } } ] } [2026-04-09 14:40:54,745][ INFO][PID:1031142] Sending fedora-messaging bus message in build.start [2026-04-09 14:40:55,634][ INFO][PID:1031142] Sending fedora-messaging bus message in chroot.start [2026-04-09 14:40:55,728][ INFO][PID:1031142] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10308561-epel-10-x86_64 --chroot epel-10-x86_64 --detached [2026-04-09 14:40:56,147][ INFO][PID:1031142] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.235.236.205' (ED25519) to the list of known hosts. [2026-04-09 14:40:56,148][ INFO][PID:1031142] Downloading the builder-live.log file, attempt 1 [2026-04-09 14:40:56,280][ INFO][PID:1031142] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.236.205 copr-rpmbuild-log [2026-04-09 14:41:01,195][ INFO][PID:1031142] Periodic builder liveness probe: alive [2026-04-09 14:41:01,200][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:06,211][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:11,214][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:16,229][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:21,235][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:26,242][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:31,246][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:36,252][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:41,259][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:46,272][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:51,274][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:41:56,287][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:01,289][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:06,303][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:11,305][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:16,307][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:21,314][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:26,318][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:31,322][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:36,326][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:41,334][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:46,339][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:51,352][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:42:56,356][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:01,363][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:06,367][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:11,368][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:16,369][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:21,371][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:26,375][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:31,379][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:36,380][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:41,382][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:46,386][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:51,391][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:43:56,393][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:01,394][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:06,396][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:11,398][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:16,400][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:21,402][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:26,405][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:31,417][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:36,419][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:41,424][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:46,425][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:51,427][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:44:56,428][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:01,429][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:06,430][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:11,432][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:16,434][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:21,436][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:26,437][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:31,439][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:36,440][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:41,443][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:46,444][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:51,445][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:45:56,446][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:01,448][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:06,449][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:11,450][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:16,454][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:21,455][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:26,456][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:31,457][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:36,460][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:41,461][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:46,462][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:51,464][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:46:56,470][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:01,609][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:06,610][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:11,612][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:16,614][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:21,615][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:26,616][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:31,618][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:36,619][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:41,620][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:46,621][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:51,626][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:47:56,627][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:01,628][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:06,629][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:11,638][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:16,644][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:21,646][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:26,650][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:31,651][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:36,652][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:41,654][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:46,664][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:51,665][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:48:56,669][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:01,673][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:06,674][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:11,676][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:16,679][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:21,694][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:26,700][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:31,702][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:36,704][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:41,710][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:46,820][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:51,855][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:49:56,856][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:01,887][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:06,892][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:11,893][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:16,894][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:21,896][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:26,901][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:31,903][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:36,904][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:42,106][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:47,280][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:52,623][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:50:57,271][ ERROR][PID:1031142] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-09 14:51:02,306][ INFO][PID:1031142] Periodic builder liveness probe: alive [2026-04-09 14:51:02,472][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:07,276][WARNING][PID:1031142] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-09 14:51:07,500][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:12,503][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:17,277][ INFO][PID:1031142] Downloading the builder-live.log file, attempt 2 [2026-04-09 14:51:17,288][ INFO][PID:1031142] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.236.205 copr-rpmbuild-log [2026-04-09 14:51:17,296][ ERROR][PID:1031142] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-09 14:51:17,506][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:22,585][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:27,306][WARNING][PID:1031142] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-09 14:51:27,615][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:32,626][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:37,307][ INFO][PID:1031142] Downloading the builder-live.log file, attempt 3 [2026-04-09 14:51:37,472][ INFO][PID:1031142] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.236.205 copr-rpmbuild-log [2026-04-09 14:51:37,780][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:42,814][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:47,818][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:52,826][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:51:57,831][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:02,839][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:07,880][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:12,923][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:17,974][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:22,982][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:28,021][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:33,023][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:37,550][ ERROR][PID:1031142] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-09 14:52:38,025][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:43,027][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:47,593][WARNING][PID:1031142] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-09 14:52:48,028][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:53,029][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:52:57,594][ INFO][PID:1031142] Downloading the builder-live.log file, attempt 4 [2026-04-09 14:52:57,604][ INFO][PID:1031142] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.236.205 copr-rpmbuild-log [2026-04-09 14:52:58,031][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:03,032][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:08,034][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:13,035][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:18,037][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:23,040][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:28,042][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:33,044][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:38,045][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:48,413][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:57,562][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:53:57,707][ ERROR][PID:1031142] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-09 14:54:02,570][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:07,577][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:07,713][ ERROR][PID:1031142] Giving up for unstable SSH, failures: 1775746267.2762501, 1775746287.3067582, 1775746367.5929844, 1775746447.7136981 [2026-04-09 14:54:07,715][ ERROR][PID:1031142] Re-try request for task on 'ResallocHost, ticket_id=2247816, hostname=3.235.236.205, name=aws_x86_64_spot_prod_05960027_20260409_143838, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-09 14:54:07,716][ INFO][PID:1031142] Releasing VM back to pool [2026-04-09 14:54:07,737][ INFO][PID:1031142] Retry #1 (on other host) [2026-04-09 14:54:07,738][ INFO][PID:1031142] Checking that /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/repodata/repomd.xml exists [2026-04-09 14:54:07,739][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:07,741][ INFO][PID:1031142] VM allocation process starts [2026-04-09 14:54:07,766][ INFO][PID:1031142] Trying to allocate VM: ResallocHost, ticket_id=2248165, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-09 14:54:10,798][ INFO][PID:1031142] Allocated host ResallocHost, ticket_id=2248165, hostname=3.237.100.21, name=aws_x86_64_normalreserved_prod_05960326_20260409_145116, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-09 14:54:10,863][ INFO][PID:1031142] Allocating ssh connection to builder [2026-04-09 14:54:10,866][ INFO][PID:1031142] Checking that builder machine is OK [2026-04-09 14:54:11,244][ INFO][PID:1031142] Running remote command: copr-builder-ready epel-10-x86_64 [2026-04-09 14:54:11,479][ INFO][PID:1031142] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-04-09 14:54:11,483][ INFO][PID:1031142] Filling build.info file with builder info [2026-04-09 14:54:11,528][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:11,530][ INFO][PID:1031142] Not re-notifying FE and msg buses for the new host. [2026-04-09 14:54:11,531][ INFO][PID:1031142] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10308561-epel-10-x86_64 --chroot epel-10-x86_64 --detached [2026-04-09 14:54:11,932][ INFO][PID:1031142] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.237.100.21' (ED25519) to the list of known hosts. [2026-04-09 14:54:11,935][ INFO][PID:1031142] Downloading the builder-live.log file, attempt 1 [2026-04-09 14:54:11,936][ INFO][PID:1031142] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.237.100.21 copr-rpmbuild-log [2026-04-09 14:54:16,935][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:21,936][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:26,951][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:31,952][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:36,953][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:41,955][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:46,956][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:51,957][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:54:56,960][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:01,962][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:06,963][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:11,964][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:16,965][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:21,966][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:26,971][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:31,988][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:37,005][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:42,006][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:47,068][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:52,069][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:55:57,409][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:02,410][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:07,805][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:13,461][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:18,462][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:35,945][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:40,987][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:56:45,994][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:01,062][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:06,259][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:11,260][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:16,261][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:21,262][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:26,266][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:31,318][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:36,341][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:41,344][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:46,355][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:51,369][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:57:56,370][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:01,385][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:06,397][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:11,407][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:16,411][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:21,412][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:26,414][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:31,415][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:36,417][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:41,442][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:46,447][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:51,452][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:58:56,457][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:01,461][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:06,464][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:11,466][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:16,476][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:21,501][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:26,538][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:31,543][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:36,553][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:41,562][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:46,576][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:51,578][ INFO][PID:1031142] Checking for cancel request [2026-04-09 14:59:56,586][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:01,588][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:06,589][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:11,591][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:16,593][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:21,601][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:26,609][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:31,622][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:36,629][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:41,630][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:46,635][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:51,655][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:00:56,659][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:01,679][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:06,761][ INFO][PID:1031142] Periodic builder liveness probe: alive [2026-04-09 15:01:06,765][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:11,777][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:16,789][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:21,812][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:26,814][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:31,817][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:36,820][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:41,824][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:46,827][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:51,836][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:01:56,847][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:01,855][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:06,859][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:11,866][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:16,892][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:21,902][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:26,906][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:31,913][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:36,915][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:41,918][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:46,919][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:51,924][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:02:56,941][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:01,950][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:06,963][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:11,967][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:16,968][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:21,970][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:26,977][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:31,982][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:36,984][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:41,985][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:46,992][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:51,997][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:03:57,003][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:02,005][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:07,021][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:12,026][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:17,029][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:22,036][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:27,037][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:32,040][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:37,044][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:42,045][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:47,047][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:52,049][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:04:57,050][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:02,051][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:07,055][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:12,056][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:17,058][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:22,059][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:27,060][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:32,072][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:37,073][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:42,078][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:47,080][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:52,097][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:05:57,103][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:02,124][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:07,136][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:12,138][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:17,165][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:22,167][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:27,174][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:32,182][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:37,183][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:42,197][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:47,214][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:52,216][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:06:57,223][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:02,243][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:07,244][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:12,251][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:17,254][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:22,257][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:27,263][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:32,268][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:37,276][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:42,288][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:47,308][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:52,312][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:07:57,328][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:08:02,335][ INFO][PID:1031142] Checking for cancel request [2026-04-09 15:08:05,291][ INFO][PID:1031142] Downloading results from builder [2026-04-09 15:08:05,293][ INFO][PID:1031142] rsyncing of mockbuilder@3.237.100.21:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel started [2026-04-09 15:08:05,294][ INFO][PID:1031142] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.237.100.21:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/ &> /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/build-10308561.rsync.log [2026-04-09 15:08:07,947][ INFO][PID:1031142] rsyncing finished. [2026-04-09 15:08:07,948][ INFO][PID:1031142] Releasing VM back to pool [2026-04-09 15:08:07,988][ INFO][PID:1031142] Searching for 'success' file in resultdir [2026-04-09 15:08:07,992][ INFO][PID:1031142] Going to sign pkgs from source: 10308561-epel-10-x86_64 in chroot: /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64 [2026-04-09 15:08:07,993][ INFO][PID:1031142] Calling '/bin/sign -u yselkowitz#cosmic-epel@copr.fedorahosted.org -p' (attempt #1) [2026-04-09 15:08:08,270][ INFO][PID:1031142] Calling '/bin/sign -4 -h sha256 -u yselkowitz#cosmic-epel@copr.fedorahosted.org -r /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-debuginfo-1.0.9-1.el10.x86_64.rpm' (attempt #1) [2026-04-09 15:08:11,224][ INFO][PID:1031142] signed rpm: /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-debuginfo-1.0.9-1.el10.x86_64.rpm [2026-04-09 15:08:11,225][ INFO][PID:1031142] Calling '/bin/sign -4 -h sha256 -u yselkowitz#cosmic-epel@copr.fedorahosted.org -r /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-1.0.9-1.el10.x86_64.rpm' (attempt #1) [2026-04-09 15:08:12,530][ INFO][PID:1031142] signed rpm: /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-1.0.9-1.el10.x86_64.rpm [2026-04-09 15:08:12,531][ INFO][PID:1031142] Calling '/bin/sign -4 -h sha256 -u yselkowitz#cosmic-epel@copr.fedorahosted.org -r /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-1.0.9-1.el10.src.rpm' (attempt #1) [2026-04-09 15:08:18,628][ INFO][PID:1031142] signed rpm: /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-1.0.9-1.el10.src.rpm [2026-04-09 15:08:18,629][ INFO][PID:1031142] Calling '/bin/sign -4 -h sha256 -u yselkowitz#cosmic-epel@copr.fedorahosted.org -r /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-debugsource-1.0.9-1.el10.x86_64.rpm' (attempt #1) [2026-04-09 15:08:19,776][ INFO][PID:1031142] signed rpm: /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/cosmic-panel-debugsource-1.0.9-1.el10.x86_64.rpm [2026-04-09 15:08:19,778][ INFO][PID:1031142] Sign done [2026-04-09 15:08:19,779][ INFO][PID:1031142] Incremental createrepo run, adding 10308561-cosmic-panel into https://download.copr.fedorainfracloud.org/results/yselkowitz/cosmic-epel/epel-10-x86_64, (auto-create-repo=True) [2026-04-09 15:08:19,794][ INFO][PID:1031142] Running command 'copr-repo --batched /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64 --add 10308561-cosmic-panel' as PID 1314890 [2026-04-09 15:08:46,457][ INFO][PID:1031142] Finished after 26 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64 --add 10308561-cosmic-panel) [2026-04-09 15:08:46,478][ INFO][PID:1031142] Getting build details [2026-04-09 15:08:46,482][ INFO][PID:1031142] Listing built binary packages in /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel [2026-04-09 15:08:46,490][ INFO][PID:1031142] Built packages: ['cosmic-panel-debuginfo 1.0.9', 'cosmic-panel-debugsource 1.0.9', 'cosmic-panel 1.0.9'] [2026-04-09 15:08:46,499][ INFO][PID:1031142] build details: {'built_packages': 'cosmic-panel-debuginfo 1.0.9\ncosmic-panel-debugsource 1.0.9\ncosmic-panel 1.0.9'} [2026-04-09 15:08:46,507][ INFO][PID:1031142] Retrieving pubkey [2026-04-09 15:08:46,510][ INFO][PID:1031142] Calling '/bin/sign -u yselkowitz#cosmic-epel@copr.fedorahosted.org -p' (attempt #1) [2026-04-09 15:08:46,812][ INFO][PID:1031142] Added pubkey for user yselkowitz project cosmic-epel into: /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/pubkey.gpg [2026-04-09 15:08:46,816][ INFO][PID:1031142] Finished build: id=10308561 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/yselkowitz/cosmic-epel chroot=epel-10-x86_64 [2026-04-09 15:08:46,827][ INFO][PID:1031142] Worker succeeded build, took 875.2962217330933 [2026-04-09 15:08:46,829][ INFO][PID:1031142] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "yselkowitz", "project_name": "cosmic-epel", "project_dirname": "cosmic-epel", "submitter": "https://src.fedoraproject.org/user/ryanabx", "ended_on": 1775747326.827064, "started_on": 1775746451.5308423, "submitted_on": null, "status": 1, "chroot": "epel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10308561-epel-10-x86_64", "build_id": 10308561, "package_name": "cosmic-panel", "package_version": "1.0.9-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/yselkowitz/cosmic-epel/cosmic-panel", "git_hash": "a4b135d85732016a6b58eacfb150b57f2ca0fe26", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "yselkowitz/cosmic-epel--https://src.fedoraproject.org/user/ryanabx", "results": { "packages": [ { "name": "cosmic-panel-debuginfo", "epoch": null, "version": "1.0.9", "release": "1.el10", "arch": "x86_64" }, { "name": "cosmic-panel-debugsource", "epoch": null, "version": "1.0.9", "release": "1.el10", "arch": "x86_64" }, { "name": "cosmic-panel", "epoch": null, "version": "1.0.9", "release": "1.el10", "arch": "x86_64" }, { "name": "cosmic-panel", "epoch": null, "version": "1.0.9", "release": "1.el10", "arch": "src" } ] }, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/yselkowitz/cosmic-epel/epel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/yselkowitz/cosmic-epel", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/yselkowitz/cosmic-epel", "result_dir": "10308561-cosmic-panel", "built_packages": "cosmic-panel-debuginfo 1.0.9\ncosmic-panel-debugsource 1.0.9\ncosmic-panel 1.0.9", "id": 10308561, "mockchain_macros": { "copr_username": "yselkowitz", "copr_projectname": "cosmic-epel", "vendor": "Fedora Project COPR (yselkowitz/cosmic-epel)" } } ] } [2026-04-09 15:08:46,995][ INFO][PID:1031142] Sending fedora-messaging bus message in build.end [2026-04-09 15:08:47,064][ INFO][PID:1031142] Compressing /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/builder-live.log by gzip [2026-04-09 15:08:47,070][ INFO][PID:1031142] Running command 'gzip /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/builder-live.log' as PID 1321683 [2026-04-09 15:08:47,276][ INFO][PID:1031142] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/builder-live.log) [2026-04-09 15:08:47,278][ INFO][PID:1031142] Compressing /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/backend.log by gzip [2026-04-09 15:08:47,286][ INFO][PID:1031142] Running command 'gzip /var/lib/copr/public_html/results/yselkowitz/cosmic-epel/epel-10-x86_64/10308561-cosmic-panel/backend.log' as PID 1321719