[2025-07-25 16:00:42,691][ INFO][PID:1943766] Marking build as starting [2025-07-25 16:00:42,790][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:00:42,796][ INFO][PID:1943766] VM allocation process starts [2025-07-25 16:00:42,846][ INFO][PID:1943766] Trying to allocate VM: ResallocHost, ticket_id=4148237, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 16:00:47,849][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:00:52,853][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:00:57,856][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:02,859][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:07,873][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:12,885][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:17,889][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:22,894][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:27,901][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:32,908][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:37,919][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:42,924][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:47,926][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:52,937][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:01:57,943][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:02,951][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:07,958][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:12,972][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:17,974][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:22,977][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:27,987][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:31,127][ INFO][PID:1943766] Allocated host ResallocHost, ticket_id=4148237, hostname=3.80.2.151, name=aws_x86_64_spot_prod_05878677_20250725_160013, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 16:02:31,128][ INFO][PID:1943766] Allocating ssh connection to builder [2025-07-25 16:02:31,130][ INFO][PID:1943766] Checking that builder machine is OK [2025-07-25 16:02:31,609][ INFO][PID:1943766] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2025-07-25 16:02:31,885][ INFO][PID:1943766] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2025-07-25 16:02:31,886][ INFO][PID:1943766] Filling build.info file with builder info [2025-07-25 16:02:31,888][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:31,896][ INFO][PID:1943766] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "brycensranch", "project_name": "snapx", "project_dirname": "snapx", "submitter": "https://api.github.com/users/renovate%5Bbot%5D", "ended_on": null, "started_on": 1753459351.8961234, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9337686-centos-stream-9-x86_64", "build_id": 9337686, "package_name": "snapx", "package_version": "0.4.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/brycensranch/snapx/snapx", "git_hash": "dc9924da3865cd8f1623388fd53f07c3c6c8bece", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "brycensranch/snapx--https://api.github.com/users/renovate%5Bbot%5D", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx/centos-stream-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://packages.microsoft.com/opensuse/15/prod", "id": "https_packages_microsoft_com_opensuse_15_prod", "name": "Additional repo https_packages_microsoft_com_opensuse_15_prod" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/brycensranch/snapx", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx", "result_dir": "09337686-snapx", "built_packages": "", "id": 9337686, "mockchain_macros": { "copr_username": "brycensranch", "copr_projectname": "snapx", "vendor": "Fedora Project COPR (brycensranch/snapx)" } } ] } [2025-07-25 16:02:31,959][ INFO][PID:1943766] Sending fedora-messaging bus message in build.start [2025-07-25 16:02:33,754][ INFO][PID:1943766] Sending fedora-messaging bus message in chroot.start [2025-07-25 16:02:33,790][ INFO][PID:1943766] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9337686-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2025-07-25 16:02:34,192][ INFO][PID:1943766] Downloading the builder-live.log file, attempt 1 [2025-07-25 16:02:34,202][ INFO][PID:1943766] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.2.151 copr-rpmbuild-log [2025-07-25 16:02:39,228][ INFO][PID:1943766] Periodic builder liveness probe: alive [2025-07-25 16:02:39,230][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:44,234][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:49,241][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:54,242][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:02:59,246][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:04,250][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:09,258][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:14,263][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:19,266][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:24,267][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:29,273][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:34,274][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:39,277][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:44,280][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:49,288][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:54,289][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:03:59,294][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:04,298][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:09,300][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:14,302][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:19,308][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:24,316][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:29,318][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:34,321][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:39,328][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:44,337][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:49,345][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:54,346][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:04:55,299][ ERROR][PID:1943766] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 16:04:59,348][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:04,351][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:05,306][WARNING][PID:1943766] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-25 16:05:09,353][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:14,356][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:15,307][ INFO][PID:1943766] Downloading the builder-live.log file, attempt 2 [2025-07-25 16:05:15,310][ INFO][PID:1943766] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.2.151 copr-rpmbuild-log [2025-07-25 16:05:19,363][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:24,366][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:29,376][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:34,379][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:39,385][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:44,394][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:49,400][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:54,405][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:05:59,408][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:04,419][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:09,424][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:14,428][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:15,400][ ERROR][PID:1943766] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 16:06:19,430][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:24,436][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:25,403][WARNING][PID:1943766] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-25 16:06:29,441][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:34,444][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:35,404][ INFO][PID:1943766] Downloading the builder-live.log file, attempt 3 [2025-07-25 16:06:35,408][ INFO][PID:1943766] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.2.151 copr-rpmbuild-log [2025-07-25 16:06:39,446][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:44,454][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:49,459][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:54,477][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:06:59,480][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:04,483][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:09,492][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:14,499][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:19,500][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:24,503][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:29,507][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:34,510][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:35,497][ ERROR][PID:1943766] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 16:07:39,513][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:44,514][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:45,501][WARNING][PID:1943766] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-25 16:07:49,517][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:54,518][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:07:55,502][ INFO][PID:1943766] Downloading the builder-live.log file, attempt 4 [2025-07-25 16:07:55,507][ INFO][PID:1943766] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.2.151 copr-rpmbuild-log [2025-07-25 16:07:59,520][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:04,524][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:09,526][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:14,527][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:19,542][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:24,547][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:29,550][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:34,555][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:39,558][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:44,569][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:49,572][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:54,579][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:08:55,589][ ERROR][PID:1943766] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-25 16:08:59,584][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:04,594][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:05,593][ ERROR][PID:1943766] Giving up for unstable SSH, failures: 1753459505.3061361, 1753459585.4038272, 1753459665.5015802, 1753459745.5928652 [2025-07-25 16:09:05,602][ ERROR][PID:1943766] Re-try request for task on 'ResallocHost, ticket_id=4148237, hostname=3.80.2.151, name=aws_x86_64_spot_prod_05878677_20250725_160013, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-25 16:09:05,602][ INFO][PID:1943766] Releasing VM back to pool [2025-07-25 16:09:05,662][ INFO][PID:1943766] Retry #1 (on other host) [2025-07-25 16:09:05,666][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:05,678][ INFO][PID:1943766] VM allocation process starts [2025-07-25 16:09:05,737][ INFO][PID:1943766] Trying to allocate VM: ResallocHost, ticket_id=4148549, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 16:09:10,749][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:15,755][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:20,757][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:25,758][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:30,760][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:35,766][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:40,775][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:45,776][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:50,778][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:53,930][ INFO][PID:1943766] Allocated host ResallocHost, ticket_id=4148549, hostname=2620:52:3:1:dead:beef:cafe:c1d8, name=copr_hv_x86_64_04_prod_05878837_20250725_160748, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-25 16:09:53,931][ INFO][PID:1943766] Allocating ssh connection to builder [2025-07-25 16:09:53,933][ INFO][PID:1943766] Checking that builder machine is OK [2025-07-25 16:09:54,576][ INFO][PID:1943766] Running remote command: copr-builder-ready centos-stream-9-x86_64 [2025-07-25 16:09:54,981][ INFO][PID:1943766] Red Hat subscription not needed for centos-stream-9-x86_64 Builder is ready to be used [2025-07-25 16:09:54,983][ INFO][PID:1943766] Filling build.info file with builder info [2025-07-25 16:09:54,990][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:09:54,994][ INFO][PID:1943766] Not re-notifying FE and msg buses for the new host. [2025-07-25 16:09:54,999][ INFO][PID:1943766] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9337686-centos-stream-9-x86_64 --chroot centos-stream-9-x86_64 --detached [2025-07-25 16:09:55,646][ INFO][PID:1943766] Downloading the builder-live.log file, attempt 1 [2025-07-25 16:09:55,650][ INFO][PID:1943766] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1d8 copr-rpmbuild-log [2025-07-25 16:10:00,648][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:05,652][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:10,653][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:15,657][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:20,658][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:25,660][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:30,669][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:35,673][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:40,678][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:45,682][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:50,684][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:10:55,694][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:00,698][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:05,700][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:10,702][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:15,704][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:20,707][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:25,714][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:30,716][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:35,721][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:40,726][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:45,737][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:50,744][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:11:55,748][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:00,749][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:05,752][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:10,759][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:15,761][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:20,762][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:25,765][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:30,767][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:35,775][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:40,796][ INFO][PID:1943766] Periodic builder liveness probe: alive [2025-07-25 16:12:40,798][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:45,801][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:50,804][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:12:55,809][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:00,815][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:05,817][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:10,820][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:15,828][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:20,834][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:25,836][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:30,839][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:35,843][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:40,849][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:45,854][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:50,862][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:13:55,863][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:00,867][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:05,870][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:10,871][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:15,875][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:20,878][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:25,880][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:30,882][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:35,886][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:40,892][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:45,893][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:50,895][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:14:55,901][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:00,904][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:05,909][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:10,912][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:15,915][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:20,919][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:25,985][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:30,989][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:35,993][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:40,998][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:45,999][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:51,003][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:15:56,006][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:01,011][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:06,013][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:11,014][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:16,016][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:21,021][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:26,023][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:31,027][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:36,032][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:41,040][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:46,043][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:51,047][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:16:56,051][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:01,055][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:06,060][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:11,061][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:16,070][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:21,076][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:26,078][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:31,089][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:36,095][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:41,098][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:46,102][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:51,105][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:17:56,109][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:01,114][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:06,117][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:11,124][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:16,129][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:21,135][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:26,136][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:31,147][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:36,150][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:41,157][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:46,161][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:51,172][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:18:56,187][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:01,193][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:06,201][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:11,204][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:16,205][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:21,214][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:26,220][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:31,222][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:36,224][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:41,228][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:46,231][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:51,235][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:19:56,243][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:01,248][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:06,250][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:11,260][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:16,265][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:21,267][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:26,275][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:31,281][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:36,283][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:41,290][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:46,299][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:51,303][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:20:56,308][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:01,316][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:06,319][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:11,323][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:16,327][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:21,329][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:26,335][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:31,340][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:36,346][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:41,347][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:46,352][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:51,356][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:21:56,364][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:01,365][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:06,366][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:11,369][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:16,374][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:21,379][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:26,384][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:31,387][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:36,392][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:41,410][ INFO][PID:1943766] Periodic builder liveness probe: alive [2025-07-25 16:22:41,411][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:46,412][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:51,419][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:22:56,428][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:01,433][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:06,435][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:11,437][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:16,439][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:21,442][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:26,444][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:31,445][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:36,450][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:41,452][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:46,455][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:51,456][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:23:56,469][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:01,474][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:06,483][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:11,484][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:16,495][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:21,500][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:26,503][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:31,504][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:36,509][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:41,519][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:46,526][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:51,531][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:24:56,533][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:01,534][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:06,538][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:11,545][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:16,551][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:21,556][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:26,558][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:31,560][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:36,567][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:41,577][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:46,578][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:51,582][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:25:56,583][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:01,588][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:06,589][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:11,593][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:16,600][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:21,611][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:26,616][ INFO][PID:1943766] Checking for cancel request [2025-07-25 16:26:28,728][ INFO][PID:1943766] Downloading results from builder [2025-07-25 16:26:28,739][ INFO][PID:1943766] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d8]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx started [2025-07-25 16:26:28,743][ INFO][PID:1943766] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d8]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/ &> /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/build-09337686.rsync.log [2025-07-25 16:26:48,280][ INFO][PID:1943766] rsyncing finished. [2025-07-25 16:26:48,281][ INFO][PID:1943766] Releasing VM back to pool [2025-07-25 16:26:48,331][ INFO][PID:1943766] Searching for 'success' file in resultdir [2025-07-25 16:26:48,336][ INFO][PID:1943766] Going to sign pkgs from source: 9337686-centos-stream-9-x86_64 in chroot: /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64 [2025-07-25 16:26:48,341][ INFO][PID:1943766] Calling '/bin/sign -u brycensranch#snapx@copr.fedorahosted.org -p' (attempt #1) [2025-07-25 16:26:48,680][ INFO][PID:1943766] Calling '/bin/sign -4 -h sha256 -u brycensranch#snapx@copr.fedorahosted.org -r /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/snapx-ui-0.4.0-2.el9.x86_64.rpm' (attempt #1) [2025-07-25 16:26:49,700][ INFO][PID:1943766] signed rpm: /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/snapx-ui-0.4.0-2.el9.x86_64.rpm [2025-07-25 16:26:49,701][ INFO][PID:1943766] Calling '/bin/sign -4 -h sha256 -u brycensranch#snapx@copr.fedorahosted.org -r /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/snapx-0.4.0-2.el9.src.rpm' (attempt #1) [2025-07-25 16:26:50,927][ INFO][PID:1943766] signed rpm: /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/snapx-0.4.0-2.el9.src.rpm [2025-07-25 16:26:50,931][ INFO][PID:1943766] Calling '/bin/sign -4 -h sha256 -u brycensranch#snapx@copr.fedorahosted.org -r /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/snapx-0.4.0-2.el9.x86_64.rpm' (attempt #1) [2025-07-25 16:27:13,971][ INFO][PID:1943766] signed rpm: /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/snapx-0.4.0-2.el9.x86_64.rpm [2025-07-25 16:27:13,972][ INFO][PID:1943766] Sign done [2025-07-25 16:27:13,974][ INFO][PID:1943766] Incremental createrepo run, adding 09337686-snapx into https://download.copr.fedorainfracloud.org/results/brycensranch/snapx/centos-stream-9-x86_64, (auto-create-repo=True) [2025-07-25 16:27:13,977][ INFO][PID:1943766] Running command 'copr-repo --batched /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64 --add 09337686-snapx --no-appstream-metadata' as PID 2220125 [2025-07-25 16:27:16,231][ INFO][PID:1943766] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64 --add 09337686-snapx --no-appstream-metadata) [2025-07-25 16:27:16,232][ INFO][PID:1943766] Getting build details [2025-07-25 16:27:16,232][ INFO][PID:1943766] Listing built binary packages in /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx [2025-07-25 16:27:16,233][ INFO][PID:1943766] Built packages: ['snapx 0.4.0', 'snapx-ui 0.4.0'] [2025-07-25 16:27:16,234][ INFO][PID:1943766] build details: {'built_packages': 'snapx 0.4.0\nsnapx-ui 0.4.0'} [2025-07-25 16:27:16,235][ INFO][PID:1943766] Retrieving pubkey [2025-07-25 16:27:16,236][ INFO][PID:1943766] Calling '/bin/sign -u brycensranch#snapx@copr.fedorahosted.org -p' (attempt #1) [2025-07-25 16:27:16,444][ INFO][PID:1943766] Added pubkey for user brycensranch project snapx into: /var/lib/copr/public_html/results/brycensranch/snapx/pubkey.gpg [2025-07-25 16:27:16,444][ INFO][PID:1943766] Finished build: id=9337686 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/brycensranch/snapx chroot=centos-stream-9-x86_64 [2025-07-25 16:27:16,446][ INFO][PID:1943766] Worker succeeded build, took 1041.452710390091 [2025-07-25 16:27:16,447][ INFO][PID:1943766] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "brycensranch", "project_name": "snapx", "project_dirname": "snapx", "submitter": "https://api.github.com/users/renovate%5Bbot%5D", "ended_on": 1753460836.4468205, "started_on": 1753459794.99411, "submitted_on": null, "status": 1, "chroot": "centos-stream-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9337686-centos-stream-9-x86_64", "build_id": 9337686, "package_name": "snapx", "package_version": "0.4.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/brycensranch/snapx/snapx", "git_hash": "dc9924da3865cd8f1623388fd53f07c3c6c8bece", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "brycensranch/snapx--https://api.github.com/users/renovate%5Bbot%5D", "results": { "packages": [ { "name": "snapx", "epoch": null, "version": "0.4.0", "release": "2.el9", "arch": "x86_64" }, { "name": "snapx", "epoch": null, "version": "0.4.0", "release": "2.el9", "arch": "src" }, { "name": "snapx-ui", "epoch": null, "version": "0.4.0", "release": "2.el9", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx/centos-stream-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://packages.microsoft.com/opensuse/15/prod", "id": "https_packages_microsoft_com_opensuse_15_prod", "name": "Additional repo https_packages_microsoft_com_opensuse_15_prod" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/brycensranch/snapx", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/brycensranch/snapx", "result_dir": "09337686-snapx", "built_packages": "snapx 0.4.0\nsnapx-ui 0.4.0", "id": 9337686, "mockchain_macros": { "copr_username": "brycensranch", "copr_projectname": "snapx", "vendor": "Fedora Project COPR (brycensranch/snapx)" } } ] } [2025-07-25 16:27:16,521][ INFO][PID:1943766] Sending fedora-messaging bus message in build.end [2025-07-25 16:27:16,548][ INFO][PID:1943766] Compressing /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/builder-live.log by gzip [2025-07-25 16:27:16,550][ INFO][PID:1943766] Running command 'gzip /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/builder-live.log' as PID 2220501 [2025-07-25 16:27:16,572][ INFO][PID:1943766] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/builder-live.log) [2025-07-25 16:27:16,573][ INFO][PID:1943766] Compressing /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/backend.log by gzip [2025-07-25 16:27:16,573][ INFO][PID:1943766] Running command 'gzip /var/lib/copr/public_html/results/brycensranch/snapx/centos-stream-9-x86_64/09337686-snapx/backend.log' as PID 2220505