[2025-08-25 15:27:16,016][ INFO][PID:2259881] Marking build as starting [2025-08-25 15:27:16,085][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:16,086][ INFO][PID:2259881] VM allocation process starts [2025-08-25 15:27:16,105][ INFO][PID:2259881] Trying to allocate VM: ResallocHost, ticket_id=4709941, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-25 15:27:19,123][ INFO][PID:2259881] Allocated host ResallocHost, ticket_id=4709941, hostname=3.80.206.6, name=aws_x86_64_spot_prod_06414056_20250825_150208, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-25 15:27:19,123][ INFO][PID:2259881] Allocating ssh connection to builder [2025-08-25 15:27:19,124][ INFO][PID:2259881] Checking that builder machine is OK [2025-08-25 15:27:19,477][ INFO][PID:2259881] Running remote command: copr-builder-ready fedora-42-x86_64 [2025-08-25 15:27:19,679][ INFO][PID:2259881] Red Hat subscription not needed for fedora-42-x86_64 Builder is ready to be used [2025-08-25 15:27:19,679][ INFO][PID:2259881] Filling build.info file with builder info [2025-08-25 15:27:19,680][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:19,681][ INFO][PID:2259881] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/cgwalters", "ended_on": null, "started_on": 1756135639.6814036, "submitted_on": null, "status": 3, "chroot": "fedora-42-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9478301-fedora-42-x86_64", "build_id": 9478301, "package_name": "rpm-ostree", "package_version": "2025.10.5.g2646a78b-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/rpm-ostree", "git_hash": "845b88c1da559b4c81233f920a14be2c7af4c608", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-42-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-42-x86_64/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "09478301-rpm-ostree", "built_packages": "", "id": 9478301, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2025-08-25 15:27:19,734][ INFO][PID:2259881] Sending fedora-messaging bus message in build.start [2025-08-25 15:27:20,520][ INFO][PID:2259881] Sending fedora-messaging bus message in chroot.start [2025-08-25 15:27:20,548][ INFO][PID:2259881] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9478301-fedora-42-x86_64 --chroot fedora-42-x86_64 --detached [2025-08-25 15:27:20,877][ INFO][PID:2259881] Downloading the builder-live.log file, attempt 1 [2025-08-25 15:27:20,879][ INFO][PID:2259881] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.206.6 copr-rpmbuild-log [2025-08-25 15:27:25,889][ INFO][PID:2259881] Periodic builder liveness probe: alive [2025-08-25 15:27:25,889][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:30,891][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:35,892][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:40,895][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:45,896][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:50,898][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:27:55,900][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:00,902][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:05,906][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:10,907][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:15,909][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:20,911][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:25,913][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:30,914][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:35,915][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:40,917][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:45,918][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:50,919][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:28:55,921][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:00,923][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:05,924][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:10,925][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:15,927][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:20,928][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:25,930][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:30,931][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:35,932][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:40,934][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:45,935][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:50,936][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:29:55,938][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:00,940][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:05,946][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:10,947][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:15,949][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:20,951][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:25,952][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:30,953][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:35,954][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:40,956][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:45,957][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:50,960][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:30:55,967][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:00,970][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:05,971][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:10,972][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:15,974][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:20,975][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:25,976][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:30,980][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:35,986][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:40,988][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:45,993][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:50,994][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:31:55,995][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:00,997][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:06,000][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:11,008][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:16,009][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:21,011][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:26,013][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:31,014][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:36,015][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:41,016][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:46,018][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:51,019][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:32:56,020][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:01,021][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:06,022][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:11,024][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:16,025][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:21,026][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:26,028][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:31,029][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:36,030][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:41,031][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:46,033][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:51,034][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:33:56,035][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:01,036][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:06,037][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:11,039][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:15,693][ ERROR][PID:2259881] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 15:34:16,040][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:21,041][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:25,694][WARNING][PID:2259881] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-25 15:34:26,042][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:31,045][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:35,695][ INFO][PID:2259881] Downloading the builder-live.log file, attempt 2 [2025-08-25 15:34:35,698][ INFO][PID:2259881] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.206.6 copr-rpmbuild-log [2025-08-25 15:34:36,046][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:41,047][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:46,049][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:51,050][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:34:56,051][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:01,053][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:06,054][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:11,055][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:16,056][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:21,057][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:26,058][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:31,060][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:35,767][ ERROR][PID:2259881] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 15:35:36,062][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:41,063][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:45,770][WARNING][PID:2259881] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-25 15:35:46,065][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:51,066][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:35:55,771][ INFO][PID:2259881] Downloading the builder-live.log file, attempt 3 [2025-08-25 15:35:55,773][ INFO][PID:2259881] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.206.6 copr-rpmbuild-log [2025-08-25 15:35:56,068][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:01,069][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:06,070][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:11,073][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:16,074][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:21,076][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:26,078][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:31,080][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:36,081][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:41,082][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:46,084][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:51,085][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:36:55,842][ ERROR][PID:2259881] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 15:36:56,086][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:01,089][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:05,843][WARNING][PID:2259881] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-25 15:37:06,092][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:11,094][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:15,845][ INFO][PID:2259881] Downloading the builder-live.log file, attempt 4 [2025-08-25 15:37:15,846][ INFO][PID:2259881] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.206.6 copr-rpmbuild-log [2025-08-25 15:37:16,095][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:21,096][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:26,108][ INFO][PID:2259881] Periodic builder liveness probe: alive [2025-08-25 15:37:26,109][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:31,110][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:36,111][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:41,112][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:46,117][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:51,118][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:37:56,120][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:01,121][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:06,122][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:11,123][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:15,915][ ERROR][PID:2259881] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-25 15:38:16,124][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:21,125][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:25,918][ ERROR][PID:2259881] Giving up for unstable SSH, failures: 1756136065.6945066, 1756136145.7706468, 1756136225.8437073, 1756136305.9185598 [2025-08-25 15:38:25,920][ ERROR][PID:2259881] Re-try request for task on 'ResallocHost, ticket_id=4709941, hostname=3.80.206.6, name=aws_x86_64_spot_prod_06414056_20250825_150208, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-08-25 15:38:25,920][ INFO][PID:2259881] Releasing VM back to pool [2025-08-25 15:38:25,934][ INFO][PID:2259881] Retry #1 (on other host) [2025-08-25 15:38:25,935][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:25,936][ INFO][PID:2259881] VM allocation process starts [2025-08-25 15:38:25,953][ INFO][PID:2259881] Trying to allocate VM: ResallocHost, ticket_id=4710218, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-25 15:38:29,082][ INFO][PID:2259881] Allocated host ResallocHost, ticket_id=4710218, hostname=13.217.23.249, name=aws_x86_64_spot_prod_06414565_20250825_152331, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-25 15:38:29,082][ INFO][PID:2259881] Allocating ssh connection to builder [2025-08-25 15:38:29,083][ INFO][PID:2259881] Checking that builder machine is OK [2025-08-25 15:38:29,442][ INFO][PID:2259881] Running remote command: copr-builder-ready fedora-42-x86_64 [2025-08-25 15:38:29,644][ INFO][PID:2259881] Red Hat subscription not needed for fedora-42-x86_64 Builder is ready to be used [2025-08-25 15:38:29,645][ INFO][PID:2259881] Filling build.info file with builder info [2025-08-25 15:38:29,647][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:29,648][ INFO][PID:2259881] Not re-notifying FE and msg buses for the new host. [2025-08-25 15:38:29,649][ INFO][PID:2259881] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9478301-fedora-42-x86_64 --chroot fedora-42-x86_64 --detached [2025-08-25 15:38:29,982][ INFO][PID:2259881] Downloading the builder-live.log file, attempt 1 [2025-08-25 15:38:29,984][ INFO][PID:2259881] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.217.23.249 copr-rpmbuild-log [2025-08-25 15:38:34,983][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:39,984][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:44,985][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:49,987][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:54,988][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:38:59,989][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:04,990][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:09,991][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:14,994][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:19,996][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:24,997][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:29,999][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:35,001][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:40,002][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:45,003][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:50,005][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:39:55,006][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:00,009][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:05,012][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:10,018][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:15,020][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:20,021][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:25,023][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:30,024][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:35,025][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:40,027][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:45,029][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:50,031][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:40:55,033][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:00,034][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:05,035][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:10,036][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:15,037][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:20,038][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:25,041][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:30,042][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:35,043][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:40,045][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:45,046][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:50,047][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:41:55,049][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:00,050][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:05,052][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:10,053][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:15,054][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:20,056][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:25,057][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:30,059][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:35,065][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:40,066][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:45,072][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:50,074][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:42:55,075][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:00,077][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:05,079][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:10,081][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:15,083][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:20,087][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:25,090][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:30,096][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:35,105][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:40,113][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:45,115][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:50,116][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:43:55,117][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:00,119][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:05,122][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:10,123][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:15,126][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:20,129][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:25,132][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:30,138][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:35,140][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:40,141][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:45,142][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:50,144][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:44:55,146][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:00,148][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:05,150][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:10,151][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:15,152][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:20,155][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:25,158][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:30,159][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:35,162][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:40,163][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:45,164][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:50,165][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:45:55,166][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:00,167][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:05,168][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:10,170][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:15,171][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:20,172][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:25,173][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:30,174][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:35,176][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:40,177][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:45,178][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:50,179][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:46:55,180][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:00,182][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:05,183][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:10,184][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:15,185][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:20,186][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:25,187][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:30,195][ INFO][PID:2259881] Periodic builder liveness probe: alive [2025-08-25 15:47:30,195][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:35,198][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:40,199][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:45,201][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:50,202][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:47:55,203][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:00,205][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:05,214][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:10,216][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:15,217][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:20,218][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:25,219][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:30,221][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:35,222][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:40,224][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:45,225][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:50,227][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:48:55,230][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:00,236][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:05,237][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:10,242][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:15,244][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:20,246][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:25,252][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:30,253][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:35,259][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:40,263][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:45,265][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:50,266][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:49:55,268][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:00,272][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:05,273][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:10,274][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:15,279][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:20,281][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:25,283][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:30,291][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:35,294][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:40,296][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:45,300][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:50,302][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:50:55,305][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:51:00,306][ INFO][PID:2259881] Checking for cancel request [2025-08-25 15:51:00,925][ INFO][PID:2259881] Downloading results from builder [2025-08-25 15:51:00,925][ INFO][PID:2259881] rsyncing of mockbuilder@13.217.23.249:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree started [2025-08-25 15:51:00,926][ INFO][PID:2259881] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.217.23.249:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/build-09478301.rsync.log [2025-08-25 15:51:02,325][ INFO][PID:2259881] rsyncing finished. [2025-08-25 15:51:02,326][ INFO][PID:2259881] Releasing VM back to pool [2025-08-25 15:51:02,341][ INFO][PID:2259881] Searching for 'success' file in resultdir [2025-08-25 15:51:02,342][ INFO][PID:2259881] Going to sign pkgs from source: 9478301-fedora-42-x86_64 in chroot: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64 [2025-08-25 15:51:02,344][ INFO][PID:2259881] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2025-08-25 15:51:02,527][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-2025.10.5.g2646a78b-1.fc42.src.rpm' (attempt #1) [2025-08-25 15:51:03,602][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-2025.10.5.g2646a78b-1.fc42.src.rpm [2025-08-25 15:51:03,603][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-debugsource-2025.10.5.g2646a78b-1.fc42.x86_64.rpm' (attempt #1) [2025-08-25 15:51:04,393][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-debugsource-2025.10.5.g2646a78b-1.fc42.x86_64.rpm [2025-08-25 15:51:04,394][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-debuginfo-2025.10.5.g2646a78b-1.fc42.x86_64.rpm' (attempt #1) [2025-08-25 15:51:05,848][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-debuginfo-2025.10.5.g2646a78b-1.fc42.x86_64.rpm [2025-08-25 15:51:05,851][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-devel-2025.10.5.g2646a78b-1.fc42.x86_64.rpm' (attempt #1) [2025-08-25 15:51:06,621][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-devel-2025.10.5.g2646a78b-1.fc42.x86_64.rpm [2025-08-25 15:51:06,623][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-libs-debuginfo-2025.10.5.g2646a78b-1.fc42.x86_64.rpm' (attempt #1) [2025-08-25 15:51:07,234][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-libs-debuginfo-2025.10.5.g2646a78b-1.fc42.x86_64.rpm [2025-08-25 15:51:07,235][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-2025.10.5.g2646a78b-1.fc42.x86_64.rpm' (attempt #1) [2025-08-25 15:51:08,108][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-2025.10.5.g2646a78b-1.fc42.x86_64.rpm [2025-08-25 15:51:08,109][ INFO][PID:2259881] Calling '/bin/sign -4 -h sha256 -u @CoreOS#continuous@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-libs-2025.10.5.g2646a78b-1.fc42.x86_64.rpm' (attempt #1) [2025-08-25 15:51:08,563][ INFO][PID:2259881] signed rpm: /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/rpm-ostree-libs-2025.10.5.g2646a78b-1.fc42.x86_64.rpm [2025-08-25 15:51:08,563][ INFO][PID:2259881] Sign done [2025-08-25 15:51:08,564][ INFO][PID:2259881] Incremental createrepo run, adding 09478301-rpm-ostree into https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-42-x86_64, (auto-create-repo=True) [2025-08-25 15:51:08,566][ INFO][PID:2259881] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64 --add 09478301-rpm-ostree --no-appstream-metadata' as PID 2460180 [2025-08-25 15:51:09,736][ INFO][PID:2259881] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64 --add 09478301-rpm-ostree --no-appstream-metadata) [2025-08-25 15:51:09,737][ INFO][PID:2259881] Getting build details [2025-08-25 15:51:09,741][ INFO][PID:2259881] Listing built binary packages in /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree [2025-08-25 15:51:09,742][ INFO][PID:2259881] Built packages: ['rpm-ostree-libs 2025.10.5.g2646a78b', 'rpm-ostree-debuginfo 2025.10.5.g2646a78b', 'rpm-ostree-libs-debuginfo 2025.10.5.g2646a78b', 'rpm-ostree-debugsource 2025.10.5.g2646a78b', 'rpm-ostree-devel 2025.10.5.g2646a78b', 'rpm-ostree 2025.10.5.g2646a78b'] [2025-08-25 15:51:09,744][ INFO][PID:2259881] build details: {'built_packages': 'rpm-ostree-libs 2025.10.5.g2646a78b\nrpm-ostree-debuginfo 2025.10.5.g2646a78b\nrpm-ostree-libs-debuginfo 2025.10.5.g2646a78b\nrpm-ostree-debugsource 2025.10.5.g2646a78b\nrpm-ostree-devel 2025.10.5.g2646a78b\nrpm-ostree 2025.10.5.g2646a78b'} [2025-08-25 15:51:09,745][ INFO][PID:2259881] Retrieving pubkey [2025-08-25 15:51:09,746][ INFO][PID:2259881] Calling '/bin/sign -u @CoreOS#continuous@copr.fedorahosted.org -p' (attempt #1) [2025-08-25 15:51:09,926][ INFO][PID:2259881] Added pubkey for user @CoreOS project continuous into: /var/lib/copr/public_html/results/@CoreOS/continuous/pubkey.gpg [2025-08-25 15:51:09,928][ INFO][PID:2259881] Finished build: id=9478301 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=fedora-42-x86_64 [2025-08-25 15:51:09,935][ INFO][PID:2259881] Worker succeeded build, took 760.2865908145905 [2025-08-25 15:51:09,938][ INFO][PID:2259881] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@CoreOS", "project_name": "continuous", "project_dirname": "continuous", "submitter": "https://api.github.com/users/cgwalters", "ended_on": 1756137069.9350722, "started_on": 1756136309.6484814, "submitted_on": null, "status": 1, "chroot": "fedora-42-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9478301-fedora-42-x86_64", "build_id": 9478301, "package_name": "rpm-ostree", "package_version": "2025.10.5.g2646a78b-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/rpm-ostree", "git_hash": "845b88c1da559b4c81233f920a14be2c7af4c608", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@CoreOS/continuous--https://api.github.com/users/cgwalters", "results": { "packages": [ { "name": "rpm-ostree-libs", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "x86_64" }, { "name": "rpm-ostree-debuginfo", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "x86_64" }, { "name": "rpm-ostree", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "src" }, { "name": "rpm-ostree-libs-debuginfo", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "x86_64" }, { "name": "rpm-ostree-debugsource", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "x86_64" }, { "name": "rpm-ostree-devel", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "x86_64" }, { "name": "rpm-ostree", "epoch": null, "version": "2025.10.5.g2646a78b", "release": "1.fc42", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-42-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-42-x86_64/", "id": "copr_rhcontainerbot_bootc", "name": "Additional repo copr_rhcontainerbot_bootc" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous", "result_dir": "09478301-rpm-ostree", "built_packages": "rpm-ostree-libs 2025.10.5.g2646a78b\nrpm-ostree-debuginfo 2025.10.5.g2646a78b\nrpm-ostree-libs-debuginfo 2025.10.5.g2646a78b\nrpm-ostree-debugsource 2025.10.5.g2646a78b\nrpm-ostree-devel 2025.10.5.g2646a78b\nrpm-ostree 2025.10.5.g2646a78b", "id": 9478301, "mockchain_macros": { "copr_username": "@CoreOS", "copr_projectname": "continuous", "vendor": "Fedora Project COPR (@CoreOS/continuous)" } } ] } [2025-08-25 15:51:10,047][ INFO][PID:2259881] Sending fedora-messaging bus message in build.end [2025-08-25 15:51:10,097][ INFO][PID:2259881] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/builder-live.log by gzip [2025-08-25 15:51:10,103][ INFO][PID:2259881] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/builder-live.log' as PID 2460502 [2025-08-25 15:51:10,171][ INFO][PID:2259881] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/builder-live.log) [2025-08-25 15:51:10,172][ INFO][PID:2259881] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/backend.log by gzip [2025-08-25 15:51:10,180][ INFO][PID:2259881] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-42-x86_64/09478301-rpm-ostree/backend.log' as PID 2460515