[2026-01-16 14:33:10,379][ INFO][PID:1977474] Marking build as starting [2026-01-16 14:33:10,446][ INFO][PID:1977474] Checking that /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/repodata/repomd.xml exists [2026-01-16 14:33:10,495][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:10,496][ INFO][PID:1977474] VM allocation process starts [2026-01-16 14:33:10,515][ INFO][PID:1977474] Trying to allocate VM: ResallocHost, ticket_id=858059, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-16 14:33:13,591][ INFO][PID:1977474] Allocated host ResallocHost, ticket_id=858059, hostname=13.222.111.178, name=aws_x86_64_normal_prod_01298649_20260116_141250, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-16 14:33:13,592][ INFO][PID:1977474] Allocating ssh connection to builder [2026-01-16 14:33:13,592][ INFO][PID:1977474] Checking that builder machine is OK [2026-01-16 14:33:13,956][ INFO][PID:1977474] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-01-16 14:33:14,175][ INFO][PID:1977474] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-01-16 14:33:14,176][ INFO][PID:1977474] Filling build.info file with builder info [2026-01-16 14:33:14,177][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:14,180][ INFO][PID:1977474] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "petersen", "project_name": "nix", "project_dirname": "nix", "submitter": "petersen", "ended_on": null, "started_on": 1768573994.18047, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10021455-fedora-43-x86_64", "build_id": 10021455, "package_name": "nix", "package_version": "2.31.2-37", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/petersen/nix/nix", "git_hash": "6631c6c104221be9dfc95e3ea62eacdd8ff79f48", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "petersen/nix--petersen", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/petersen/nix/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/petersen/nix", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/petersen/nix", "result_dir": "10021455-nix", "built_packages": "", "id": 10021455, "mockchain_macros": { "copr_username": "petersen", "copr_projectname": "nix", "vendor": "Fedora Project COPR (petersen/nix)" } } ] } [2026-01-16 14:33:14,234][ INFO][PID:1977474] Sending fedora-messaging bus message in build.start [2026-01-16 14:33:14,967][ INFO][PID:1977474] Sending fedora-messaging bus message in chroot.start [2026-01-16 14:33:15,003][ INFO][PID:1977474] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10021455-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-01-16 14:33:15,373][ INFO][PID:1977474] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.222.111.178' (ED25519) to the list of known hosts. [2026-01-16 14:33:15,374][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 1 [2026-01-16 14:33:15,379][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.111.178 copr-rpmbuild-log [2026-01-16 14:33:20,388][ INFO][PID:1977474] Periodic builder liveness probe: alive [2026-01-16 14:33:20,389][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:25,390][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:30,392][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:35,393][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:40,395][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:45,397][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:50,399][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:33:55,400][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:00,401][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:05,403][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:10,405][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:15,406][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:20,407][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:25,409][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:30,411][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:35,412][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:40,413][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:45,415][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:50,416][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:34:55,419][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:00,421][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:05,422][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:10,426][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:15,427][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:20,428][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:25,431][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:30,432][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:35,433][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:40,436][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:45,446][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:50,456][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:35:55,457][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:00,458][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:05,478][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:10,508][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:15,509][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:20,510][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:25,511][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:30,512][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:35,515][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:40,519][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:45,520][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:50,521][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:36:55,522][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:00,523][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:05,525][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:10,526][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:15,527][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:20,528][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:25,531][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:30,533][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:35,534][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:40,535][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:45,536][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:50,537][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:37:55,539][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:00,545][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:05,547][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:10,549][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:15,554][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:20,556][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:25,557][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:30,558][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:35,560][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:40,561][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:45,562][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:50,563][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:38:55,567][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:00,568][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:05,569][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:10,570][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:15,571][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:20,573][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:25,575][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:30,576][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:33,737][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:39:35,588][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:40,589][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:43,738][WARNING][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 14:39:45,590][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:50,592][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:39:53,739][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 2 [2026-01-16 14:39:53,771][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.111.178 copr-rpmbuild-log [2026-01-16 14:39:55,596][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:00,600][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:05,601][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:10,602][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:15,603][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:20,605][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:25,606][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:30,607][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:35,608][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:40,609][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:45,610][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:50,611][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:40:53,841][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:40:55,613][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:00,614][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:03,859][WARNING][PID:1977474] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 14:41:05,615][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:10,616][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:13,860][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 3 [2026-01-16 14:41:13,861][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.111.178 copr-rpmbuild-log [2026-01-16 14:41:15,617][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:20,618][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:25,620][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:30,621][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:35,622][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:40,624][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:45,626][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:50,633][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:41:55,634][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:00,635][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:05,636][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:10,637][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:13,929][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:42:15,638][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:20,639][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:23,930][WARNING][PID:1977474] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 14:42:25,643][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:30,644][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:33,952][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 4 [2026-01-16 14:42:33,954][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.111.178 copr-rpmbuild-log [2026-01-16 14:42:35,646][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:40,647][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:45,648][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:50,649][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:42:55,650][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:00,651][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:05,652][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:10,654][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:15,655][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:20,664][ INFO][PID:1977474] Periodic builder liveness probe: alive [2026-01-16 14:43:20,665][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:25,666][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:30,685][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:34,022][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:43:35,689][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:40,696][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:44,048][ ERROR][PID:1977474] Giving up for unstable SSH, failures: 1768574383.7384484, 1768574463.8599076, 1768574543.9306533, 1768574624.048689 [2026-01-16 14:43:44,049][ ERROR][PID:1977474] Re-try request for task on 'ResallocHost, ticket_id=858059, hostname=13.222.111.178, name=aws_x86_64_normal_prod_01298649_20260116_141250, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-16 14:43:44,050][ INFO][PID:1977474] Releasing VM back to pool [2026-01-16 14:43:44,061][ INFO][PID:1977474] Retry #1 (on other host) [2026-01-16 14:43:44,061][ INFO][PID:1977474] Checking that /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/repodata/repomd.xml exists [2026-01-16 14:43:44,116][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:44,117][ INFO][PID:1977474] VM allocation process starts [2026-01-16 14:43:44,129][ INFO][PID:1977474] Trying to allocate VM: ResallocHost, ticket_id=858210, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-16 14:43:47,148][ INFO][PID:1977474] Allocated host ResallocHost, ticket_id=858210, hostname=98.84.121.131, name=aws_x86_64_spot_prod_01301479_20260116_144139, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-16 14:43:47,148][ INFO][PID:1977474] Allocating ssh connection to builder [2026-01-16 14:43:47,149][ INFO][PID:1977474] Checking that builder machine is OK [2026-01-16 14:43:47,490][ INFO][PID:1977474] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-01-16 14:43:47,685][ INFO][PID:1977474] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-01-16 14:43:47,685][ INFO][PID:1977474] Filling build.info file with builder info [2026-01-16 14:43:47,722][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:47,723][ INFO][PID:1977474] Not re-notifying FE and msg buses for the new host. [2026-01-16 14:43:47,724][ INFO][PID:1977474] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10021455-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-01-16 14:43:48,039][ INFO][PID:1977474] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.84.121.131' (ED25519) to the list of known hosts. [2026-01-16 14:43:48,040][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 1 [2026-01-16 14:43:48,041][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.121.131 copr-rpmbuild-log [2026-01-16 14:43:53,040][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:43:58,041][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:03,042][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:08,043][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:13,048][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:18,056][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:23,057][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:28,060][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:33,061][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:38,063][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:43,065][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:48,067][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:53,068][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:44:58,069][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:03,070][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:08,072][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:13,105][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:18,108][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:23,109][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:28,111][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:33,115][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:38,119][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:43,121][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:48,124][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:53,126][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:45:58,131][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:03,133][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:08,136][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:13,164][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:18,309][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:23,311][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:28,313][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:33,314][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:38,318][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:43,321][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:48,328][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:53,380][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:46:58,382][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:03,389][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:08,395][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:13,396][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:18,398][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:23,399][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:28,402][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:33,404][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:38,405][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:43,406][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:48,408][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:53,410][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:47:58,413][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:03,414][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:08,415][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:13,416][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:18,417][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:23,418][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:28,420][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:33,421][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:38,422][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:43,426][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:48,427][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:53,432][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:48:58,434][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:03,439][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:08,441][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:13,445][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:18,448][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:23,450][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:28,453][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:33,454][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:38,455][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:43,456][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:48,460][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:53,461][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:49:58,463][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:03,470][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:08,472][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:13,479][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:18,487][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:21,481][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:50:23,488][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:28,498][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:31,497][WARNING][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 14:50:33,500][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:38,504][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:41,503][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 2 [2026-01-16 14:50:41,506][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.121.131 copr-rpmbuild-log [2026-01-16 14:50:43,507][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:48,508][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:53,512][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:50:58,514][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:03,517][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:08,519][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:13,522][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:18,525][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:23,526][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:28,528][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:33,530][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:38,534][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:41,587][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:51:43,538][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:48,542][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:51,598][WARNING][PID:1977474] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 14:51:53,550][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:51:58,552][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:01,599][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 3 [2026-01-16 14:52:01,601][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.121.131 copr-rpmbuild-log [2026-01-16 14:52:03,565][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:08,569][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:13,571][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:18,584][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:23,585][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:28,587][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:33,589][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:38,590][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:43,592][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:48,594][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:53,595][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:52:58,596][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:01,673][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:53:03,597][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:08,598][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:11,686][WARNING][PID:1977474] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-16 14:53:13,599][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:18,601][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:21,687][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 4 [2026-01-16 14:53:21,689][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.121.131 copr-rpmbuild-log [2026-01-16 14:53:23,613][ INFO][PID:1977474] Periodic builder liveness probe: alive [2026-01-16 14:53:23,613][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:28,615][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:33,616][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:38,617][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:43,618][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:48,619][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:53,620][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:53:58,621][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:03,622][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:08,624][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:13,625][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:18,627][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:21,748][ ERROR][PID:1977474] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-16 14:54:23,628][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:28,629][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:31,760][ ERROR][PID:1977474] Giving up for unstable SSH, failures: 1768575031.4977946, 1768575111.5987308, 1768575191.6867592, 1768575271.7600422 [2026-01-16 14:54:31,761][ ERROR][PID:1977474] Re-try request for task on 'ResallocHost, ticket_id=858210, hostname=98.84.121.131, name=aws_x86_64_spot_prod_01301479_20260116_144139, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-16 14:54:31,762][ INFO][PID:1977474] Releasing VM back to pool [2026-01-16 14:54:31,771][ INFO][PID:1977474] Retry #2 (on other host) [2026-01-16 14:54:31,772][ INFO][PID:1977474] Checking that /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/repodata/repomd.xml exists [2026-01-16 14:54:31,773][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:31,773][ INFO][PID:1977474] VM allocation process starts [2026-01-16 14:54:31,784][ INFO][PID:1977474] Trying to allocate VM: ResallocHost, ticket_id=858391, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-16 14:54:34,801][ INFO][PID:1977474] Allocated host ResallocHost, ticket_id=858391, hostname=98.84.12.156, name=aws_x86_64_normalreserved_prod_01302278_20260116_145120, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-16 14:54:34,802][ INFO][PID:1977474] Allocating ssh connection to builder [2026-01-16 14:54:34,803][ INFO][PID:1977474] Checking that builder machine is OK [2026-01-16 14:54:35,158][ INFO][PID:1977474] Running remote command: copr-builder-ready fedora-43-x86_64 [2026-01-16 14:54:35,362][ INFO][PID:1977474] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2026-01-16 14:54:35,363][ INFO][PID:1977474] Filling build.info file with builder info [2026-01-16 14:54:35,395][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:35,396][ INFO][PID:1977474] Not re-notifying FE and msg buses for the new host. [2026-01-16 14:54:35,396][ INFO][PID:1977474] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10021455-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2026-01-16 14:54:35,728][ INFO][PID:1977474] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '98.84.12.156' (ED25519) to the list of known hosts. [2026-01-16 14:54:35,729][ INFO][PID:1977474] Downloading the builder-live.log file, attempt 1 [2026-01-16 14:54:35,730][ INFO][PID:1977474] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.84.12.156 copr-rpmbuild-log [2026-01-16 14:54:40,729][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:45,731][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:50,732][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:54:55,734][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:00,736][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:05,738][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:10,742][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:15,744][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:20,746][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:25,747][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:30,749][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:35,751][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:40,752][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:45,753][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:50,754][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:55:55,755][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:00,757][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:05,758][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:10,759][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:15,760][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:20,761][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:25,762][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:30,763][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:35,765][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:40,767][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:45,768][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:50,770][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:56:55,771][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:00,773][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:05,775][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:10,776][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:15,777][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:20,778][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:25,779][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:30,780][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:35,781][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:40,782][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:45,783][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:50,784][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:57:55,785][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:00,786][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:05,787][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:10,788][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:15,789][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:20,790][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:25,791][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:30,794][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:35,795][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:40,797][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:45,798][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:50,799][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:58:55,800][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:00,801][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:05,802][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:10,803][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:15,805][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:20,806][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:25,806][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:30,807][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:35,808][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:40,809][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:45,810][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:50,811][ INFO][PID:1977474] Checking for cancel request [2026-01-16 14:59:55,812][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:00,814][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:05,817][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:10,825][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:15,826][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:20,827][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:25,828][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:30,829][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:35,830][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:40,831][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:45,832][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:50,833][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:00:55,834][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:00,836][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:05,837][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:10,838][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:15,860][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:20,861][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:25,900][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:30,901][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:35,902][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:40,903][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:45,904][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:50,905][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:01:55,906][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:00,907][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:05,908][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:10,909][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:15,909][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:20,911][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:25,938][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:30,940][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:35,941][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:40,942][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:45,943][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:50,944][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:02:55,945][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:00,946][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:05,947][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:10,948][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:15,949][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:20,949][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:25,959][ INFO][PID:1977474] Periodic builder liveness probe: alive [2026-01-16 15:03:25,959][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:30,960][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:35,961][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:40,962][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:45,963][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:50,964][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:03:55,965][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:00,966][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:05,973][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:10,974][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:15,975][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:20,976][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:25,977][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:30,978][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:35,979][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:41,006][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:46,010][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:51,013][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:04:56,014][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:01,015][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:06,016][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:11,017][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:16,018][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:21,019][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:26,020][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:31,021][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:36,022][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:41,024][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:46,025][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:51,026][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:05:56,027][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:01,029][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:06,039][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:11,045][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:16,048][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:21,050][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:26,051][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:31,052][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:36,053][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:41,055][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:46,056][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:51,060][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:06:56,062][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:01,068][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:06,072][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:11,073][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:16,078][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:21,081][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:26,082][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:31,083][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:36,085][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:41,088][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:46,090][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:51,091][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:07:56,092][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:01,094][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:06,096][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:11,098][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:16,101][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:21,104][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:26,106][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:31,112][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:36,114][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:41,118][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:46,121][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:51,127][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:08:56,133][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:01,139][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:06,148][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:11,150][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:16,153][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:21,157][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:26,168][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:31,176][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:36,177][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:41,180][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:46,183][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:51,184][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:09:56,215][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:01,217][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:06,219][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:11,222][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:16,225][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:21,226][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:26,228][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:31,231][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:36,235][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:41,240][ INFO][PID:1977474] Checking for cancel request [2026-01-16 15:10:42,828][ INFO][PID:1977474] Downloading results from builder [2026-01-16 15:10:42,828][ INFO][PID:1977474] rsyncing of mockbuilder@98.84.12.156:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix started [2026-01-16 15:10:42,830][ INFO][PID:1977474] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.84.12.156:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/ &> /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/build-10021455.rsync.log [2026-01-16 15:10:43,952][ INFO][PID:1977474] rsyncing finished. [2026-01-16 15:10:43,954][ INFO][PID:1977474] Releasing VM back to pool [2026-01-16 15:10:43,969][ INFO][PID:1977474] Searching for 'success' file in resultdir [2026-01-16 15:10:43,970][ INFO][PID:1977474] Going to sign pkgs from source: 10021455-fedora-43-x86_64 in chroot: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64 [2026-01-16 15:10:43,971][ INFO][PID:1977474] Calling '/bin/sign -u petersen#nix@copr.fedorahosted.org -p' (attempt #1) [2026-01-16 15:10:44,246][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-doc-2.31.2-37.fc43.noarch.rpm' (attempt #1) [2026-01-16 15:10:44,954][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-doc-2.31.2-37.fc43.noarch.rpm [2026-01-16 15:10:44,955][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:45,653][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:45,657][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-legacy-2.31.2-37.fc43.noarch.rpm' (attempt #1) [2026-01-16 15:10:46,258][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-legacy-2.31.2-37.fc43.noarch.rpm [2026-01-16 15:10:46,259][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-daemon-2.31.2-37.fc43.noarch.rpm' (attempt #1) [2026-01-16 15:10:46,780][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-daemon-2.31.2-37.fc43.noarch.rpm [2026-01-16 15:10:46,780][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-libs-debuginfo-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:49,298][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-libs-debuginfo-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:49,299][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-2.31.2-37.fc43.src.rpm' (attempt #1) [2026-01-16 15:10:49,955][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-2.31.2-37.fc43.src.rpm [2026-01-16 15:10:49,956][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-core-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:50,632][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-core-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:50,635][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-filesystem-2.31.2-37.fc43.noarch.rpm' (attempt #1) [2026-01-16 15:10:51,348][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-filesystem-2.31.2-37.fc43.noarch.rpm [2026-01-16 15:10:51,351][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-libs-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:52,208][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-libs-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:52,209][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-system-2.31.2-37.fc43.noarch.rpm' (attempt #1) [2026-01-16 15:10:52,816][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-system-2.31.2-37.fc43.noarch.rpm [2026-01-16 15:10:52,818][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-core-debuginfo-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:53,813][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-core-debuginfo-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:53,814][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-devel-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:54,524][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-devel-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:54,525][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-debugsource-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:55,158][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-debugsource-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:55,161][ INFO][PID:1977474] Calling '/bin/sign -4 -h sha256 -u petersen#nix@copr.fedorahosted.org -r /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-debuginfo-2.31.2-37.fc43.x86_64.rpm' (attempt #1) [2026-01-16 15:10:55,810][ INFO][PID:1977474] signed rpm: /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/nix-debuginfo-2.31.2-37.fc43.x86_64.rpm [2026-01-16 15:10:55,811][ INFO][PID:1977474] Sign done [2026-01-16 15:10:55,812][ INFO][PID:1977474] Incremental createrepo run, adding 10021455-nix into https://download.copr.fedorainfracloud.org/results/petersen/nix/fedora-43-x86_64, (auto-create-repo=True) [2026-01-16 15:10:55,813][ INFO][PID:1977474] Running command 'copr-repo --batched /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64 --add 10021455-nix --no-appstream-metadata' as PID 2243659 [2026-01-16 15:10:56,861][ INFO][PID:1977474] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64 --add 10021455-nix --no-appstream-metadata) [2026-01-16 15:10:56,862][ INFO][PID:1977474] Getting build details [2026-01-16 15:10:56,863][ INFO][PID:1977474] Listing built binary packages in /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix [2026-01-16 15:10:56,864][ INFO][PID:1977474] Built packages: ['nix 2.31.2', 'nix-system 2.31.2', 'nix-daemon 2.31.2', 'nix-debugsource 2.31.2', 'nix-debuginfo 2.31.2', 'nix-doc 2.31.2', 'nix-devel 2.31.2', 'nix-legacy 2.31.2', 'nix-libs 2.31.2', 'nix-core 2.31.2', 'nix-filesystem 2.31.2', 'nix-libs-debuginfo 2.31.2', 'nix-core-debuginfo 2.31.2'] [2026-01-16 15:10:56,866][ INFO][PID:1977474] build details: {'built_packages': 'nix 2.31.2\nnix-system 2.31.2\nnix-daemon 2.31.2\nnix-debugsource 2.31.2\nnix-debuginfo 2.31.2\nnix-doc 2.31.2\nnix-devel 2.31.2\nnix-legacy 2.31.2\nnix-libs 2.31.2\nnix-core 2.31.2\nnix-filesystem 2.31.2\nnix-libs-debuginfo 2.31.2\nnix-core-debuginfo 2.31.2'} [2026-01-16 15:10:56,867][ INFO][PID:1977474] Retrieving pubkey [2026-01-16 15:10:56,868][ INFO][PID:1977474] Calling '/bin/sign -u petersen#nix@copr.fedorahosted.org -p' (attempt #1) [2026-01-16 15:10:57,148][ INFO][PID:1977474] Added pubkey for user petersen project nix into: /var/lib/copr/public_html/results/petersen/nix/pubkey.gpg [2026-01-16 15:10:57,149][ INFO][PID:1977474] Finished build: id=10021455 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/petersen/nix chroot=fedora-43-x86_64 [2026-01-16 15:10:57,151][ INFO][PID:1977474] Worker succeeded build, took 981.7554180622101 [2026-01-16 15:10:57,152][ INFO][PID:1977474] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "petersen", "project_name": "nix", "project_dirname": "nix", "submitter": "petersen", "ended_on": 1768576257.1516523, "started_on": 1768575275.3962343, "submitted_on": null, "status": 1, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10021455-fedora-43-x86_64", "build_id": 10021455, "package_name": "nix", "package_version": "2.31.2-37", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/petersen/nix/nix", "git_hash": "6631c6c104221be9dfc95e3ea62eacdd8ff79f48", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "petersen/nix--petersen", "results": { "packages": [ { "name": "nix", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "src" }, { "name": "nix", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-system", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "noarch" }, { "name": "nix-daemon", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "noarch" }, { "name": "nix-debugsource", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-debuginfo", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-doc", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "noarch" }, { "name": "nix-devel", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-legacy", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "noarch" }, { "name": "nix-libs", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-core", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-filesystem", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "noarch" }, { "name": "nix-libs-debuginfo", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" }, { "name": "nix-core-debuginfo", "epoch": null, "version": "2.31.2", "release": "37.fc43", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/petersen/nix/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/petersen/nix", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/petersen/nix", "result_dir": "10021455-nix", "built_packages": "nix 2.31.2\nnix-system 2.31.2\nnix-daemon 2.31.2\nnix-debugsource 2.31.2\nnix-debuginfo 2.31.2\nnix-doc 2.31.2\nnix-devel 2.31.2\nnix-legacy 2.31.2\nnix-libs 2.31.2\nnix-core 2.31.2\nnix-filesystem 2.31.2\nnix-libs-debuginfo 2.31.2\nnix-core-debuginfo 2.31.2", "id": 10021455, "mockchain_macros": { "copr_username": "petersen", "copr_projectname": "nix", "vendor": "Fedora Project COPR (petersen/nix)" } } ] } [2026-01-16 15:10:57,217][ INFO][PID:1977474] Sending fedora-messaging bus message in build.end [2026-01-16 15:10:57,256][ INFO][PID:1977474] Compressing /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/builder-live.log by gzip [2026-01-16 15:10:57,258][ INFO][PID:1977474] Running command 'gzip /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/builder-live.log' as PID 2243909 [2026-01-16 15:10:57,357][ INFO][PID:1977474] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/builder-live.log) [2026-01-16 15:10:57,358][ INFO][PID:1977474] Compressing /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/backend.log by gzip [2026-01-16 15:10:57,359][ INFO][PID:1977474] Running command 'gzip /var/lib/copr/public_html/results/petersen/nix/fedora-43-x86_64/10021455-nix/backend.log' as PID 2243922