[2026-04-02 18:09:15,266][ INFO][PID:3116890] Marking build as starting [2026-04-02 18:09:15,334][ INFO][PID:3116890] Checking that /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/repodata/repomd.xml exists [2026-04-02 18:09:15,730][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:15,731][ INFO][PID:3116890] VM allocation process starts [2026-04-02 18:09:15,742][ INFO][PID:3116890] Trying to allocate VM: ResallocHost, ticket_id=2153565, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:09:20,743][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:25,744][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:27,784][ INFO][PID:3116890] Allocated host ResallocHost, ticket_id=2153565, hostname=3.238.204.208, name=aws_x86_64_spot_prod_04487781_20260402_175816, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:09:27,784][ INFO][PID:3116890] Allocating ssh connection to builder [2026-04-02 18:09:27,785][ INFO][PID:3116890] Checking that builder machine is OK [2026-04-02 18:09:28,152][ INFO][PID:3116890] Running remote command: copr-builder-ready mageia-9-x86_64 [2026-04-02 18:09:28,372][ INFO][PID:3116890] Red Hat subscription not needed for mageia-9-x86_64 Builder is ready to be used [2026-04-02 18:09:28,372][ INFO][PID:3116890] Filling build.info file with builder info [2026-04-02 18:09:28,373][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:28,374][ INFO][PID:3116890] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "supervillain", "project_name": "i2pd", "project_dirname": "i2pd", "submitter": "https://api.github.com/users/orignal", "ended_on": null, "started_on": 1775153368.3739934, "submitted_on": null, "status": 3, "chroot": "mageia-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10287981-mageia-9-x86_64", "build_id": 10287981, "package_name": "i2pd-git", "package_version": "2.59.0-git", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/supervillain/i2pd/i2pd-git", "git_hash": "0287dc7f1e6657c8054a11fdf199d7a35cbb81be", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "supervillain/i2pd--https://api.github.com/users/orignal", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/supervillain/i2pd/mageia-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/supervillain/i2pd", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/supervillain/i2pd", "result_dir": "10287981-i2pd-git", "built_packages": "", "id": 10287981, "mockchain_macros": { "copr_username": "supervillain", "copr_projectname": "i2pd", "vendor": "Fedora Project COPR (supervillain/i2pd)" } } ] } [2026-04-02 18:09:28,462][ INFO][PID:3116890] Sending fedora-messaging bus message in build.start [2026-04-02 18:09:29,075][ INFO][PID:3116890] Sending fedora-messaging bus message in chroot.start [2026-04-02 18:09:29,104][ INFO][PID:3116890] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287981-mageia-9-x86_64 --chroot mageia-9-x86_64 --detached [2026-04-02 18:09:29,470][ INFO][PID:3116890] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.238.204.208' (ED25519) to the list of known hosts. [2026-04-02 18:09:29,470][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 1 [2026-04-02 18:09:29,472][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.204.208 copr-rpmbuild-log [2026-04-02 18:09:34,478][ INFO][PID:3116890] Periodic builder liveness probe: alive [2026-04-02 18:09:34,478][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:39,479][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:44,480][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:49,482][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:54,489][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:09:59,492][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:04,493][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:09,494][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:14,495][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:19,497][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:24,498][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:29,499][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:34,500][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:39,501][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:44,502][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:49,503][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:54,504][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:10:59,505][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:04,506][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:09,507][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:14,508][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:19,509][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:24,510][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:29,511][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:34,512][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:39,513][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:44,515][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:49,518][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:54,519][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:11:59,520][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:04,521][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:09,522][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:14,523][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:19,524][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:24,525][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:29,526][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:34,527][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:39,528][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:44,529][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:49,530][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:54,531][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:12:59,533][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:04,534][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:09,535][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:14,536][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:19,537][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:24,538][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:29,539][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:34,541][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:39,542][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:44,544][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:49,547][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:54,549][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:13:59,550][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:04,552][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:09,553][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:14,554][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:19,555][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:24,558][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:29,560][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:34,561][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:39,562][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:44,563][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:49,564][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:54,566][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:14:59,567][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:04,568][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:09,574][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:14,577][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:19,584][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:24,585][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:29,586][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:34,770][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:39,772][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:44,778][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:49,779][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:54,780][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:15:59,781][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:04,931][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:09,934][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:14,935][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:19,936][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:24,937][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:29,944][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:34,945][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:39,946][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:44,948][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:49,949][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:54,950][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:16:59,957][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:04,965][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:09,966][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:14,967][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:19,970][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:24,972][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:29,973][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:34,974][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:39,976][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:44,977][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:49,983][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:54,984][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:17:59,985][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:04,986][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:09,987][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:14,988][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:19,989][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:24,991][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:29,993][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:35,183][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:40,267][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:45,269][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:50,272][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:18:55,273][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:00,274][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:05,354][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:10,355][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:15,358][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:20,361][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:25,362][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:30,364][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:35,571][ INFO][PID:3116890] Periodic builder liveness probe: alive [2026-04-02 18:19:35,572][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:40,573][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:45,574][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:50,575][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:19:55,576][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:00,577][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:05,606][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:10,609][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:15,612][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:20,615][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:25,616][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:30,618][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:35,619][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:40,620][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:45,621][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:50,637][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:20:55,638][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:00,640][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:05,643][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:10,644][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:15,645][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:20,647][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:25,648][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:30,670][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:35,814][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:40,818][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:45,821][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:50,823][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:21:55,828][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:00,830][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:05,832][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:09,105][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:22:10,853][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:15,888][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:19,106][WARNING][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:22:20,891][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:25,904][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:29,107][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 2 [2026-04-02 18:22:29,108][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.204.208 copr-rpmbuild-log [2026-04-02 18:22:31,325][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:36,326][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:41,328][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:46,333][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:51,335][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:22:56,337][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:01,345][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:06,346][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:11,347][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:16,349][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:21,350][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:26,351][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:29,150][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:23:31,352][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:36,353][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:39,154][WARNING][PID:3116890] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:23:41,360][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:46,361][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:49,154][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 3 [2026-04-02 18:23:49,156][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.204.208 copr-rpmbuild-log [2026-04-02 18:23:51,362][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:23:56,363][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:01,364][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:06,365][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:11,366][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:16,368][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:21,369][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:26,370][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:31,371][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:36,372][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:41,373][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:46,374][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:49,223][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:24:51,375][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:56,376][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:24:59,226][WARNING][PID:3116890] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:25:01,377][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:06,377][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:09,227][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 4 [2026-04-02 18:25:09,228][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.204.208 copr-rpmbuild-log [2026-04-02 18:25:11,378][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:16,379][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:21,380][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:26,381][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:31,445][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:36,448][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:41,452][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:46,453][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:51,454][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:25:56,455][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:01,457][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:06,458][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:09,296][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:26:11,459][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:16,464][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:19,308][ ERROR][PID:3116890] Giving up for unstable SSH, failures: 1775154139.1064284, 1775154219.1542788, 1775154299.2266264, 1775154379.3087192 [2026-04-02 18:26:19,309][ ERROR][PID:3116890] Re-try request for task on 'ResallocHost, ticket_id=2153565, hostname=3.238.204.208, name=aws_x86_64_spot_prod_04487781_20260402_175816, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-02 18:26:19,310][ INFO][PID:3116890] Releasing VM back to pool [2026-04-02 18:26:19,321][ INFO][PID:3116890] Retry #1 (on other host) [2026-04-02 18:26:19,321][ INFO][PID:3116890] Checking that /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/repodata/repomd.xml exists [2026-04-02 18:26:19,322][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:19,322][ INFO][PID:3116890] VM allocation process starts [2026-04-02 18:26:19,337][ INFO][PID:3116890] Trying to allocate VM: ResallocHost, ticket_id=2153732, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:26:24,338][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:29,339][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:34,340][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:39,341][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:44,342][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:49,343][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:54,344][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:26:59,345][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:04,346][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:09,347][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:14,348][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:19,349][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:24,350][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:29,351][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:34,352][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:39,353][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:44,354][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:49,355][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:54,356][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:27:59,357][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:04,358][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:09,359][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:14,360][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:19,361][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:24,362][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:29,367][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:34,368][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:37,473][ INFO][PID:3116890] Allocated host ResallocHost, ticket_id=2153732, hostname=54.90.188.55, name=aws_x86_64_spot_prod_04488532_20260402_182301, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:28:37,473][ INFO][PID:3116890] Allocating ssh connection to builder [2026-04-02 18:28:37,473][ INFO][PID:3116890] Checking that builder machine is OK [2026-04-02 18:28:37,815][ INFO][PID:3116890] Running remote command: copr-builder-ready mageia-9-x86_64 [2026-04-02 18:28:38,029][ INFO][PID:3116890] Red Hat subscription not needed for mageia-9-x86_64 Builder is ready to be used [2026-04-02 18:28:38,029][ INFO][PID:3116890] Filling build.info file with builder info [2026-04-02 18:28:38,032][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:38,033][ INFO][PID:3116890] Not re-notifying FE and msg buses for the new host. [2026-04-02 18:28:38,033][ INFO][PID:3116890] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287981-mageia-9-x86_64 --chroot mageia-9-x86_64 --detached [2026-04-02 18:28:38,364][ INFO][PID:3116890] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.90.188.55' (ED25519) to the list of known hosts. [2026-04-02 18:28:38,365][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 1 [2026-04-02 18:28:38,366][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.188.55 copr-rpmbuild-log [2026-04-02 18:28:43,365][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:48,366][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:53,367][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:28:58,368][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:03,369][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:08,370][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:13,371][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:18,372][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:23,373][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:28,374][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:33,375][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:38,387][ INFO][PID:3116890] Periodic builder liveness probe: alive [2026-04-02 18:29:38,387][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:43,388][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:48,389][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:53,390][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:29:58,392][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:03,393][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:08,394][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:10,891][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:30:13,396][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:18,397][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:20,892][WARNING][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:30:23,403][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:28,404][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:30,893][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 2 [2026-04-02 18:30:30,894][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.188.55 copr-rpmbuild-log [2026-04-02 18:30:33,405][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:38,406][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:43,407][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:48,408][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:53,409][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:30:58,410][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:03,412][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:08,416][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:13,417][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:18,418][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:23,419][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:28,420][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:30,961][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:31:33,421][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:38,422][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:40,967][WARNING][PID:3116890] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:31:43,423][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:48,424][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:50,967][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 3 [2026-04-02 18:31:50,969][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.188.55 copr-rpmbuild-log [2026-04-02 18:31:53,425][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:31:58,426][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:03,429][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:08,430][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:13,431][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:18,432][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:23,433][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:28,434][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:33,435][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:38,436][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:43,437][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:48,438][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:51,036][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:32:53,439][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:32:58,441][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:01,062][WARNING][PID:3116890] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:33:03,442][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:08,443][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:11,063][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 4 [2026-04-02 18:33:11,065][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.188.55 copr-rpmbuild-log [2026-04-02 18:33:13,444][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:18,445][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:23,445][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:28,446][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:33,447][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:38,448][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:43,449][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:48,450][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:53,451][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:33:58,452][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:03,453][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:08,454][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:11,132][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:34:13,455][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:18,456][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:21,133][ ERROR][PID:3116890] Giving up for unstable SSH, failures: 1775154620.892499, 1775154700.9670472, 1775154781.0629034, 1775154861.1330585 [2026-04-02 18:34:21,134][ ERROR][PID:3116890] Re-try request for task on 'ResallocHost, ticket_id=2153732, hostname=54.90.188.55, name=aws_x86_64_spot_prod_04488532_20260402_182301, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-02 18:34:21,134][ INFO][PID:3116890] Releasing VM back to pool [2026-04-02 18:34:21,144][ INFO][PID:3116890] Retry #2 (on other host) [2026-04-02 18:34:21,144][ INFO][PID:3116890] Checking that /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/repodata/repomd.xml exists [2026-04-02 18:34:21,145][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:21,145][ INFO][PID:3116890] VM allocation process starts [2026-04-02 18:34:21,157][ INFO][PID:3116890] Trying to allocate VM: ResallocHost, ticket_id=2153767, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:34:26,158][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:31,159][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:36,160][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:41,161][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:46,162][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:51,163][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:34:56,164][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:01,165][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:06,166][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:11,169][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:16,170][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:21,170][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:26,172][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:31,172][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:36,173][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:41,179][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:46,182][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:51,183][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:35:56,184][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:01,186][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:06,187][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:11,188][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:16,189][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:21,190][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:26,191][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:31,192][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:36,193][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:41,194][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:46,195][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:51,200][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:36:56,200][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:01,201][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:06,202][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:11,203][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:16,204][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:21,205][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:26,206][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:31,207][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:36,208][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:41,215][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:46,216][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:51,217][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:37:56,218][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:01,219][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:06,220][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:11,221][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:16,222][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:21,223][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:26,225][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:31,226][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:36,227][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:41,228][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:46,229][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:51,230][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:38:56,230][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:01,231][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:06,232][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:11,233][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:16,234][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:21,235][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:26,236][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:31,237][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:36,238][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:41,239][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:46,240][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:51,241][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:39:56,242][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:01,243][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:06,244][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:11,250][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:16,251][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:21,252][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:26,253][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:31,254][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:36,255][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:41,256][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:46,265][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:51,266][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:40:56,267][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:01,268][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:06,274][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:11,282][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:16,289][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:21,305][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:26,307][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:31,309][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:36,311][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:39,268][ INFO][PID:3116890] Allocated host ResallocHost, ticket_id=2153767, hostname=100.27.246.53, name=aws_x86_64_spot_prod_04489189_20260402_183930, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 18:41:39,269][ INFO][PID:3116890] Allocating ssh connection to builder [2026-04-02 18:41:39,269][ INFO][PID:3116890] Checking that builder machine is OK [2026-04-02 18:41:39,603][ INFO][PID:3116890] Running remote command: copr-builder-ready mageia-9-x86_64 [2026-04-02 18:41:39,811][ INFO][PID:3116890] Red Hat subscription not needed for mageia-9-x86_64 Builder is ready to be used [2026-04-02 18:41:39,811][ INFO][PID:3116890] Filling build.info file with builder info [2026-04-02 18:41:39,824][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:39,826][ INFO][PID:3116890] Not re-notifying FE and msg buses for the new host. [2026-04-02 18:41:39,827][ INFO][PID:3116890] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287981-mageia-9-x86_64 --chroot mageia-9-x86_64 --detached [2026-04-02 18:41:40,166][ INFO][PID:3116890] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.27.246.53' (ED25519) to the list of known hosts. [2026-04-02 18:41:40,167][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 1 [2026-04-02 18:41:40,168][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.246.53 copr-rpmbuild-log [2026-04-02 18:41:45,178][ INFO][PID:3116890] Periodic builder liveness probe: alive [2026-04-02 18:41:45,180][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:50,181][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:41:55,182][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:00,183][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:05,184][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:10,185][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:15,186][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:20,187][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:25,188][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:30,189][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:35,190][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:40,191][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:45,192][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:50,193][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:42:55,194][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:00,195][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:05,196][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:10,197][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:15,198][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:20,199][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:25,200][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:30,200][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:35,201][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:40,202][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:45,203][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:50,205][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:43:55,206][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:00,207][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:05,208][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:10,209][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:15,210][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:20,211][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:25,220][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:30,221][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:35,222][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:40,223][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:45,224][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:50,225][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:44:55,226][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:00,227][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:05,228][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:10,228][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:15,229][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:20,230][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:25,231][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:30,232][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:35,233][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:40,234][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:45,235][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:50,237][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:45:55,238][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:00,239][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:02,158][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:46:05,240][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:10,243][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:12,163][WARNING][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:46:15,248][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:20,250][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:22,164][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 2 [2026-04-02 18:46:22,167][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.246.53 copr-rpmbuild-log [2026-04-02 18:46:25,251][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:30,252][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:35,253][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:40,254][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:45,255][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:50,256][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:46:55,257][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:00,259][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:05,260][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:10,268][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:15,269][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:20,270][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:22,235][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:47:25,272][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:30,273][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:32,239][WARNING][PID:3116890] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:47:35,274][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:40,275][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:42,240][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 3 [2026-04-02 18:47:42,322][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.246.53 copr-rpmbuild-log [2026-04-02 18:47:45,276][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:50,277][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:47:55,279][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:00,280][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:05,281][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:10,282][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:15,283][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:20,284][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:25,285][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:30,287][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:35,288][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:40,289][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:42,390][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:48:45,290][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:50,291][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:48:52,395][WARNING][PID:3116890] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 18:48:55,300][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:00,301][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:02,396][ INFO][PID:3116890] Downloading the builder-live.log file, attempt 4 [2026-04-02 18:49:02,397][ INFO][PID:3116890] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.27.246.53 copr-rpmbuild-log [2026-04-02 18:49:05,302][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:10,303][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:15,304][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:20,305][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:25,306][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:30,307][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:35,308][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:40,309][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:45,315][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:50,316][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:49:55,317][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:50:00,318][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:50:02,464][ ERROR][PID:3116890] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 18:50:05,319][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:50:10,320][ INFO][PID:3116890] Checking for cancel request [2026-04-02 18:50:12,468][ ERROR][PID:3116890] Giving up for unstable SSH, failures: 1775155572.1637328, 1775155652.2390723, 1775155732.3957868, 1775155812.4684484 [2026-04-02 18:50:12,469][ ERROR][PID:3116890] Re-try request for task on 'ResallocHost, ticket_id=2153767, hostname=100.27.246.53, name=aws_x86_64_spot_prod_04489189_20260402_183930, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-02 18:50:12,469][ INFO][PID:3116890] Releasing VM back to pool [2026-04-02 18:50:12,480][ ERROR][PID:3116890] Backend process error: Three host tried without success: {'3.238.204.208', '54.90.188.55', '100.27.246.53'} [2026-04-02 18:50:12,480][WARNING][PID:3116890] Switching not-finished job state to 'failed' [2026-04-02 18:50:12,481][ INFO][PID:3116890] Worker failed build, took 512.6539690494537 [2026-04-02 18:50:12,481][ INFO][PID:3116890] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "supervillain", "project_name": "i2pd", "project_dirname": "i2pd", "submitter": "https://api.github.com/users/orignal", "ended_on": 1775155812.4807632, "started_on": 1775155299.8267941, "submitted_on": null, "status": 0, "chroot": "mageia-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10287981-mageia-9-x86_64", "build_id": 10287981, "package_name": "i2pd-git", "package_version": "2.59.0-git", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/supervillain/i2pd/i2pd-git", "git_hash": "0287dc7f1e6657c8054a11fdf199d7a35cbb81be", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "supervillain/i2pd--https://api.github.com/users/orignal", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/supervillain/i2pd/mageia-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/supervillain/i2pd", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/supervillain/i2pd", "result_dir": "10287981-i2pd-git", "built_packages": "", "id": 10287981, "mockchain_macros": { "copr_username": "supervillain", "copr_projectname": "i2pd", "vendor": "Fedora Project COPR (supervillain/i2pd)" } } ] } [2026-04-02 18:50:12,560][ INFO][PID:3116890] Sending fedora-messaging bus message in build.end [2026-04-02 18:50:12,589][ INFO][PID:3116890] Compressing /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/10287981-i2pd-git/builder-live.log by gzip [2026-04-02 18:50:12,591][ INFO][PID:3116890] Running command 'gzip /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/10287981-i2pd-git/builder-live.log' as PID 3292364 [2026-04-02 18:50:12,693][ INFO][PID:3116890] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/10287981-i2pd-git/builder-live.log) [2026-04-02 18:50:12,694][ INFO][PID:3116890] Compressing /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/10287981-i2pd-git/backend.log by gzip [2026-04-02 18:50:12,696][ INFO][PID:3116890] Running command 'gzip /var/lib/copr/public_html/results/supervillain/i2pd/mageia-9-x86_64/10287981-i2pd-git/backend.log' as PID 3292379