[2025-07-23 14:56:28,543][  INFO][PID:3628956] Marking build as starting
[2025-07-23 14:56:28,622][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:56:28,625][  INFO][PID:3628956] VM allocation process starts
[2025-07-23 14:56:28,663][  INFO][PID:3628956] Trying to allocate VM: ResallocHost, ticket_id=4067840, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 14:56:31,699][  INFO][PID:3628956] Allocated host ResallocHost, ticket_id=4067840, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05761472_20250723_143603, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 14:56:31,700][  INFO][PID:3628956] Allocating ssh connection to builder
[2025-07-23 14:56:31,701][  INFO][PID:3628956] Checking that builder machine is OK
[2025-07-23 14:56:33,069][  INFO][PID:3628956] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-23 14:56:34,090][  INFO][PID:3628956] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-23 14:56:34,091][  INFO][PID:3628956] Filling build.info file with builder info
[2025-07-23 14:56:34,092][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:56:34,095][  INFO][PID:3628956] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1753282594.0949206,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9312726-fedora-eln-ppc64le",
            "build_id": 9312726,
            "package_name": "bootc",
            "package_version": "202507231449.g6607f10ed6-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "94f71d9393e65f64c6cedbc0a0bf7c4779905eec",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09312726-bootc",
            "built_packages": "",
            "id": 9312726,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-07-23 14:56:34,162][  INFO][PID:3628956] Sending fedora-messaging bus message in build.start
[2025-07-23 14:56:35,153][  INFO][PID:3628956] Sending fedora-messaging bus message in chroot.start
[2025-07-23 14:56:35,203][  INFO][PID:3628956] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9312726-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-23 14:56:36,539][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 1
[2025-07-23 14:56:36,545][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-23 14:56:41,560][  INFO][PID:3628956] Periodic builder liveness probe: alive
[2025-07-23 14:56:41,567][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:56:46,568][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:56:51,574][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:56:56,576][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:01,577][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:06,579][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:11,581][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:16,586][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:21,587][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:26,588][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:31,589][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:36,599][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:41,601][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:46,603][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:51,605][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:57:56,606][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:01,608][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:06,609][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:11,610][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:16,614][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:21,616][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:26,618][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:31,619][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:36,620][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:41,621][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:46,624][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:51,625][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:58:56,627][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:01,628][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:06,632][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:11,637][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:16,638][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:21,639][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:26,640][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:31,642][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:36,643][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:41,644][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:46,645][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:51,646][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 14:59:56,649][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:01,650][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:06,652][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:11,655][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:12,139][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:00:16,656][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:21,658][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:22,140][WARNING][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:00:26,659][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:31,669][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:32,140][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 2
[2025-07-23 15:00:32,144][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-23 15:00:36,673][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:41,674][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:46,675][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:51,677][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:00:56,679][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:01,682][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:06,683][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:11,685][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:16,686][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:21,687][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:26,689][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:31,690][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:32,285][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:01:36,691][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:41,693][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:42,287][WARNING][PID:3628956] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:01:46,694][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:51,695][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:01:52,288][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 3
[2025-07-23 15:01:52,289][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-23 15:01:56,698][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:01,700][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:06,704][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:11,706][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:16,707][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:21,712][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:26,713][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:31,714][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:36,715][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:41,717][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:46,720][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:51,721][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:02:52,428][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:02:56,723][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:01,726][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:02,431][WARNING][PID:3628956] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:03:06,727][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:11,729][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:12,435][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 4
[2025-07-23 15:03:12,442][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-23 15:03:16,730][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:21,731][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:26,733][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:31,739][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:36,741][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:41,743][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:46,744][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:51,745][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:03:56,747][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:01,749][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:06,750][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:11,752][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:12,583][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:04:16,754][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:21,756][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:22,588][ ERROR][PID:3628956] Giving up for unstable SSH, failures: 1753282822.1402032, 1753282902.287288, 1753282982.4316204, 1753283062.5879264
[2025-07-23 15:04:22,589][ ERROR][PID:3628956] Re-try request for task on 'ResallocHost, ticket_id=4067840, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05761472_20250723_143603, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-23 15:04:22,589][  INFO][PID:3628956] Releasing VM back to pool
[2025-07-23 15:04:22,599][  INFO][PID:3628956] Retry #1 (on other host)
[2025-07-23 15:04:22,600][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:22,601][  INFO][PID:3628956] VM allocation process starts
[2025-07-23 15:04:22,615][  INFO][PID:3628956] Trying to allocate VM: ResallocHost, ticket_id=4068104, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 15:04:25,630][  INFO][PID:3628956] Allocated host ResallocHost, ticket_id=4068104, hostname=140.211.168.104, name=copr_osuosl_p09_prod_05761762_20250723_145447, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 15:04:25,631][  INFO][PID:3628956] Allocating ssh connection to builder
[2025-07-23 15:04:25,631][  INFO][PID:3628956] Checking that builder machine is OK
[2025-07-23 15:04:27,145][  INFO][PID:3628956] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-23 15:04:28,163][  INFO][PID:3628956] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-23 15:04:28,164][  INFO][PID:3628956] Filling build.info file with builder info
[2025-07-23 15:04:28,168][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:28,169][  INFO][PID:3628956] Not re-notifying FE and msg buses for the new host.
[2025-07-23 15:04:28,169][  INFO][PID:3628956] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9312726-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-23 15:04:29,415][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 1
[2025-07-23 15:04:29,416][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-07-23 15:04:34,421][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:39,426][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:44,427][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:49,428][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:54,430][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:04:59,432][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:04,433][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:09,434][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:14,435][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:19,437][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:24,446][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:29,453][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:34,456][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:39,459][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:44,461][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:49,485][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:54,494][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:05:59,499][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:04,506][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:09,508][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:14,510][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:19,512][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:24,513][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:29,514][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:34,515][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:39,519][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:44,541][  INFO][PID:3628956] Periodic builder liveness probe: alive
[2025-07-23 15:06:44,544][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:49,555][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:54,557][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:06:59,561][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:04,569][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:09,584][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:14,588][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:19,591][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:24,595][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:29,597][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:34,600][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:39,601][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:44,603][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:49,607][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:54,610][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:07:59,616][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:04,618][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:09,622][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:14,627][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:19,629][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:24,632][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:29,638][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:34,647][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:39,660][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:44,666][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:49,672][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:54,673][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:08:59,675][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:04,678][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:09,690][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:14,702][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:19,710][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:24,712][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:29,718][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:34,721][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:39,727][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:44,740][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:09:49,742][  INFO][PID:3628956] Checking for cancel request
[2025-07-23 15:10:50,011][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.104 port 22 timed out

[2025-07-23 15:12:00,260][ ERROR][PID:3628956] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.104 port 22 timed out

[2025-07-23 15:13:10,459][ ERROR][PID:3628956] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.104 port 22 timed out

[2025-07-23 15:14:20,658][ ERROR][PID:3628956] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.104 port 22 timed out

[2025-07-23 15:14:30,665][ ERROR][PID:3628956] Can't ssh to cancel build.
[2025-07-23 15:30:09,148][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:30:19,170][WARNING][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:30:29,174][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 2
[2025-07-23 15:30:29,176][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-07-23 15:31:29,288][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:31:39,291][WARNING][PID:3628956] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:31:49,293][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 3
[2025-07-23 15:31:49,302][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-07-23 15:32:49,375][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:32:59,380][WARNING][PID:3628956] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:33:09,381][  INFO][PID:3628956] Downloading the builder-live.log file, attempt 4
[2025-07-23 15:33:09,386][  INFO][PID:3628956] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-07-23 15:34:09,456][ ERROR][PID:3628956] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:34:19,463][ ERROR][PID:3628956] Giving up for unstable SSH, failures: 1753284619.1709094, 1753284699.2912045, 1753284779.3806505, 1753284859.463301
[2025-07-23 15:34:19,464][ ERROR][PID:3628956] Build was canceled
[2025-07-23 15:34:19,468][  INFO][PID:3628956] Releasing VM back to pool
[2025-07-23 15:34:19,508][WARNING][PID:3628956] Switching not-finished job state to 'failed'
[2025-07-23 15:34:19,509][  INFO][PID:3628956] Worker failed build, took 1791.3395111560822
[2025-07-23 15:34:19,510][  INFO][PID:3628956] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": 1753284859.50891,
            "started_on": 1753283068.1693988,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9312726-fedora-eln-ppc64le",
            "build_id": 9312726,
            "package_name": "bootc",
            "package_version": "202507231449.g6607f10ed6-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "94f71d9393e65f64c6cedbc0a0bf7c4779905eec",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch/",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09312726-bootc",
            "built_packages": "",
            "id": 9312726,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-07-23 15:34:19,578][  INFO][PID:3628956] Sending fedora-messaging bus message in build.end
[2025-07-23 15:34:19,649][  INFO][PID:3628956] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09312726-bootc/builder-live.log by gzip
[2025-07-23 15:34:19,654][  INFO][PID:3628956] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09312726-bootc/builder-live.log' as PID 4001575
[2025-07-23 15:34:19,664][  INFO][PID:3628956] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09312726-bootc/builder-live.log)
[2025-07-23 15:34:19,668][  INFO][PID:3628956] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09312726-bootc/backend.log by gzip
[2025-07-23 15:34:19,669][  INFO][PID:3628956] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-eln-ppc64le/09312726-bootc/backend.log' as PID 4001578