[2026-04-02 19:14:32,964][  INFO][PID:3432594] Marking build as starting
[2026-04-02 19:14:33,048][  INFO][PID:3432594] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/repodata/repomd.xml exists
[2026-04-02 19:14:33,556][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:14:33,557][  INFO][PID:3432594] VM allocation process starts
[2026-04-02 19:14:33,567][  INFO][PID:3432594] Trying to allocate VM: ResallocHost, ticket_id=2154227, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-02 19:14:38,569][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:14:43,570][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:14:48,571][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:14:53,572][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:14:58,573][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:03,574][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:08,581][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:13,582][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:18,583][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:23,584][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:28,585][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:33,586][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:38,587][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:43,588][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:48,589][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:53,590][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:15:58,591][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:03,592][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:08,593][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:13,594][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:18,595][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:23,596][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:28,597][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:33,599][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:38,601][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:43,602][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:48,603][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:53,604][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:16:58,605][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:03,606][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:08,607][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:13,608][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:18,609][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:23,610][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:28,617][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:33,617][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:38,618][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:43,620][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:48,626][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:53,628][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:17:58,630][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:03,631][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:08,632][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:13,633][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:18,634][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:23,635][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:28,636][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:33,637][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:38,638][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:43,644][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:48,645][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:53,646][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:18:58,647][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:03,649][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:08,650][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:13,651][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:18,652][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:23,653][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:28,654][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:33,655][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:38,656][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:43,657][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:48,658][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:53,659][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:19:58,661][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:03,662][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:08,663][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:13,664][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:18,665][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:23,666][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:28,667][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:33,668][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:38,669][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:43,670][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:48,671][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:53,672][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:20:58,678][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:03,679][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:08,680][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:13,681][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:18,682][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:23,683][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:28,684][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:33,685][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:38,686][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:43,688][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:48,689][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:51,700][  INFO][PID:3432594] Allocated host ResallocHost, ticket_id=2154227, hostname=32.194.169.110, name=aws_x86_64_spot_prod_04490283_20260402_191950, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-02 19:21:51,701][  INFO][PID:3432594] Allocating ssh connection to builder
[2026-04-02 19:21:51,702][  INFO][PID:3432594] Checking that builder machine is OK
[2026-04-02 19:21:52,070][  INFO][PID:3432594] Running remote command: copr-builder-ready centos-stream-9-s390x
[2026-04-02 19:21:52,287][  INFO][PID:3432594] Red Hat subscription not needed for centos-stream-9-s390x
Builder is ready to be used

[2026-04-02 19:21:52,287][  INFO][PID:3432594] Filling build.info file with builder info
[2026-04-02 19:21:52,288][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:21:52,289][  INFO][PID:3432594] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "podman-next",
            "project_dirname": "podman-next",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1775157712.2889917,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10287996-centos-stream-9-s390x",
            "build_id": 10287996,
            "package_name": "podman",
            "package_version": "102:6.0.0~dev-1.20260402180422795791.main.2655.8c483b4da0",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/podman",
            "git_hash": "69056b0cfe4f3e73dccc7cce0584c9467644fa95",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/podman-next--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/",
                    "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch",
                    "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next",
            "result_dir": "10287996-podman",
            "built_packages": "",
            "id": 10287996,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "podman-next",
                "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)"
            }
        }
    ]
}
[2026-04-02 19:21:52,353][  INFO][PID:3432594] Sending fedora-messaging bus message in build.start
[2026-04-02 19:21:52,896][  INFO][PID:3432594] Sending fedora-messaging bus message in chroot.start
[2026-04-02 19:21:52,925][  INFO][PID:3432594] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287996-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached
[2026-04-02 19:21:53,297][  INFO][PID:3432594] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '32.194.169.110' (ED25519) to the list of known hosts.


[2026-04-02 19:21:53,298][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 1
[2026-04-02 19:21:53,299][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@32.194.169.110 copr-rpmbuild-log
[2026-04-02 19:21:58,308][  INFO][PID:3432594] Periodic builder liveness probe: alive
[2026-04-02 19:21:58,309][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:03,309][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:08,316][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:13,317][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:18,318][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:23,319][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:28,320][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:33,321][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:38,381][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:43,384][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:48,385][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:53,386][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:22:58,389][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:03,391][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:08,392][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:09,728][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:23:13,393][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:18,394][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:19,729][WARNING][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:23:23,396][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:28,397][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:29,730][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 2
[2026-04-02 19:23:29,732][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@32.194.169.110 copr-rpmbuild-log
[2026-04-02 19:23:33,399][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:38,400][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:43,401][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:48,402][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:53,404][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:23:58,405][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:03,406][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:08,407][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:13,408][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:18,409][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:23,410][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:28,411][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:29,800][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:24:33,412][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:38,413][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:39,803][WARNING][PID:3432594] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:24:43,415][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:48,416][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:49,803][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 3
[2026-04-02 19:24:49,805][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@32.194.169.110 copr-rpmbuild-log
[2026-04-02 19:24:53,417][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:24:58,418][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:03,419][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:08,420][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:13,422][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:18,422][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:23,423][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:28,424][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:33,425][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:38,432][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:43,433][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:48,434][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:49,871][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:25:53,435][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:58,436][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:25:59,872][WARNING][PID:3432594] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:26:03,437][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:08,438][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:09,873][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 4
[2026-04-02 19:26:09,874][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@32.194.169.110 copr-rpmbuild-log
[2026-04-02 19:26:13,439][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:18,440][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:23,441][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:28,443][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:33,444][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:38,445][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:43,447][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:48,449][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:53,452][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:26:58,453][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:03,482][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:08,484][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:09,944][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:27:14,118][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:19,119][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:19,946][ ERROR][PID:3432594] Giving up for unstable SSH, failures: 1775157799.729852, 1775157879.8030345, 1775157959.872526, 1775158039.9460733
[2026-04-02 19:27:19,947][ ERROR][PID:3432594] Re-try request for task on 'ResallocHost, ticket_id=2154227, hostname=32.194.169.110, name=aws_x86_64_spot_prod_04490283_20260402_191950, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-02 19:27:19,947][  INFO][PID:3432594] Releasing VM back to pool
[2026-04-02 19:27:19,957][  INFO][PID:3432594] Retry #1 (on other host)
[2026-04-02 19:27:19,958][  INFO][PID:3432594] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/repodata/repomd.xml exists
[2026-04-02 19:27:19,958][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:19,959][  INFO][PID:3432594] VM allocation process starts
[2026-04-02 19:27:19,970][  INFO][PID:3432594] Trying to allocate VM: ResallocHost, ticket_id=2154383, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-02 19:27:24,971][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:29,972][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:34,973][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:39,974][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:44,975][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:49,976][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:54,977][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:27:59,978][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:04,979][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:09,980][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:14,981][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:19,982][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:24,983][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:29,984][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:34,985][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:39,986][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:44,987][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:49,988][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:54,989][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:28:59,990][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:04,991][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:09,992][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:14,993][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:19,993][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:24,994][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:29,996][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:34,997][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:39,997][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:44,999][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:50,000][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:29:55,001][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:00,002][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:05,013][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:10,014][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:15,015][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:20,016][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:25,017][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:30,018][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:35,019][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:40,020][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:45,021][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:50,022][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:30:55,023][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:00,024][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:05,025][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:10,026][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:15,027][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:20,028][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:25,029][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:30,036][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:35,037][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:40,038][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:45,039][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:50,409][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:31:55,410][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:00,411][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:05,412][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:10,413][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:15,414][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:20,415][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:25,416][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:30,417][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:35,418][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:40,419][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:45,420][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:50,421][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:32:55,422][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:00,423][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:05,424][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:10,425][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:15,426][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:20,427][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:25,428][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:30,429][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:35,430][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:38,110][  INFO][PID:3432594] Allocated host ResallocHost, ticket_id=2154383, hostname=3.235.159.198, name=aws_x86_64_spot_prod_04490462_20260402_193130, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-02 19:33:38,110][  INFO][PID:3432594] Allocating ssh connection to builder
[2026-04-02 19:33:38,111][  INFO][PID:3432594] Checking that builder machine is OK
[2026-04-02 19:33:38,430][  INFO][PID:3432594] Running remote command: copr-builder-ready centos-stream-9-s390x
[2026-04-02 19:33:38,630][  INFO][PID:3432594] Red Hat subscription not needed for centos-stream-9-s390x
Builder is ready to be used

[2026-04-02 19:33:38,631][  INFO][PID:3432594] Filling build.info file with builder info
[2026-04-02 19:33:38,887][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:38,888][  INFO][PID:3432594] Not re-notifying FE and msg buses for the new host.
[2026-04-02 19:33:38,889][  INFO][PID:3432594] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287996-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached
[2026-04-02 19:33:39,215][  INFO][PID:3432594] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.235.159.198' (ED25519) to the list of known hosts.


[2026-04-02 19:33:39,711][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 1
[2026-04-02 19:33:39,712][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.159.198 copr-rpmbuild-log
[2026-04-02 19:33:44,719][  INFO][PID:3432594] Periodic builder liveness probe: alive
[2026-04-02 19:33:44,719][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:49,720][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:54,721][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:33:59,896][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:04,897][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:09,898][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:14,899][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:19,900][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:24,901][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:29,902][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:34,903][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:39,905][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:44,906][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:49,906][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:54,907][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:34:59,908][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:04,909][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:09,910][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:14,911][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:19,912][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:24,913][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:29,914][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:34,915][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:39,925][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:44,926][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:49,933][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:54,934][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:35:59,935][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:04,936][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:09,937][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:14,938][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:19,939][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:24,940][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:29,943][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:34,944][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:39,945][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:44,946][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:49,947][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:54,948][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:36:59,949][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:04,949][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:09,950][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:14,951][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:15,164][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:37:19,953][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:24,955][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:25,165][WARNING][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:37:29,956][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:34,957][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:35,166][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 2
[2026-04-02 19:37:35,167][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.159.198 copr-rpmbuild-log
[2026-04-02 19:37:39,958][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:44,959][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:49,960][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:54,961][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:37:59,962][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:04,963][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:09,964][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:14,965][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:19,966][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:24,967][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:29,968][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:34,970][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:35,234][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:38:39,971][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:44,972][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:45,271][WARNING][PID:3432594] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:38:49,973][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:54,974][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:38:55,272][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 3
[2026-04-02 19:38:55,273][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.159.198 copr-rpmbuild-log
[2026-04-02 19:38:59,975][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:04,976][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:09,977][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:14,978][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:19,979][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:24,980][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:29,981][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:34,982][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:39,983][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:44,985][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:49,986][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:54,988][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:39:55,336][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:39:59,989][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:04,990][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:05,340][WARNING][PID:3432594] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:40:09,991][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:14,993][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:15,341][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 4
[2026-04-02 19:40:15,349][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.159.198 copr-rpmbuild-log
[2026-04-02 19:40:19,994][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:24,999][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:30,002][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:35,003][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:40,005][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:45,006][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:50,007][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:40:55,008][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:00,009][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:05,010][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:10,011][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:15,058][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:15,447][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:41:20,062][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:25,063][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:25,450][ ERROR][PID:3432594] Giving up for unstable SSH, failures: 1775158645.165459, 1775158725.2713566, 1775158805.3407412, 1775158885.4502814
[2026-04-02 19:41:25,451][ ERROR][PID:3432594] Re-try request for task on 'ResallocHost, ticket_id=2154383, hostname=3.235.159.198, name=aws_x86_64_spot_prod_04490462_20260402_193130, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-02 19:41:25,452][  INFO][PID:3432594] Releasing VM back to pool
[2026-04-02 19:41:25,464][  INFO][PID:3432594] Retry #2 (on other host)
[2026-04-02 19:41:25,465][  INFO][PID:3432594] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/repodata/repomd.xml exists
[2026-04-02 19:41:25,465][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:25,466][  INFO][PID:3432594] VM allocation process starts
[2026-04-02 19:41:25,482][  INFO][PID:3432594] Trying to allocate VM: ResallocHost, ticket_id=2154567, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-02 19:41:30,484][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:35,485][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:40,486][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:45,487][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:50,488][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:41:55,489][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:00,490][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:05,491][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:10,492][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:15,495][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:20,499][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:25,502][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:30,503][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:35,504][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:40,505][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:45,689][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:50,690][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:42:55,693][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:00,694][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:05,696][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:10,697][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:15,698][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:20,700][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:25,701][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:30,702][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:35,703][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:40,704][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:45,705][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:50,706][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:43:55,707][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:00,709][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:05,712][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:10,713][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:15,744][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:20,745][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:25,746][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:30,747][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:35,750][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:40,753][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:45,754][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:50,755][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:44:55,756][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:00,757][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:05,758][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:10,760][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:15,762][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:20,765][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:25,766][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:30,767][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:35,768][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:40,769][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:45,874][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:50,875][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:45:55,878][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:00,908][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:05,938][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:10,940][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:15,943][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:20,944][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:25,945][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:30,947][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:35,948][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:40,951][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:46,008][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:51,012][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:46:56,014][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:01,015][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:06,016][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:11,017][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:16,017][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:21,590][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:26,592][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:31,593][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:36,594][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:41,596][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:46,597][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:51,598][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:47:56,616][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:01,619][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:06,620][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:11,621][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:16,622][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:21,623][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:26,624][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:31,625][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:36,941][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:41,942][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:46,943][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:51,977][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:48:56,977][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:01,978][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:06,979][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:11,981][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:16,982][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:21,983][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:27,024][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:32,037][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:37,061][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:42,083][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:47,085][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:52,086][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:49:57,116][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:02,117][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:07,118][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:12,119][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:17,120][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:22,121][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:27,122][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:32,123][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:37,124][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:42,125][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:43,635][  INFO][PID:3432594] Allocated host ResallocHost, ticket_id=2154567, hostname=3.233.219.115, name=aws_x86_64_spot_prod_04490924_20260402_194856, requested_tags=['copr_builder', 'arch_s390x']
[2026-04-02 19:50:43,635][  INFO][PID:3432594] Allocating ssh connection to builder
[2026-04-02 19:50:43,636][  INFO][PID:3432594] Checking that builder machine is OK
[2026-04-02 19:50:43,997][  INFO][PID:3432594] Running remote command: copr-builder-ready centos-stream-9-s390x
[2026-04-02 19:50:44,215][  INFO][PID:3432594] Red Hat subscription not needed for centos-stream-9-s390x
Builder is ready to be used

[2026-04-02 19:50:44,216][  INFO][PID:3432594] Filling build.info file with builder info
[2026-04-02 19:50:44,299][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:44,300][  INFO][PID:3432594] Not re-notifying FE and msg buses for the new host.
[2026-04-02 19:50:44,300][  INFO][PID:3432594] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287996-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached
[2026-04-02 19:50:44,657][  INFO][PID:3432594] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.233.219.115' (ED25519) to the list of known hosts.


[2026-04-02 19:50:44,658][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 1
[2026-04-02 19:50:44,659][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.233.219.115 copr-rpmbuild-log
[2026-04-02 19:50:49,666][  INFO][PID:3432594] Periodic builder liveness probe: alive
[2026-04-02 19:50:49,667][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:54,668][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:50:59,669][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:04,670][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:09,671][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:14,672][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:19,673][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:24,675][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:29,677][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:34,678][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:39,684][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:44,685][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:49,686][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:54,687][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:51:59,688][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:04,689][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:09,690][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:14,691][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:19,692][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:24,693][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:29,694][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:34,696][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:39,697][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:44,698][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:49,711][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:54,712][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:52:59,713][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:04,715][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:09,716][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:14,717][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:19,718][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:24,719][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:29,723][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:34,724][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:39,725][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:44,726][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:49,727][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:54,728][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:53:59,729][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:04,730][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:09,731][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:14,732][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:19,733][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:24,734][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:29,735][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:34,736][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:39,737][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:44,738][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:49,739][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:54,740][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:54:59,741][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:04,742][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:09,743][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:14,744][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:18,437][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:55:19,745][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:24,746][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:28,439][WARNING][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:55:29,747][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:34,748][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:38,440][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 2
[2026-04-02 19:55:38,728][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.233.219.115 copr-rpmbuild-log
[2026-04-02 19:55:39,749][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:44,750][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:49,750][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:54,751][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:55:59,752][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:04,753][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:09,754][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:14,755][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:19,756][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:24,758][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:29,759][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:34,760][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:38,797][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:56:39,761][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:44,762][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:48,803][WARNING][PID:3432594] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:56:49,763][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:54,764][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:56:58,804][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 3
[2026-04-02 19:56:58,805][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.233.219.115 copr-rpmbuild-log
[2026-04-02 19:56:59,765][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:04,766][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:09,767][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:14,768][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:19,769][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:24,770][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:29,771][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:34,772][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:39,773][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:44,774][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:49,775][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:54,776][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:57:58,873][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:57:59,777][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:04,778][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:08,873][WARNING][PID:3432594] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-02 19:58:09,779][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:14,779][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:18,947][  INFO][PID:3432594] Downloading the builder-live.log file, attempt 4
[2026-04-02 19:58:18,950][  INFO][PID:3432594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.233.219.115 copr-rpmbuild-log
[2026-04-02 19:58:19,780][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:24,781][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:29,782][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:34,808][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:39,809][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:44,810][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:49,810][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:54,811][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:58:59,812][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:59:04,813][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:59:09,832][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:59:14,834][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:59:19,018][ ERROR][PID:3432594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-02 19:59:19,835][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:59:24,836][  INFO][PID:3432594] Checking for cancel request
[2026-04-02 19:59:29,417][ ERROR][PID:3432594] Giving up for unstable SSH, failures: 1775159728.439907, 1775159808.803645, 1775159888.873795, 1775159969.4170532
[2026-04-02 19:59:29,418][ ERROR][PID:3432594] Re-try request for task on 'ResallocHost, ticket_id=2154567, hostname=3.233.219.115, name=aws_x86_64_spot_prod_04490924_20260402_194856, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-02 19:59:29,418][  INFO][PID:3432594] Releasing VM back to pool
[2026-04-02 19:59:29,454][ ERROR][PID:3432594] Backend process error: Three host tried without success: {'32.194.169.110', '3.233.219.115', '3.235.159.198'}
[2026-04-02 19:59:29,454][WARNING][PID:3432594] Switching not-finished job state to 'failed'
[2026-04-02 19:59:29,455][  INFO][PID:3432594] Worker failed build, took 525.1545815467834
[2026-04-02 19:59:29,455][  INFO][PID:3432594] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "podman-next",
            "project_dirname": "podman-next",
            "submitter": "packit",
            "ended_on": 1775159969.4549177,
            "started_on": 1775159444.3003361,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10287996-centos-stream-9-s390x",
            "build_id": 10287996,
            "package_name": "podman",
            "package_version": "102:6.0.0~dev-1.20260402180422795791.main.2655.8c483b4da0",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/podman",
            "git_hash": "69056b0cfe4f3e73dccc7cce0584c9467644fa95",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/podman-next--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/",
                    "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch",
                    "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next",
            "result_dir": "10287996-podman",
            "built_packages": "",
            "id": 10287996,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "podman-next",
                "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)"
            }
        }
    ]
}
[2026-04-02 19:59:29,529][  INFO][PID:3432594] Sending fedora-messaging bus message in build.end
[2026-04-02 19:59:29,564][  INFO][PID:3432594] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/10287996-podman/builder-live.log by gzip
[2026-04-02 19:59:29,565][  INFO][PID:3432594] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/10287996-podman/builder-live.log' as PID 3662788
[2026-04-02 19:59:29,566][  INFO][PID:3432594] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/10287996-podman/builder-live.log)
[2026-04-02 19:59:29,567][  INFO][PID:3432594] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/10287996-podman/backend.log by gzip
[2026-04-02 19:59:29,568][  INFO][PID:3432594] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-s390x/10287996-podman/backend.log' as PID 3662790