[2026-03-27 11:17:33,812][  INFO][PID:1743720] Marking build as starting
[2026-03-27 11:17:33,869][  INFO][PID:1743720] Checking that /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/repodata/repomd.xml exists
[2026-03-27 11:17:33,983][  INFO][PID:1743720] Checking that /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/repodata/repomd.xml exists
[2026-03-27 11:17:33,984][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:17:33,985][  INFO][PID:1743720] VM allocation process starts
[2026-03-27 11:17:34,001][  INFO][PID:1743720] Trying to allocate VM: ResallocHost, ticket_id=2055998, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-27 11:17:37,033][  INFO][PID:1743720] Allocated host ResallocHost, ticket_id=2055998, hostname=3.88.146.4, name=aws_x86_64_spot_prod_04326861_20260327_111542, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-27 11:17:37,034][  INFO][PID:1743720] Allocating ssh connection to builder
[2026-03-27 11:17:37,035][  INFO][PID:1743720] Checking that builder machine is OK
[2026-03-27 11:17:37,365][  INFO][PID:1743720] Running remote command: copr-builder-ready fedora-42-s390x
[2026-03-27 11:17:37,624][  INFO][PID:1743720] Red Hat subscription not needed for fedora-42-s390x
Builder is ready to be used

[2026-03-27 11:17:37,625][  INFO][PID:1743720] Filling build.info file with builder info
[2026-03-27 11:17:37,625][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:17:37,626][  INFO][PID:1743720] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ngompa",
            "project_name": "bcachefs",
            "project_dirname": "bcachefs:pr:fork-packit-rpms-bcachefs-tools-7",
            "submitter": "https://src.fedoraproject.org/user/packit",
            "ended_on": null,
            "started_on": 1774610257.6266277,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10238023-fedora-42-s390x",
            "build_id": 10238023,
            "package_name": "bcachefs-tools",
            "package_version": "1.37.2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/bcachefs-tools",
            "git_hash": "fadb824a2d6ccf71f97b7de5d25ff1decf64dcd3",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ngompa/bcachefs--https://src.fedoraproject.org/user/packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/bcachefs/fedora-42-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": 98
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": 98
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": 98,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [
                "dkms"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7",
            "result_dir": "10238023-bcachefs-tools",
            "built_packages": "",
            "id": 10238023,
            "mockchain_macros": {
                "copr_username": "ngompa",
                "copr_projectname": "bcachefs",
                "vendor": "Fedora Project COPR (ngompa/bcachefs)"
            }
        }
    ]
}
[2026-03-27 11:17:37,704][  INFO][PID:1743720] Sending fedora-messaging bus message in build.start
[2026-03-27 11:17:38,637][  INFO][PID:1743720] Sending fedora-messaging bus message in chroot.start
[2026-03-27 11:17:38,696][  INFO][PID:1743720] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10238023-fedora-42-s390x --chroot fedora-42-s390x --detached
[2026-03-27 11:17:39,049][  INFO][PID:1743720] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.88.146.4' (ED25519) to the list of known hosts.


[2026-03-27 11:17:39,051][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 1
[2026-03-27 11:17:39,095][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.88.146.4 copr-rpmbuild-log
[2026-03-27 11:17:44,067][  INFO][PID:1743720] Periodic builder liveness probe: alive
[2026-03-27 11:17:44,068][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:17:49,069][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:17:54,070][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:17:59,074][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:04,075][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:09,080][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:14,081][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:19,082][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:24,083][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:29,084][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:34,085][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:39,086][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:44,087][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:49,088][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:54,090][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:18:59,091][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:04,092][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:09,093][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:14,094][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:19,095][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:24,096][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:29,098][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:34,099][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:39,100][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:44,101][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:49,102][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:54,103][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:19:59,104][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:04,105][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:09,109][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:14,110][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:19,111][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:24,112][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:29,113][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:34,122][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:39,123][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:44,124][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:49,125][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:54,126][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:20:59,128][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:04,129][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:09,130][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:14,131][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:19,132][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:24,134][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:29,135][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:34,136][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:39,137][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:44,138][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:49,139][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:54,140][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:21:59,141][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:04,142][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:09,144][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:14,146][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:19,147][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:24,148][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:29,155][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:34,156][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:39,157][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:44,158][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:49,159][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:54,160][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:22:59,161][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:04,163][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:09,168][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:14,169][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:19,175][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:24,180][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:29,181][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:34,183][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:39,184][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:44,186][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:49,187][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:54,188][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:23:59,189][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:04,189][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:09,216][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:14,217][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:19,218][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:24,220][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:29,227][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:34,228][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:39,230][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:44,231][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:49,232][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:54,233][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:24:59,235][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:04,236][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:09,237][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:14,239][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:19,240][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:24,241][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:29,242][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:34,243][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:39,245][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:44,246][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:49,247][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:54,248][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:25:59,250][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:04,250][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:09,252][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:14,253][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:19,254][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:24,255][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:29,256][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:34,257][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:39,258][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:44,259][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:49,260][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:54,261][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:26:59,261][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:04,262][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:09,263][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:14,264][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:19,265][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:24,266][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:29,267][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:34,268][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:39,269][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:44,275][  INFO][PID:1743720] Periodic builder liveness probe: alive
[2026-03-27 11:27:44,275][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:49,276][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:54,277][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:27:59,278][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:04,281][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:09,283][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:14,284][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:19,285][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:24,286][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:29,287][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:34,288][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:39,289][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:44,290][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:49,317][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:54,318][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:28:59,319][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:04,320][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:09,321][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:14,322][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:19,323][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:24,324][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:29,325][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:34,326][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:39,327][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:44,328][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:49,329][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:54,330][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:29:59,331][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:04,332][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:09,333][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:14,399][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:19,400][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:24,405][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:29,408][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:34,409][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:39,410][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:44,411][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:49,412][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:54,413][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:30:59,414][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:04,416][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:09,417][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:14,418][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:19,419][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:24,420][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:29,422][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:34,423][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:39,424][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:44,426][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:49,427][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:54,428][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:31:59,429][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:04,430][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:09,433][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:14,438][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:19,440][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:24,443][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:29,446][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:34,447][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:39,449][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:44,450][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:49,451][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:54,452][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:32:59,453][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:04,456][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:09,458][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:14,526][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:19,527][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:24,528][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:29,529][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:34,530][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:39,531][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:44,532][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:49,534][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:54,536][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:33:59,536][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:03,637][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:34:04,539][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:09,540][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:13,638][WARNING][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:34:14,542][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:19,543][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:23,638][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 2
[2026-03-27 11:34:23,640][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.88.146.4 copr-rpmbuild-log
[2026-03-27 11:34:24,544][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:29,545][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:34,546][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:39,547][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:44,548][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:49,549][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:54,550][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:34:59,551][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:04,552][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:09,553][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:14,554][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:19,555][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:23,708][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:35:24,556][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:29,557][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:33,758][WARNING][PID:1743720] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:35:34,559][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:39,562][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:43,762][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 3
[2026-03-27 11:35:43,764][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.88.146.4 copr-rpmbuild-log
[2026-03-27 11:35:44,563][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:49,564][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:54,565][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:35:59,566][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:04,568][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:09,570][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:14,571][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:19,572][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:24,575][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:29,576][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:34,579][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:39,588][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:43,836][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:36:44,591][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:49,592][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:53,837][WARNING][PID:1743720] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:36:54,594][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:36:59,595][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:03,838][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 4
[2026-03-27 11:37:03,839][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.88.146.4 copr-rpmbuild-log
[2026-03-27 11:37:04,596][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:09,597][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:14,598][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:19,599][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:24,600][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:29,602][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:34,603][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:39,604][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:44,611][  INFO][PID:1743720] Periodic builder liveness probe: alive
[2026-03-27 11:37:44,612][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:49,613][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:54,614][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:37:59,615][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:03,906][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:38:04,616][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:09,617][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:13,935][ ERROR][PID:1743720] Giving up for unstable SSH, failures: 1774611253.6381707, 1774611333.7584655, 1774611413.8375213, 1774611493.9348128
[2026-03-27 11:38:13,936][ ERROR][PID:1743720] Re-try request for task on 'ResallocHost, ticket_id=2055998, hostname=3.88.146.4, name=aws_x86_64_spot_prod_04326861_20260327_111542, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-03-27 11:38:13,936][  INFO][PID:1743720] Releasing VM back to pool
[2026-03-27 11:38:13,961][  INFO][PID:1743720] Retry #1 (on other host)
[2026-03-27 11:38:13,963][  INFO][PID:1743720] Checking that /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/repodata/repomd.xml exists
[2026-03-27 11:38:13,963][  INFO][PID:1743720] Checking that /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/repodata/repomd.xml exists
[2026-03-27 11:38:13,963][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:13,964][  INFO][PID:1743720] VM allocation process starts
[2026-03-27 11:38:13,981][  INFO][PID:1743720] Trying to allocate VM: ResallocHost, ticket_id=2056323, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-27 11:38:17,022][  INFO][PID:1743720] Allocated host ResallocHost, ticket_id=2056323, hostname=3.83.11.18, name=aws_x86_64_spot_prod_04327903_20260327_113609, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-27 11:38:17,024][  INFO][PID:1743720] Allocating ssh connection to builder
[2026-03-27 11:38:17,025][  INFO][PID:1743720] Checking that builder machine is OK
[2026-03-27 11:38:17,354][  INFO][PID:1743720] Running remote command: copr-builder-ready fedora-42-s390x
[2026-03-27 11:38:17,555][  INFO][PID:1743720] Red Hat subscription not needed for fedora-42-s390x
Builder is ready to be used

[2026-03-27 11:38:17,555][  INFO][PID:1743720] Filling build.info file with builder info
[2026-03-27 11:38:17,747][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:17,749][  INFO][PID:1743720] Not re-notifying FE and msg buses for the new host.
[2026-03-27 11:38:17,749][  INFO][PID:1743720] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10238023-fedora-42-s390x --chroot fedora-42-s390x --detached
[2026-03-27 11:38:18,069][  INFO][PID:1743720] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.83.11.18' (ED25519) to the list of known hosts.


[2026-03-27 11:38:18,070][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 1
[2026-03-27 11:38:18,071][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.83.11.18 copr-rpmbuild-log
[2026-03-27 11:38:23,070][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:28,071][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:33,072][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:38,073][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:43,075][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:48,076][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:53,076][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:38:58,078][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:03,082][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:08,085][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:13,089][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:18,090][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:23,091][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:28,093][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:33,095][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:38,096][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:43,097][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:48,098][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:53,233][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:39:58,235][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:03,239][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:08,240][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:13,243][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:18,244][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:23,245][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:28,246][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:33,247][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:38,248][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:43,303][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:48,305][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:53,307][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:40:58,308][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:03,718][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:08,720][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:13,722][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:18,724][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:23,726][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:28,727][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:33,728][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:38,733][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:43,736][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:48,738][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:53,739][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:41:58,741][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:03,742][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:08,743][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:13,744][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:18,745][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:23,931][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:28,933][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:33,934][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:38,935][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:43,937][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:48,937][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:53,938][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:42:58,939][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:03,940][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:08,941][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:13,942][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:18,943][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:23,945][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:28,946][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:34,077][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:39,079][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:44,080][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:49,082][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:54,083][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:43:59,084][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:04,086][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:09,087][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:14,088][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:19,089][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:24,090][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:29,092][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:34,093][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:39,094][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:44,096][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:49,097][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:54,098][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:44:59,099][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:04,100][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:09,101][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:14,102][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:19,103][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:24,104][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:29,604][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:34,607][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:39,609][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:44,610][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:49,612][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:54,613][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:45:59,615][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:04,617][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:09,634][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:14,636][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:19,637][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:24,639][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:29,640][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:34,641][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:39,642][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:44,643][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:49,841][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:54,843][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:46:59,845][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:04,846][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:09,848][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:14,849][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:19,851][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:24,964][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:29,978][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:34,980][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:39,981][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:44,989][  INFO][PID:1743720] Periodic builder liveness probe: alive
[2026-03-27 11:47:44,990][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:49,991][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:54,992][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:47:59,993][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:04,993][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:09,994][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:14,995][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:19,996][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:25,000][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:30,002][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:35,053][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:40,054][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:45,055][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:50,057][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:48:55,058][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:00,059][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:05,061][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:10,062][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:15,063][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:20,064][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:25,065][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:30,066][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:35,068][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:40,072][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:45,073][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:50,074][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:49:55,075][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:00,076][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:05,077][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:10,164][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:15,170][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:20,172][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:25,174][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:30,178][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:30,587][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:50:35,181][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:40,183][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:40,595][WARNING][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:50:45,194][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:50,197][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:50:50,596][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 2
[2026-03-27 11:50:50,608][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.83.11.18 copr-rpmbuild-log
[2026-03-27 11:50:55,198][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:00,199][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:05,201][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:10,205][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:15,207][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:20,212][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:25,243][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:30,244][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:35,246][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:40,247][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:45,248][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:50,250][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:51:50,675][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:51:55,251][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:00,252][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:00,677][WARNING][PID:1743720] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:52:05,629][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:10,630][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:10,678][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 3
[2026-03-27 11:52:10,679][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.83.11.18 copr-rpmbuild-log
[2026-03-27 11:52:15,634][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:20,635][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:25,636][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:30,637][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:35,638][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:40,639][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:45,641][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:50,643][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:52:55,644][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:00,645][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:05,647][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:10,649][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:10,733][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:53:15,650][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:20,651][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:20,744][WARNING][PID:1743720] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:53:25,654][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:30,655][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:30,745][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 4
[2026-03-27 11:53:30,747][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.83.11.18 copr-rpmbuild-log
[2026-03-27 11:53:35,656][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:40,657][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:45,659][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:50,660][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:53:55,662][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:00,663][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:05,664][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:10,665][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:15,666][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:20,667][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:25,668][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:30,670][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:30,811][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:54:35,671][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:40,672][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:40,815][ ERROR][PID:1743720] Giving up for unstable SSH, failures: 1774612240.5955691, 1774612320.6772592, 1774612400.7444603, 1774612480.8148723
[2026-03-27 11:54:40,815][ ERROR][PID:1743720] Re-try request for task on 'ResallocHost, ticket_id=2056323, hostname=3.83.11.18, name=aws_x86_64_spot_prod_04327903_20260327_113609, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-03-27 11:54:40,816][  INFO][PID:1743720] Releasing VM back to pool
[2026-03-27 11:54:40,827][  INFO][PID:1743720] Retry #2 (on other host)
[2026-03-27 11:54:40,827][  INFO][PID:1743720] Checking that /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/repodata/repomd.xml exists
[2026-03-27 11:54:40,828][  INFO][PID:1743720] Checking that /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/repodata/repomd.xml exists
[2026-03-27 11:54:40,828][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:40,829][  INFO][PID:1743720] VM allocation process starts
[2026-03-27 11:54:40,838][  INFO][PID:1743720] Trying to allocate VM: ResallocHost, ticket_id=2056581, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-27 11:54:45,839][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:50,840][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:54:55,841][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:00,843][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:05,844][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:10,876][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:15,877][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:20,877][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:25,883][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:30,887][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:35,888][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:40,889][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:45,890][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:48,899][  INFO][PID:1743720] Allocated host ResallocHost, ticket_id=2056581, hostname=52.204.116.213, name=aws_x86_64_spot_prod_04328485_20260327_115407, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-27 11:55:48,900][  INFO][PID:1743720] Allocating ssh connection to builder
[2026-03-27 11:55:48,901][  INFO][PID:1743720] Checking that builder machine is OK
[2026-03-27 11:55:49,246][  INFO][PID:1743720] Running remote command: copr-builder-ready fedora-42-s390x
[2026-03-27 11:55:49,458][  INFO][PID:1743720] Red Hat subscription not needed for fedora-42-s390x
Builder is ready to be used

[2026-03-27 11:55:49,458][  INFO][PID:1743720] Filling build.info file with builder info
[2026-03-27 11:55:49,511][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:49,512][  INFO][PID:1743720] Not re-notifying FE and msg buses for the new host.
[2026-03-27 11:55:49,513][  INFO][PID:1743720] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10238023-fedora-42-s390x --chroot fedora-42-s390x --detached
[2026-03-27 11:55:49,869][  INFO][PID:1743720] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '52.204.116.213' (ED25519) to the list of known hosts.


[2026-03-27 11:55:49,870][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 1
[2026-03-27 11:55:49,871][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.204.116.213 copr-rpmbuild-log
[2026-03-27 11:55:54,870][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:55:59,871][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:04,872][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:09,873][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:14,874][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:19,876][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:24,877][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:29,878][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:34,879][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:39,880][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:44,898][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:49,901][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:54,903][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:56:59,904][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:04,905][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:09,906][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:14,908][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:19,909][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:24,910][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:29,911][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:34,912][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:39,914][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:44,915][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:49,925][  INFO][PID:1743720] Periodic builder liveness probe: alive
[2026-03-27 11:57:49,926][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:54,927][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:57:59,928][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:04,929][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:09,931][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:14,933][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:19,933][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:24,935][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:29,936][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:34,941][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:39,944][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:44,945][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:49,946][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:54,950][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:58:59,952][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:04,953][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:09,954][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:14,956][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:19,957][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:24,958][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:29,960][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:34,962][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:38,573][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 11:59:39,964][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:44,965][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:48,574][WARNING][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 11:59:49,966][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:54,967][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 11:59:58,575][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 2
[2026-03-27 11:59:58,577][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.204.116.213 copr-rpmbuild-log
[2026-03-27 11:59:59,968][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:04,971][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:09,972][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:14,973][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:19,975][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:24,977][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:29,978][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:34,979][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:39,980][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:44,981][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:49,982][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:54,983][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:00:58,644][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 12:00:59,985][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:04,986][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:08,649][WARNING][PID:1743720] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 12:01:09,988][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:14,989][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:18,650][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 3
[2026-03-27 12:01:18,651][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.204.116.213 copr-rpmbuild-log
[2026-03-27 12:01:19,990][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:24,992][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:29,994][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:34,999][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:40,001][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:45,002][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:50,003][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:01:55,004][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:00,005][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:05,008][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:10,010][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:15,011][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:18,721][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 12:02:20,013][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:25,015][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:28,737][WARNING][PID:1743720] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-27 12:02:30,017][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:35,019][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:38,738][  INFO][PID:1743720] Downloading the builder-live.log file, attempt 4
[2026-03-27 12:02:38,739][  INFO][PID:1743720] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.204.116.213 copr-rpmbuild-log
[2026-03-27 12:02:40,020][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:45,021][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:50,024][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:02:55,029][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:00,033][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:05,034][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:10,036][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:15,037][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:20,038][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:25,039][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:30,040][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:35,041][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:38,807][ ERROR][PID:1743720] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-27 12:03:40,042][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:45,043][  INFO][PID:1743720] Checking for cancel request
[2026-03-27 12:03:48,831][ ERROR][PID:1743720] Giving up for unstable SSH, failures: 1774612788.5746498, 1774612868.6493266, 1774612948.7374308, 1774613028.8310983
[2026-03-27 12:03:48,832][ ERROR][PID:1743720] Re-try request for task on 'ResallocHost, ticket_id=2056581, hostname=52.204.116.213, name=aws_x86_64_spot_prod_04328485_20260327_115407, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-03-27 12:03:48,832][  INFO][PID:1743720] Releasing VM back to pool
[2026-03-27 12:03:48,843][ ERROR][PID:1743720] Backend process error: Three host tried without success: {'3.88.146.4', '52.204.116.213', '3.83.11.18'}
[2026-03-27 12:03:48,844][WARNING][PID:1743720] Switching not-finished job state to 'failed'
[2026-03-27 12:03:48,844][  INFO][PID:1743720] Worker failed build, took 479.3315782546997
[2026-03-27 12:03:48,845][  INFO][PID:1743720] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ngompa",
            "project_name": "bcachefs",
            "project_dirname": "bcachefs:pr:fork-packit-rpms-bcachefs-tools-7",
            "submitter": "https://src.fedoraproject.org/user/packit",
            "ended_on": 1774613028.84417,
            "started_on": 1774612549.5125918,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10238023-fedora-42-s390x",
            "build_id": 10238023,
            "package_name": "bcachefs-tools",
            "package_version": "1.37.2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/bcachefs-tools",
            "git_hash": "fadb824a2d6ccf71f97b7de5d25ff1decf64dcd3",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ngompa/bcachefs--https://src.fedoraproject.org/user/packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/bcachefs/fedora-42-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": 98
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": 98
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": 98,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [
                "dkms"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7",
            "result_dir": "10238023-bcachefs-tools",
            "built_packages": "",
            "id": 10238023,
            "mockchain_macros": {
                "copr_username": "ngompa",
                "copr_projectname": "bcachefs",
                "vendor": "Fedora Project COPR (ngompa/bcachefs)"
            }
        }
    ]
}
[2026-03-27 12:03:48,901][  INFO][PID:1743720] Sending fedora-messaging bus message in build.end
[2026-03-27 12:03:48,965][  INFO][PID:1743720] Compressing /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/10238023-bcachefs-tools/builder-live.log by gzip
[2026-03-27 12:03:48,966][  INFO][PID:1743720] Running command 'gzip /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/10238023-bcachefs-tools/builder-live.log' as PID 2064021
[2026-03-27 12:03:49,273][  INFO][PID:1743720] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/10238023-bcachefs-tools/builder-live.log)
[2026-03-27 12:03:49,273][  INFO][PID:1743720] Compressing /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/10238023-bcachefs-tools/backend.log by gzip
[2026-03-27 12:03:49,274][  INFO][PID:1743720] Running command 'gzip /var/lib/copr/public_html/results/ngompa/bcachefs:pr:fork-packit-rpms-bcachefs-tools-7/fedora-42-s390x/10238023-bcachefs-tools/backend.log' as PID 2064045