[2026-04-20 13:21:34,963][  INFO][PID:2002814] Marking build as starting
[2026-04-20 13:21:35,024][  INFO][PID:2002814] Checking that /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/repodata/repomd.xml exists
[2026-04-20 13:21:35,089][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:21:35,090][  INFO][PID:2002814] VM allocation process starts
[2026-04-20 13:21:35,113][  INFO][PID:2002814] Trying to allocate VM: ResallocHost, ticket_id=2422033, requested_tags=['arch_aarch64', 'copr_builder']
[2026-04-20 13:21:40,119][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:21:45,126][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:21:50,131][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:21:55,134][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:00,136][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:05,143][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:10,145][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:15,149][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:20,153][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:25,156][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:30,159][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:35,160][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:40,163][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:45,168][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:50,170][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:22:55,179][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:00,187][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:05,258][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:10,260][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:15,265][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:20,266][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:25,269][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:30,270][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:35,271][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:40,273][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:45,276][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:50,277][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:23:55,282][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:00,352][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:05,357][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:10,359][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:15,362][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:20,366][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:25,367][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:30,369][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:35,371][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:40,372][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:45,374][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:50,378][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:24:55,380][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:00,381][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:05,388][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:10,395][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:15,397][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:20,401][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:25,402][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:30,403][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:35,404][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:40,408][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:45,410][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:50,422][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:25:55,424][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:00,425][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:05,426][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:10,429][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:15,430][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:20,448][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:25,449][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:30,451][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:35,453][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:40,457][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:45,459][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:50,465][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:53,417][  INFO][PID:2002814] Allocated host ResallocHost, ticket_id=2422033, hostname=98.94.0.75, name=aws_aarch64_spot_prod_07132070_20260420_132508, requested_tags=['arch_aarch64', 'copr_builder']
[2026-04-20 13:26:53,419][  INFO][PID:2002814] Allocating ssh connection to builder
[2026-04-20 13:26:53,419][  INFO][PID:2002814] Checking that builder machine is OK
[2026-04-20 13:26:53,842][  INFO][PID:2002814] Installed copr-rpmbuild version: 1.8
[2026-04-20 13:26:53,843][  INFO][PID:2002814] Running remote command: copr-builder-ready epel-9-aarch64
[2026-04-20 13:26:54,106][  INFO][PID:2002814] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-20 13:26:54,110][  INFO][PID:2002814] Filling build.info file with builder info
[2026-04-20 13:26:54,263][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:26:54,267][  INFO][PID:2002814] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@redhat-et",
            "project_name": "flightctl-dev",
            "project_dirname": "flightctl-dev",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1776691614.2670856,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-9-aarch64",
            "arch": "aarch64",
            "buildroot_pkgs": [],
            "task_id": "10348578-epel-9-aarch64",
            "build_id": 10348578,
            "package_name": "flightctl",
            "package_version": "1.2.0~main~357~g17573020-1.20260420132041108055.main.444.g17573020",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@redhat-et/flightctl-dev/flightctl",
            "git_hash": "3b0ad23b73ff08a481a37cb97053ab934988ad75",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@redhat-et/flightctl-dev--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@redhat-et/flightctl-dev/epel-9-aarch64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_aarch64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@redhat-et/flightctl-dev",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@redhat-et/flightctl-dev",
            "result_dir": "10348578-flightctl",
            "built_packages": "",
            "id": 10348578,
            "mockchain_macros": {
                "copr_username": "@redhat-et",
                "copr_projectname": "flightctl-dev",
                "vendor": "Fedora Project COPR (@redhat-et/flightctl-dev)"
            }
        }
    ]
}
[2026-04-20 13:26:54,358][  INFO][PID:2002814] Sending fedora-messaging bus message in build.start
[2026-04-20 13:26:55,155][  INFO][PID:2002814] Sending fedora-messaging bus message in chroot.start
[2026-04-20 13:26:55,189][  INFO][PID:2002814] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10348578-epel-9-aarch64 --chroot epel-9-aarch64 --detached
[2026-04-20 13:26:55,734][  INFO][PID:2002814] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.94.0.75' (ED25519) to the list of known hosts.


[2026-04-20 13:26:55,736][  INFO][PID:2002814] Downloading the builder-live.log file, attempt 1
[2026-04-20 13:26:55,741][  INFO][PID:2002814] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.94.0.75 copr-rpmbuild-log
[2026-04-20 13:27:00,757][  INFO][PID:2002814] Periodic builder liveness probe: alive
[2026-04-20 13:27:00,761][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:05,762][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:10,766][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:15,770][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:20,780][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:25,789][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:30,791][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:35,798][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:40,806][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:45,810][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:50,812][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:27:55,814][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:00,891][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:05,896][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:10,899][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:15,907][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:20,918][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:25,936][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:30,938][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:35,974][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:40,976][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:45,981][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:50,983][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:28:56,007][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:01,013][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:06,017][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:11,019][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:16,046][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:21,056][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:26,061][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:31,067][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:36,074][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:41,078][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:46,082][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:51,088][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:29:56,125][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:01,127][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:06,128][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:11,130][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:16,136][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:21,138][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:26,141][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:31,146][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:36,148][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:41,154][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:46,155][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:51,158][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:30:56,163][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:01,164][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:03,742][  INFO][PID:2002814] Downloading results from builder
[2026-04-20 13:31:03,743][  INFO][PID:2002814] rsyncing of mockbuilder@98.94.0.75:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl started
[2026-04-20 13:31:03,745][  INFO][PID:2002814] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.94.0.75:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/ &> /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/build-10348578.rsync.log
[2026-04-20 13:31:04,325][  INFO][PID:2002814] rsyncing finished.
[2026-04-20 13:31:04,326][ ERROR][PID:2002814] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:04,326][ ERROR][PID:2002814] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:14,328][  INFO][PID:2002814] rsyncing of mockbuilder@98.94.0.75:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl started
[2026-04-20 13:31:14,340][  INFO][PID:2002814] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.94.0.75:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/ &> /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/build-10348578.rsync.log
[2026-04-20 13:31:14,501][  INFO][PID:2002814] rsyncing finished.
[2026-04-20 13:31:14,503][ ERROR][PID:2002814] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:14,505][ ERROR][PID:2002814] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:24,508][  INFO][PID:2002814] rsyncing of mockbuilder@98.94.0.75:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl started
[2026-04-20 13:31:24,509][  INFO][PID:2002814] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.94.0.75:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/ &> /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/build-10348578.rsync.log
[2026-04-20 13:31:24,691][  INFO][PID:2002814] rsyncing finished.
[2026-04-20 13:31:24,695][ ERROR][PID:2002814] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:24,697][ ERROR][PID:2002814] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-04-20 13:31:34,698][ ERROR][PID:2002814] Re-try request for task on 'ResallocHost, ticket_id=2422033, hostname=98.94.0.75, name=aws_aarch64_spot_prod_07132070_20260420_132508, requested_tags=['arch_aarch64', 'copr_builder']': Unable to finish after 3 SSH attempts
[2026-04-20 13:31:34,699][  INFO][PID:2002814] VM Release request
[2026-04-20 13:31:34,733][  INFO][PID:2002814] Retry #1 (on other host)
[2026-04-20 13:31:34,734][  INFO][PID:2002814] Checking that /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/repodata/repomd.xml exists
[2026-04-20 13:31:34,735][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:34,738][  INFO][PID:2002814] VM allocation process starts
[2026-04-20 13:31:34,780][  INFO][PID:2002814] Trying to allocate VM: ResallocHost, ticket_id=2422441, requested_tags=['arch_aarch64', 'copr_builder']
[2026-04-20 13:31:39,784][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:44,790][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:49,793][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:54,794][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:31:59,796][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:04,800][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:09,801][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:14,804][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:19,805][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:24,806][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:29,810][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:34,812][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:39,814][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:44,817][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:49,819][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:54,821][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:32:59,827][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:04,839][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:09,846][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:14,851][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:19,853][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:24,856][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:29,860][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:34,863][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:39,869][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:44,879][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:49,882][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:54,884][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:33:59,887][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:04,889][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:09,893][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:14,905][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:19,906][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:24,916][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:29,931][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:34,934][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:39,935][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:44,937][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:49,938][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:54,942][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:34:59,947][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:04,969][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:09,978][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:14,981][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:19,988][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:24,990][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:29,992][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:34,994][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:39,996][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:45,002][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:50,005][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:35:55,009][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:00,011][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:05,013][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:10,019][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:15,031][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:20,035][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:25,049][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:30,066][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:35,069][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:40,070][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:45,075][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:50,079][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:36:55,091][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:00,094][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:05,107][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:10,108][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:15,112][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:20,118][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:25,121][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:30,125][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:35,134][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:40,137][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:45,152][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:50,156][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:37:55,162][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:00,170][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:05,173][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:10,177][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:15,188][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:20,194][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:25,211][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:30,217][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:35,235][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:40,248][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:45,254][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:50,273][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:38:53,346][  INFO][PID:2002814] Allocated host ResallocHost, ticket_id=2422441, hostname=3.91.156.23, name=aws_aarch64_normalreserved_prod_07132691_20260420_133558, requested_tags=['arch_aarch64', 'copr_builder']
[2026-04-20 13:38:53,347][  INFO][PID:2002814] Allocating ssh connection to builder
[2026-04-20 13:38:53,349][  INFO][PID:2002814] Checking that builder machine is OK
[2026-04-20 13:38:53,541][ ERROR][PID:2002814] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '3.91.156.23' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@3.91.156.23: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:39:03,563][ ERROR][PID:2002814] Re-try request for task on 'ResallocHost, ticket_id=2422441, hostname=3.91.156.23, name=aws_aarch64_normalreserved_prod_07132691_20260420_133558, requested_tags=['arch_aarch64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:39:03,567][  INFO][PID:2002814] VM Release request
[2026-04-20 13:39:03,628][  INFO][PID:2002814] Retry #2 (on other host)
[2026-04-20 13:39:03,632][  INFO][PID:2002814] Checking that /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/repodata/repomd.xml exists
[2026-04-20 13:39:03,633][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:03,635][  INFO][PID:2002814] VM allocation process starts
[2026-04-20 13:39:03,668][  INFO][PID:2002814] Trying to allocate VM: ResallocHost, ticket_id=2422664, requested_tags=['arch_aarch64', 'copr_builder']
[2026-04-20 13:39:08,671][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:13,674][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:18,683][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:23,684][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:28,694][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:33,698][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:38,704][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:43,779][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:48,782][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:53,783][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:39:58,793][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:03,798][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:08,803][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:13,809][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:18,812][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:23,814][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:28,820][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:33,822][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:38,824][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:43,828][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:48,830][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:53,833][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:40:58,834][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:03,849][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:08,850][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:13,853][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:18,856][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:23,857][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:28,863][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:33,864][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:38,865][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:43,875][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:48,878][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:53,881][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:41:58,886][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:03,922][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:08,929][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:13,936][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:18,937][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:23,944][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:28,948][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:33,959][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:38,966][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:43,968][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:48,971][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:53,974][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:42:58,976][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:03,980][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:08,982][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:13,990][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:18,998][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:24,000][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:29,001][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:34,005][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:39,008][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:44,010][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:49,011][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:54,015][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:43:59,018][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:04,024][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:09,031][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:14,041][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:19,047][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:24,048][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:29,059][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:34,064][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:39,066][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:44,069][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:49,075][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:54,081][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:44:59,088][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:04,090][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:09,094][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:14,101][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:19,119][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:24,120][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:29,128][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:34,140][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:39,146][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:44,149][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:49,150][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:54,163][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:45:59,169][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:04,173][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:09,177][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:14,184][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:19,188][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:24,195][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:29,197][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:34,200][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:39,201][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:44,202][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:49,209][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:54,212][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:46:59,216][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:04,228][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:09,237][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:14,243][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:19,249][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:24,250][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:29,252][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:34,258][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:39,267][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:44,270][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:49,272][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:54,276][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:47:59,282][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:04,285][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:09,286][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:14,287][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:19,290][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:24,291][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:29,292][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:34,295][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:39,296][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:44,297][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:49,300][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:54,304][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:48:59,307][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:49:04,315][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:49:09,321][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:49:14,322][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:49:19,326][  INFO][PID:2002814] Checking for cancel request
[2026-04-20 13:49:22,240][  INFO][PID:2002814] Allocated host ResallocHost, ticket_id=2422664, hostname=34.201.133.117, name=aws_aarch64_eserved_prod_07133349_20260420_134635, requested_tags=['arch_aarch64', 'copr_builder']
[2026-04-20 13:49:22,241][  INFO][PID:2002814] Allocating ssh connection to builder
[2026-04-20 13:49:22,241][  INFO][PID:2002814] Checking that builder machine is OK
[2026-04-20 13:49:22,513][ ERROR][PID:2002814] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '34.201.133.117' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@34.201.133.117: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 13:49:32,514][ ERROR][PID:2002814] Re-try request for task on 'ResallocHost, ticket_id=2422664, hostname=34.201.133.117, name=aws_aarch64_eserved_prod_07133349_20260420_134635, requested_tags=['arch_aarch64', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 13:49:32,544][  INFO][PID:2002814] VM Release request
[2026-04-20 13:49:32,623][ ERROR][PID:2002814] Backend process error: Three host tried without success: {'3.91.156.23', '34.201.133.117', '98.94.0.75'}
[2026-04-20 13:49:32,626][WARNING][PID:2002814] Switching not-finished job state to 'failed'
[2026-04-20 13:49:32,629][  INFO][PID:2002814] Worker failed build, took 1358.3591890335083
[2026-04-20 13:49:32,631][  INFO][PID:2002814] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@redhat-et",
            "project_name": "flightctl-dev",
            "project_dirname": "flightctl-dev",
            "submitter": "packit",
            "ended_on": 1776692972.6262746,
            "started_on": 1776691614.2670856,
            "submitted_on": null,
            "status": 0,
            "chroot": "epel-9-aarch64",
            "arch": "aarch64",
            "buildroot_pkgs": [],
            "task_id": "10348578-epel-9-aarch64",
            "build_id": 10348578,
            "package_name": "flightctl",
            "package_version": "1.2.0~main~357~g17573020-1.20260420132041108055.main.444.g17573020",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@redhat-et/flightctl-dev/flightctl",
            "git_hash": "3b0ad23b73ff08a481a37cb97053ab934988ad75",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@redhat-et/flightctl-dev--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@redhat-et/flightctl-dev/epel-9-aarch64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_aarch64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@redhat-et/flightctl-dev",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@redhat-et/flightctl-dev",
            "result_dir": "10348578-flightctl",
            "built_packages": "",
            "id": 10348578,
            "mockchain_macros": {
                "copr_username": "@redhat-et",
                "copr_projectname": "flightctl-dev",
                "vendor": "Fedora Project COPR (@redhat-et/flightctl-dev)"
            }
        }
    ]
}
[2026-04-20 13:49:32,779][  INFO][PID:2002814] Sending fedora-messaging bus message in build.end
[2026-04-20 13:49:32,983][  INFO][PID:2002814] Compressing /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/builder-live.log by gzip
[2026-04-20 13:49:32,989][  INFO][PID:2002814] Running command 'gzip /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/builder-live.log' as PID 2391253
[2026-04-20 13:49:33,148][  INFO][PID:2002814] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/builder-live.log)
[2026-04-20 13:49:33,149][  INFO][PID:2002814] Compressing /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/backend.log by gzip
[2026-04-20 13:49:33,160][  INFO][PID:2002814] Running command 'gzip /var/lib/copr/public_html/results/@redhat-et/flightctl-dev/epel-9-aarch64/10348578-flightctl/backend.log' as PID 2391285