[2025-07-10 16:14:35,998][  INFO][PID:3793588] Marking build as starting
[2025-07-10 16:14:36,047][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:14:36,048][  INFO][PID:3793588] VM allocation process starts
[2025-07-10 16:14:36,070][  INFO][PID:3793588] Trying to allocate VM: ResallocHost, ticket_id=3881715, requested_tags=['copr_builder', 'arch_i386']
[2025-07-10 16:14:41,073][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:14:46,074][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:14:51,076][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:14:56,077][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:01,085][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:06,088][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:11,090][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:16,091][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:21,093][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:26,097][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:31,100][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:36,102][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:41,104][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:46,105][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:51,107][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:15:56,108][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:01,109][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:06,113][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:11,114][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:16,117][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:21,120][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:26,131][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:31,132][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:36,134][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:41,136][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:46,137][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:51,140][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:16:56,143][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:01,145][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:06,146][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:11,148][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:16,149][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:21,151][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:26,154][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:31,156][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:36,158][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:41,159][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:46,161][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:51,163][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:17:56,165][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:01,167][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:06,168][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:11,171][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:16,173][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:21,176][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:26,177][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:31,179][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:36,181][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:41,182][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:46,183][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:51,184][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:54,332][  INFO][PID:3793588] Allocated host ResallocHost, ticket_id=3881715, hostname=54.167.252.195, name=aws_x86_64_spot_prod_05262157_20250710_161633, requested_tags=['copr_builder', 'arch_i386']
[2025-07-10 16:18:54,333][  INFO][PID:3793588] Allocating ssh connection to builder
[2025-07-10 16:18:54,334][  INFO][PID:3793588] Checking that builder machine is OK
[2025-07-10 16:18:54,809][  INFO][PID:3793588] Running remote command: copr-builder-ready fedora-42-i386
[2025-07-10 16:18:55,001][  INFO][PID:3793588] Red Hat subscription not needed for fedora-42-i386
Builder is ready to be used

[2025-07-10 16:18:55,002][  INFO][PID:3793588] Filling build.info file with builder info
[2025-07-10 16:18:55,004][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:18:55,005][  INFO][PID:3793588] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 36000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "gloriouseggroll",
            "project_name": "nobara-42",
            "project_dirname": "nobara-42",
            "submitter": "lionheartp",
            "ended_on": null,
            "started_on": 1752164335.0050867,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-i386",
            "arch": "i386",
            "buildroot_pkgs": [],
            "task_id": "9263436-fedora-42-i386",
            "build_id": 9263436,
            "package_name": "mesa-vulkan-drivers-git",
            "package_version": "25.2.0-10.git.20250710.d45f375",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/gloriouseggroll/nobara-42/mesa-vulkan-drivers-git",
            "git_hash": "68f30cf871d36188e92f5260344f3cd1681da640",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "gloriouseggroll/nobara-42--lionheartp",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/gloriouseggroll/nobara-42/fedora-42-i386/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_i386"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/gloriouseggroll/nobara-42",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/gloriouseggroll/nobara-42",
            "result_dir": "09263436-mesa-vulkan-drivers-git",
            "built_packages": "",
            "id": 9263436,
            "mockchain_macros": {
                "copr_username": "gloriouseggroll",
                "copr_projectname": "nobara-42",
                "vendor": "Fedora Project COPR (gloriouseggroll/nobara-42)"
            }
        }
    ]
}
[2025-07-10 16:18:55,034][  INFO][PID:3793588] Sending fedora-messaging bus message in build.start
[2025-07-10 16:18:55,906][  INFO][PID:3793588] Sending fedora-messaging bus message in chroot.start
[2025-07-10 16:18:55,936][  INFO][PID:3793588] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9263436-fedora-42-i386 --chroot fedora-42-i386 --detached
[2025-07-10 16:18:56,271][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 1
[2025-07-10 16:18:56,273][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.167.252.195 copr-rpmbuild-log
[2025-07-10 16:19:01,279][  INFO][PID:3793588] Periodic builder liveness probe: alive
[2025-07-10 16:19:01,280][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:06,281][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:11,282][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:16,283][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:21,285][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:26,286][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:31,287][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:36,289][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:41,290][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:46,291][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:51,293][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:19:56,294][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:01,295][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:06,297][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:11,298][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:16,299][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:21,305][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:26,306][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:31,307][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:36,308][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:41,310][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:46,311][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:51,312][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:20:56,314][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:01,315][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:06,317][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:11,318][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:16,319][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:21,320][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:26,322][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:31,323][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:36,324][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:41,325][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:46,327][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:51,328][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:21:56,329][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:01,330][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:06,331][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:11,332][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:16,333][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:21,334][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:26,335][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:31,336][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:36,337][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:41,338][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:46,339][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:51,340][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:22:56,342][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:01,343][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:06,344][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:08,476][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:23:11,345][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:16,347][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:18,477][WARNING][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 16:23:21,348][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:26,349][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:28,478][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 2
[2025-07-10 16:23:28,481][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.167.252.195 copr-rpmbuild-log
[2025-07-10 16:23:31,350][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:36,351][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:41,352][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:46,353][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:51,354][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:23:56,355][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:01,356][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:06,357][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:11,358][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:16,360][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:21,361][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:26,362][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:28,510][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:24:31,363][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:36,365][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:38,511][WARNING][PID:3793588] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 16:24:41,366][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:46,367][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:48,512][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 3
[2025-07-10 16:24:48,513][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.167.252.195 copr-rpmbuild-log
[2025-07-10 16:24:51,368][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:24:56,369][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:01,370][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:06,371][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:11,372][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:16,373][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:21,374][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:26,375][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:31,376][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:36,377][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:41,382][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:46,385][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:48,581][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:25:51,386][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:56,387][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:25:58,583][WARNING][PID:3793588] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 16:26:01,388][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:06,389][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:08,584][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 4
[2025-07-10 16:26:08,585][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.167.252.195 copr-rpmbuild-log
[2025-07-10 16:26:11,390][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:16,391][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:21,393][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:26,399][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:31,400][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:36,401][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:41,402][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:46,403][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:51,405][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:26:56,407][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:01,410][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:06,412][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:08,653][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:27:11,413][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:16,415][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:18,655][ ERROR][PID:3793588] Giving up for unstable SSH, failures: 1752164598.477641, 1752164678.5112097, 1752164758.5837836, 1752164838.6557143
[2025-07-10 16:27:18,657][ ERROR][PID:3793588] Re-try request for task on 'ResallocHost, ticket_id=3881715, hostname=54.167.252.195, name=aws_x86_64_spot_prod_05262157_20250710_161633, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-10 16:27:18,657][  INFO][PID:3793588] Releasing VM back to pool
[2025-07-10 16:27:18,669][  INFO][PID:3793588] Retry #1 (on other host)
[2025-07-10 16:27:18,670][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:18,672][  INFO][PID:3793588] VM allocation process starts
[2025-07-10 16:27:18,732][  INFO][PID:3793588] Trying to allocate VM: ResallocHost, ticket_id=3881912, requested_tags=['copr_builder', 'arch_i386']
[2025-07-10 16:27:21,797][  INFO][PID:3793588] Allocated host ResallocHost, ticket_id=3881912, hostname=3.85.51.38, name=aws_x86_64_spot_prod_05262387_20250710_162542, requested_tags=['copr_builder', 'arch_i386']
[2025-07-10 16:27:21,798][  INFO][PID:3793588] Allocating ssh connection to builder
[2025-07-10 16:27:21,798][  INFO][PID:3793588] Checking that builder machine is OK
[2025-07-10 16:27:22,311][  INFO][PID:3793588] Running remote command: copr-builder-ready fedora-42-i386
[2025-07-10 16:27:22,564][  INFO][PID:3793588] Red Hat subscription not needed for fedora-42-i386
Builder is ready to be used

[2025-07-10 16:27:22,564][  INFO][PID:3793588] Filling build.info file with builder info
[2025-07-10 16:27:22,572][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:22,573][  INFO][PID:3793588] Not re-notifying FE and msg buses for the new host.
[2025-07-10 16:27:22,574][  INFO][PID:3793588] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9263436-fedora-42-i386 --chroot fedora-42-i386 --detached
[2025-07-10 16:27:22,968][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 1
[2025-07-10 16:27:22,974][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.85.51.38 copr-rpmbuild-log
[2025-07-10 16:27:27,971][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:32,981][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:37,982][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:42,986][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:47,988][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:52,990][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:27:57,991][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:02,993][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:07,994][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:12,995][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:17,996][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:23,002][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:28,004][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:33,006][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:38,008][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:43,009][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:48,010][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:53,013][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:28:58,017][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:03,022][  INFO][PID:3793588] Periodic builder liveness probe: alive
[2025-07-10 16:29:03,023][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:08,024][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:13,025][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:18,027][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:23,028][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:28,029][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:33,030][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:38,031][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:43,032][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:48,034][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:53,035][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:29:58,037][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:03,038][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:08,040][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:13,041][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:18,046][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:23,047][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:28,048][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:33,050][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:38,051][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:43,052][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:48,053][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:53,055][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:30:58,056][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:03,057][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:08,058][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:13,059][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:18,060][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:23,061][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:28,062][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:33,064][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:38,065][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:43,066][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:48,068][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:53,069][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:31:58,070][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:03,071][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:08,072][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:13,073][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:18,074][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:23,075][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:28,076][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:33,077][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:38,078][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:43,079][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:48,081][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:53,082][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:32:58,083][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:03,084][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:08,085][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:13,086][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:18,087][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:23,089][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:28,090][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:33,092][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:38,094][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:43,095][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:48,096][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:53,097][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:33:58,098][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:03,100][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:08,101][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:13,102][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:18,103][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:23,104][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:28,107][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:29,267][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:34:33,109][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:38,110][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:39,273][WARNING][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 16:34:43,112][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:48,113][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:49,274][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 2
[2025-07-10 16:34:49,279][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.85.51.38 copr-rpmbuild-log
[2025-07-10 16:34:53,114][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:34:58,115][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:03,116][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:08,117][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:13,118][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:18,119][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:23,120][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:28,121][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:33,122][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:38,124][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:43,125][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:48,126][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:49,348][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:35:53,127][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:58,128][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:35:59,352][WARNING][PID:3793588] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 16:36:03,129][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:08,130][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:09,352][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 3
[2025-07-10 16:36:09,354][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.85.51.38 copr-rpmbuild-log
[2025-07-10 16:36:13,131][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:18,132][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:23,134][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:28,135][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:33,136][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:38,137][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:43,138][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:48,139][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:53,141][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:36:58,142][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:03,143][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:08,144][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:09,421][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:37:13,145][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:18,147][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:19,425][WARNING][PID:3793588] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 16:37:23,148][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:28,149][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:29,426][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 4
[2025-07-10 16:37:29,427][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.85.51.38 copr-rpmbuild-log
[2025-07-10 16:37:33,151][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:38,152][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:43,153][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:48,154][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:53,157][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:37:58,161][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:03,162][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:08,163][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:13,164][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:18,165][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:23,167][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:28,168][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:29,495][ ERROR][PID:3793588] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 16:38:33,169][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:38,170][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:39,499][ ERROR][PID:3793588] Giving up for unstable SSH, failures: 1752165279.2737072, 1752165359.3521502, 1752165439.425476, 1752165519.4998221
[2025-07-10 16:38:39,500][ ERROR][PID:3793588] Re-try request for task on 'ResallocHost, ticket_id=3881912, hostname=3.85.51.38, name=aws_x86_64_spot_prod_05262387_20250710_162542, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-10 16:38:39,501][  INFO][PID:3793588] Releasing VM back to pool
[2025-07-10 16:38:39,509][  INFO][PID:3793588] Retry #2 (on other host)
[2025-07-10 16:38:39,510][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:39,510][  INFO][PID:3793588] VM allocation process starts
[2025-07-10 16:38:39,565][  INFO][PID:3793588] Trying to allocate VM: ResallocHost, ticket_id=3882059, requested_tags=['copr_builder', 'arch_i386']
[2025-07-10 16:38:42,609][  INFO][PID:3793588] Allocated host ResallocHost, ticket_id=3882059, hostname=54.162.182.246, name=aws_x86_64_normalreserved_prod_05262741_20250710_163713, requested_tags=['copr_builder', 'arch_i386']
[2025-07-10 16:38:42,609][  INFO][PID:3793588] Allocating ssh connection to builder
[2025-07-10 16:38:42,610][  INFO][PID:3793588] Checking that builder machine is OK
[2025-07-10 16:38:43,117][  INFO][PID:3793588] Running remote command: copr-builder-ready fedora-42-i386
[2025-07-10 16:38:43,368][  INFO][PID:3793588] Red Hat subscription not needed for fedora-42-i386
Builder is ready to be used

[2025-07-10 16:38:43,369][  INFO][PID:3793588] Filling build.info file with builder info
[2025-07-10 16:38:43,372][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:43,373][  INFO][PID:3793588] Not re-notifying FE and msg buses for the new host.
[2025-07-10 16:38:43,373][  INFO][PID:3793588] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9263436-fedora-42-i386 --chroot fedora-42-i386 --detached
[2025-07-10 16:38:43,763][  INFO][PID:3793588] Downloading the builder-live.log file, attempt 1
[2025-07-10 16:38:43,766][  INFO][PID:3793588] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.162.182.246 copr-rpmbuild-log
[2025-07-10 16:38:48,764][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:53,765][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:38:58,766][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:03,772][  INFO][PID:3793588] Periodic builder liveness probe: alive
[2025-07-10 16:39:03,772][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:08,773][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:13,774][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:18,775][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:23,776][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:28,778][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:33,779][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:38,780][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:43,781][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:48,782][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:53,784][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:39:58,785][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:03,786][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:08,790][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:13,791][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:18,794][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:23,796][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:28,801][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:33,815][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:38,817][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:43,818][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:48,820][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:53,825][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:40:58,827][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:03,829][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:08,832][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:13,833][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:18,834][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:23,836][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:28,837][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:33,838][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:38,839][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:43,840][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:48,841][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:53,842][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:41:58,844][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:03,845][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:08,845][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:13,846][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:18,847][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:23,848][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:28,849][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:33,850][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:38,851][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:43,852][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:48,853][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:53,855][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:42:58,856][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:03,857][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:08,858][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:13,859][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:18,860][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:23,861][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:28,862][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:33,863][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:38,864][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:43,865][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:48,866][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:53,867][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:43:58,868][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:03,869][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:08,870][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:13,871][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:18,872][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:23,874][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:28,875][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:33,875][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:38,876][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:43,877][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:48,878][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:53,879][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:44:58,880][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:03,881][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:08,882][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:13,883][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:18,884][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:23,885][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:28,886][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:33,887][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:38,894][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:43,895][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:48,896][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:53,897][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:45:58,897][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:03,898][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:08,899][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:13,900][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:18,901][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:23,902][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:28,903][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:33,904][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:38,905][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:43,906][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:48,907][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:53,908][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:46:58,909][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:03,910][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:08,911][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:13,912][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:18,913][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:23,914][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:28,914][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:33,915][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:38,916][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:43,917][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:48,919][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:53,920][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:47:58,921][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:03,922][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:08,923][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:13,924][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:18,925][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:23,926][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:28,927][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:33,928][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:38,929][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:43,930][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:48,931][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:53,932][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:48:58,933][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:03,939][  INFO][PID:3793588] Periodic builder liveness probe: alive
[2025-07-10 16:49:03,939][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:08,940][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:13,941][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:18,942][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:23,943][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:28,944][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:33,945][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:38,947][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:43,949][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:48,950][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:53,951][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:49:58,952][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:03,953][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:08,954][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:13,955][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:18,956][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:23,957][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:28,959][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:33,960][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:38,961][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:43,962][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:48,963][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:53,964][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:50:58,965][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:03,966][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:08,967][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:13,968][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:18,970][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:23,971][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:28,972][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:33,973][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:38,974][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:43,975][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:48,975][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:53,976][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:51:58,977][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:03,978][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:08,979][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:13,980][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:18,981][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:23,982][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:28,983][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:33,985][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:38,986][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:43,987][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:48,988][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:53,989][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:52:58,990][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:03,991][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:08,992][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:13,993][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:18,995][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:23,997][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:28,998][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:33,999][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:39,001][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:44,002][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:49,003][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:54,004][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:53:59,006][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:04,007][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:09,008][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:14,009][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:19,010][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:24,012][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:29,013][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:34,015][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:39,016][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:44,017][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:49,018][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:54,019][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:54:59,020][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:04,021][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:09,022][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:14,023][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:19,025][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:24,026][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:29,027][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:34,028][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:39,029][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:44,030][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:49,031][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:54,032][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:55:59,033][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:04,034][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:09,036][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:14,037][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:19,038][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:24,039][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:29,040][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:34,041][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:39,042][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:44,043][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:49,044][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:54,046][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:56:59,047][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:57:04,048][  INFO][PID:3793588] Checking for cancel request
[2025-07-10 16:57:06,888][  INFO][PID:3793588] Downloading results from builder
[2025-07-10 16:57:06,889][  INFO][PID:3793588] rsyncing of mockbuilder@54.162.182.246:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git started
[2025-07-10 16:57:06,890][  INFO][PID:3793588] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.162.182.246:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/ &> /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/build-09263436.rsync.log
[2025-07-10 16:57:07,940][  INFO][PID:3793588] rsyncing finished.
[2025-07-10 16:57:07,940][  INFO][PID:3793588] Releasing VM back to pool
[2025-07-10 16:57:07,949][  INFO][PID:3793588] Searching for 'success' file in resultdir
[2025-07-10 16:57:07,950][  INFO][PID:3793588] Going to sign pkgs from source: 9263436-fedora-42-i386 in chroot: /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386
[2025-07-10 16:57:07,951][  INFO][PID:3793588] Calling '/bin/sign -u gloriouseggroll#nobara-42@copr.fedorahosted.org -p' (attempt #1)
[2025-07-10 16:57:08,279][  INFO][PID:3793588] Calling '/bin/sign -4 -h sha256 -u gloriouseggroll#nobara-42@copr.fedorahosted.org -r /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-debuginfo-25.2.0-10.git.20250710.d45f375.fc42.i686.rpm' (attempt #1)
[2025-07-10 16:57:10,643][  INFO][PID:3793588] signed rpm: /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-debuginfo-25.2.0-10.git.20250710.d45f375.fc42.i686.rpm
[2025-07-10 16:57:10,644][  INFO][PID:3793588] Calling '/bin/sign -4 -h sha256 -u gloriouseggroll#nobara-42@copr.fedorahosted.org -r /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-25.2.0-10.git.20250710.d45f375.fc42.i686.rpm' (attempt #1)
[2025-07-10 16:57:11,607][  INFO][PID:3793588] signed rpm: /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-25.2.0-10.git.20250710.d45f375.fc42.i686.rpm
[2025-07-10 16:57:11,608][  INFO][PID:3793588] Calling '/bin/sign -4 -h sha256 -u gloriouseggroll#nobara-42@copr.fedorahosted.org -r /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-debugsource-25.2.0-10.git.20250710.d45f375.fc42.i686.rpm' (attempt #1)
[2025-07-10 16:57:12,648][  INFO][PID:3793588] signed rpm: /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-debugsource-25.2.0-10.git.20250710.d45f375.fc42.i686.rpm
[2025-07-10 16:57:12,648][  INFO][PID:3793588] Calling '/bin/sign -4 -h sha256 -u gloriouseggroll#nobara-42@copr.fedorahosted.org -r /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-25.2.0-10.git.20250710.d45f375.fc42.src.rpm' (attempt #1)
[2025-07-10 16:57:14,571][  INFO][PID:3793588] signed rpm: /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/mesa-vulkan-drivers-git-25.2.0-10.git.20250710.d45f375.fc42.src.rpm
[2025-07-10 16:57:14,571][  INFO][PID:3793588] Sign done
[2025-07-10 16:57:14,572][  INFO][PID:3793588] Incremental createrepo run, adding 09263436-mesa-vulkan-drivers-git into https://download.copr.fedorainfracloud.org/results/gloriouseggroll/nobara-42/fedora-42-i386, (auto-create-repo=True)
[2025-07-10 16:57:14,573][  INFO][PID:3793588] Running command 'copr-repo --batched /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386 --add 09263436-mesa-vulkan-drivers-git --no-appstream-metadata' as PID 4044490
[2025-07-10 16:57:15,821][  INFO][PID:3793588] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386 --add 09263436-mesa-vulkan-drivers-git --no-appstream-metadata)
[2025-07-10 16:57:15,822][  INFO][PID:3793588] Getting build details
[2025-07-10 16:57:15,822][  INFO][PID:3793588] Listing built binary packages in /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git
[2025-07-10 16:57:15,822][  INFO][PID:3793588] Built packages:
['mesa-vulkan-drivers-git-debugsource 25.2.0', 'mesa-vulkan-drivers-git 25.2.0', 'mesa-vulkan-drivers-git-debuginfo 25.2.0']
[2025-07-10 16:57:15,823][  INFO][PID:3793588] build details: {'built_packages': 'mesa-vulkan-drivers-git-debugsource 25.2.0\nmesa-vulkan-drivers-git 25.2.0\nmesa-vulkan-drivers-git-debuginfo 25.2.0'}
[2025-07-10 16:57:15,823][  INFO][PID:3793588] Retrieving pubkey
[2025-07-10 16:57:15,823][  INFO][PID:3793588] Calling '/bin/sign -u gloriouseggroll#nobara-42@copr.fedorahosted.org -p' (attempt #1)
[2025-07-10 16:57:16,152][  INFO][PID:3793588] Added pubkey for user gloriouseggroll project nobara-42 into: /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/pubkey.gpg
[2025-07-10 16:57:16,152][  INFO][PID:3793588] Finished build: id=9263436 failed=False timeout=36000 destdir=/var/lib/copr/public_html/results/gloriouseggroll/nobara-42 chroot=fedora-42-i386 
[2025-07-10 16:57:16,154][  INFO][PID:3793588] Worker succeeded build, took 1112.7811346054077
[2025-07-10 16:57:16,155][  INFO][PID:3793588] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 36000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "gloriouseggroll",
            "project_name": "nobara-42",
            "project_dirname": "nobara-42",
            "submitter": "lionheartp",
            "ended_on": 1752166636.1543598,
            "started_on": 1752165523.3732252,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-42-i386",
            "arch": "i386",
            "buildroot_pkgs": [],
            "task_id": "9263436-fedora-42-i386",
            "build_id": 9263436,
            "package_name": "mesa-vulkan-drivers-git",
            "package_version": "25.2.0-10.git.20250710.d45f375",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/gloriouseggroll/nobara-42/mesa-vulkan-drivers-git",
            "git_hash": "68f30cf871d36188e92f5260344f3cd1681da640",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "gloriouseggroll/nobara-42--lionheartp",
            "results": {
                "packages": [
                    {
                        "name": "mesa-vulkan-drivers-git-debugsource",
                        "epoch": null,
                        "version": "25.2.0",
                        "release": "10.git.20250710.d45f375.fc42",
                        "arch": "i686"
                    },
                    {
                        "name": "mesa-vulkan-drivers-git",
                        "epoch": null,
                        "version": "25.2.0",
                        "release": "10.git.20250710.d45f375.fc42",
                        "arch": "i686"
                    },
                    {
                        "name": "mesa-vulkan-drivers-git",
                        "epoch": null,
                        "version": "25.2.0",
                        "release": "10.git.20250710.d45f375.fc42",
                        "arch": "src"
                    },
                    {
                        "name": "mesa-vulkan-drivers-git-debuginfo",
                        "epoch": null,
                        "version": "25.2.0",
                        "release": "10.git.20250710.d45f375.fc42",
                        "arch": "i686"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/gloriouseggroll/nobara-42/fedora-42-i386/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_i386"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/gloriouseggroll/nobara-42",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/gloriouseggroll/nobara-42",
            "result_dir": "09263436-mesa-vulkan-drivers-git",
            "built_packages": "mesa-vulkan-drivers-git-debugsource 25.2.0\nmesa-vulkan-drivers-git 25.2.0\nmesa-vulkan-drivers-git-debuginfo 25.2.0",
            "id": 9263436,
            "mockchain_macros": {
                "copr_username": "gloriouseggroll",
                "copr_projectname": "nobara-42",
                "vendor": "Fedora Project COPR (gloriouseggroll/nobara-42)"
            }
        }
    ]
}
[2025-07-10 16:57:16,198][  INFO][PID:3793588] Sending fedora-messaging bus message in build.end
[2025-07-10 16:57:16,223][  INFO][PID:3793588] Compressing /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/builder-live.log by gzip
[2025-07-10 16:57:16,224][  INFO][PID:3793588] Running command 'gzip /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/builder-live.log' as PID 4044623
[2025-07-10 16:57:16,360][  INFO][PID:3793588] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/builder-live.log)
[2025-07-10 16:57:16,361][  INFO][PID:3793588] Compressing /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/backend.log by gzip
[2025-07-10 16:57:16,362][  INFO][PID:3793588] Running command 'gzip /var/lib/copr/public_html/results/gloriouseggroll/nobara-42/fedora-42-i386/09263436-mesa-vulkan-drivers-git/backend.log' as PID 4044641