[2026-01-15 12:42:51,568][  INFO][PID:975726] Marking build as starting
[2026-01-15 12:42:51,670][  INFO][PID:975726] Checking that /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-15 12:42:51,672][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:42:51,674][  INFO][PID:975726] VM allocation process starts
[2026-01-15 12:42:51,732][  INFO][PID:975726] Trying to allocate VM: ResallocHost, ticket_id=831181, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 12:42:54,769][  INFO][PID:975726] Allocated host ResallocHost, ticket_id=831181, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01256861_20260115_121341, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 12:42:54,770][  INFO][PID:975726] Allocating ssh connection to builder
[2026-01-15 12:42:54,770][  INFO][PID:975726] Checking that builder machine is OK
[2026-01-15 12:42:55,887][  INFO][PID:975726] Running remote command: copr-builder-ready fedora-43-ppc64le
[2026-01-15 12:42:56,406][  INFO][PID:975726] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2026-01-15 12:42:56,407][  INFO][PID:975726] Filling build.info file with builder info
[2026-01-15 12:42:56,407][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:42:56,408][  INFO][PID:975726] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rivenirvana",
            "project_name": "kitty",
            "project_dirname": "kitty",
            "submitter": "https://api.github.com/users/rivenirvana",
            "ended_on": null,
            "started_on": 1768480976.4083757,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10014983-fedora-43-ppc64le",
            "build_id": 10014983,
            "package_name": "kitty",
            "package_version": "0.45.1.future.84.9ef934c-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rivenirvana/kitty/kitty",
            "git_hash": "f6c8d1e5a12996391a26328a613eebaa039c515c",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rivenirvana/kitty--https://api.github.com/users/rivenirvana",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rivenirvana/kitty/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rivenirvana/kitty",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rivenirvana/kitty",
            "result_dir": "10014983-kitty",
            "built_packages": "",
            "id": 10014983,
            "mockchain_macros": {
                "copr_username": "rivenirvana",
                "copr_projectname": "kitty",
                "vendor": "Fedora Project COPR (rivenirvana/kitty)"
            }
        }
    ]
}
[2026-01-15 12:42:56,516][  INFO][PID:975726] Sending fedora-messaging bus message in build.start
[2026-01-15 12:42:57,083][  INFO][PID:975726] Sending fedora-messaging bus message in chroot.start
[2026-01-15 12:42:57,116][  INFO][PID:975726] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10014983-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2026-01-15 12:42:58,067][  INFO][PID:975726] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c190' (ED25519) to the list of known hosts.


[2026-01-15 12:42:58,068][  INFO][PID:975726] Downloading the builder-live.log file, attempt 1
[2026-01-15 12:42:58,125][  INFO][PID:975726] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2026-01-15 12:43:03,106][  INFO][PID:975726] Periodic builder liveness probe: alive
[2026-01-15 12:43:03,106][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:08,108][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:13,109][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:18,110][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:23,111][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:28,112][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:33,113][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:38,114][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:43,115][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:48,116][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:53,117][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:43:58,118][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:03,120][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:08,121][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:13,122][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:18,123][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:23,124][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:28,126][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:33,133][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:38,134][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:43,135][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:48,136][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:53,138][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:44:58,139][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:03,142][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:08,143][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:13,144][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:18,145][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:23,146][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:28,147][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:33,148][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:38,150][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:43,151][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:48,152][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:53,153][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:45:58,154][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:03,155][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:08,168][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:13,169][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:18,170][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:23,171][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:28,173][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:33,174][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:38,175][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:43,176][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:48,177][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:53,178][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:46:58,179][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:03,180][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:08,181][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:13,182][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:18,183][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:23,184][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:28,185][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:33,186][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:38,187][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:43,188][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:48,189][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:53,190][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:47:58,191][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:03,192][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:08,193][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:13,194][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:18,196][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:23,197][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:28,198][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:33,199][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:38,200][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:43,201][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:48,202][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:53,204][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:48:58,206][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:03,207][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:08,208][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:13,209][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:18,210][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:23,211][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:28,212][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:33,213][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:38,214][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:43,216][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:48,217][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:53,218][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:49:58,219][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:03,220][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:08,221][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:13,222][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:18,226][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:23,227][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:28,227][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:33,229][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:38,229][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:43,231][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:48,235][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:53,236][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:50:58,237][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:03,238][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:08,239][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:13,240][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:18,241][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:23,242][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:28,243][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:33,244][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:38,245][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:43,251][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:48,252][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:53,253][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:51:58,254][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:03,255][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:08,256][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:13,264][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:18,265][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:23,266][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:28,267][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:33,268][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:38,269][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:43,270][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:48,271][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:53,272][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:52:58,273][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:03,280][  INFO][PID:975726] Periodic builder liveness probe: alive
[2026-01-15 12:53:03,281][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:08,282][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:13,283][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:18,284][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:23,285][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:28,286][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:33,287][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:38,288][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:43,289][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:48,290][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:53,291][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:53:58,292][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:03,293][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:08,294][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:13,295][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:18,297][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:23,298][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:28,299][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:33,300][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:38,301][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:43,302][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:48,303][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:53,306][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:54:56,588][  INFO][PID:975726] Downloading results from builder
[2026-01-15 12:54:56,699][  INFO][PID:975726] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty started
[2026-01-15 12:54:56,700][  INFO][PID:975726] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/ &> /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/build-10014983.rsync.log
[2026-01-15 12:55:56,905][  INFO][PID:975726] rsyncing finished.
[2026-01-15 12:55:56,915][ ERROR][PID:975726] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-15 12:55:56,916][ ERROR][PID:975726] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-15 12:56:06,916][  INFO][PID:975726] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty started
[2026-01-15 12:56:06,917][  INFO][PID:975726] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/ &> /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/build-10014983.rsync.log
[2026-01-15 12:57:07,244][  INFO][PID:975726] rsyncing finished.
[2026-01-15 12:57:07,244][ ERROR][PID:975726] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-15 12:57:07,244][ ERROR][PID:975726] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-15 12:57:17,245][  INFO][PID:975726] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty started
[2026-01-15 12:57:17,246][  INFO][PID:975726] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/ &> /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/build-10014983.rsync.log
[2026-01-15 12:58:17,333][  INFO][PID:975726] rsyncing finished.
[2026-01-15 12:58:17,334][ ERROR][PID:975726] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-15 12:58:17,335][ ERROR][PID:975726] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-15 12:58:27,336][ ERROR][PID:975726] Re-try request for task on 'ResallocHost, ticket_id=831181, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01256861_20260115_121341, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts
[2026-01-15 12:58:27,336][  INFO][PID:975726] Releasing VM back to pool
[2026-01-15 12:58:27,347][  INFO][PID:975726] Retry #1 (on other host)
[2026-01-15 12:58:27,348][  INFO][PID:975726] Checking that /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-15 12:58:27,348][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:58:27,349][  INFO][PID:975726] VM allocation process starts
[2026-01-15 12:58:27,364][  INFO][PID:975726] Trying to allocate VM: ResallocHost, ticket_id=831473, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 12:58:30,382][  INFO][PID:975726] Allocated host ResallocHost, ticket_id=831473, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_01257493_20260115_124454, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 12:58:30,383][  INFO][PID:975726] Allocating ssh connection to builder
[2026-01-15 12:58:30,384][  INFO][PID:975726] Checking that builder machine is OK
[2026-01-15 12:59:30,453][ ERROR][PID:975726] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14d port 22: Connection timed out

[2026-01-15 12:59:40,454][ ERROR][PID:975726] Re-try request for task on 'ResallocHost, ticket_id=831473, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_01257493_20260115_124454, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-15 12:59:40,455][  INFO][PID:975726] Releasing VM back to pool
[2026-01-15 12:59:40,465][  INFO][PID:975726] Retry #2 (on other host)
[2026-01-15 12:59:40,466][  INFO][PID:975726] Checking that /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-15 12:59:40,467][  INFO][PID:975726] Checking for cancel request
[2026-01-15 12:59:40,467][  INFO][PID:975726] VM allocation process starts
[2026-01-15 12:59:40,478][  INFO][PID:975726] Trying to allocate VM: ResallocHost, ticket_id=831501, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 12:59:43,506][  INFO][PID:975726] Allocated host ResallocHost, ticket_id=831501, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01256861_20260115_121341, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 12:59:43,508][  INFO][PID:975726] Allocating ssh connection to builder
[2026-01-15 12:59:43,511][  INFO][PID:975726] Checking that builder machine is OK
[2026-01-15 13:00:43,558][ ERROR][PID:975726] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c190 port 22: Connection timed out

[2026-01-15 13:00:53,559][ ERROR][PID:975726] Re-try request for task on 'ResallocHost, ticket_id=831501, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01256861_20260115_121341, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-15 13:00:53,559][  INFO][PID:975726] Releasing VM back to pool
[2026-01-15 13:00:53,568][  INFO][PID:975726] Retry #3 (on other host)
[2026-01-15 13:00:53,569][  INFO][PID:975726] Checking that /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-15 13:00:53,569][  INFO][PID:975726] Checking for cancel request
[2026-01-15 13:00:53,570][  INFO][PID:975726] VM allocation process starts
[2026-01-15 13:00:53,579][  INFO][PID:975726] Trying to allocate VM: ResallocHost, ticket_id=831528, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 13:00:56,595][  INFO][PID:975726] Allocated host ResallocHost, ticket_id=831528, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_01257500_20260115_124547, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-15 13:00:56,596][  INFO][PID:975726] Allocating ssh connection to builder
[2026-01-15 13:00:56,596][  INFO][PID:975726] Checking that builder machine is OK
[2026-01-15 13:00:57,599][  INFO][PID:975726] Running remote command: copr-builder-ready fedora-43-ppc64le
[2026-01-15 13:01:58,136][ ERROR][PID:975726] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18e port 22: Connection timed out

[2026-01-15 13:02:08,137][ ERROR][PID:975726] Re-try request for task on 'ResallocHost, ticket_id=831528, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_01257500_20260115_124547, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-15 13:02:08,138][  INFO][PID:975726] Releasing VM back to pool
[2026-01-15 13:02:08,146][ ERROR][PID:975726] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c190', '2620:52:6:1161:dead:beef:cafe:c18e', '2620:52:6:1161:dead:beef:cafe:c14d'}
[2026-01-15 13:02:08,147][WARNING][PID:975726] Switching not-finished job state to 'failed'
[2026-01-15 13:02:08,147][  INFO][PID:975726] Worker failed build, took 1151.7385966777802
[2026-01-15 13:02:08,147][  INFO][PID:975726] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rivenirvana",
            "project_name": "kitty",
            "project_dirname": "kitty",
            "submitter": "https://api.github.com/users/rivenirvana",
            "ended_on": 1768482128.1469724,
            "started_on": 1768480976.4083757,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10014983-fedora-43-ppc64le",
            "build_id": 10014983,
            "package_name": "kitty",
            "package_version": "0.45.1.future.84.9ef934c-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rivenirvana/kitty/kitty",
            "git_hash": "f6c8d1e5a12996391a26328a613eebaa039c515c",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rivenirvana/kitty--https://api.github.com/users/rivenirvana",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rivenirvana/kitty/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rivenirvana/kitty",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rivenirvana/kitty",
            "result_dir": "10014983-kitty",
            "built_packages": "",
            "id": 10014983,
            "mockchain_macros": {
                "copr_username": "rivenirvana",
                "copr_projectname": "kitty",
                "vendor": "Fedora Project COPR (rivenirvana/kitty)"
            }
        }
    ]
}
[2026-01-15 13:02:08,207][  INFO][PID:975726] Sending fedora-messaging bus message in build.end
[2026-01-15 13:02:08,235][  INFO][PID:975726] Compressing /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/builder-live.log by gzip
[2026-01-15 13:02:08,237][  INFO][PID:975726] Running command 'gzip /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/builder-live.log' as PID 1077569
[2026-01-15 13:02:08,317][  INFO][PID:975726] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/builder-live.log)
[2026-01-15 13:02:08,317][  INFO][PID:975726] Compressing /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/backend.log by gzip
[2026-01-15 13:02:08,318][  INFO][PID:975726] Running command 'gzip /var/lib/copr/public_html/results/rivenirvana/kitty/fedora-43-ppc64le/10014983-kitty/backend.log' as PID 1077587