[2026-01-05 11:26:40,663][  INFO][PID:348122] Marking build as starting
[2026-01-05 11:26:40,792][  INFO][PID:348122] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-05 11:26:40,811][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:26:40,812][  INFO][PID:348122] VM allocation process starts
[2026-01-05 11:26:40,841][  INFO][PID:348122] Trying to allocate VM: ResallocHost, ticket_id=659004, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:26:43,908][  INFO][PID:348122] Allocated host ResallocHost, ticket_id=659004, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00920877_20260105_105030, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:26:43,908][  INFO][PID:348122] Allocating ssh connection to builder
[2026-01-05 11:26:43,911][  INFO][PID:348122] Checking that builder machine is OK
[2026-01-05 11:27:43,986][ ERROR][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c148 port 22: Connection timed out

[2026-01-05 11:27:53,986][ ERROR][PID:348122] Re-try request for task on 'ResallocHost, ticket_id=659004, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00920877_20260105_105030, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-05 11:27:53,987][  INFO][PID:348122] Releasing VM back to pool
[2026-01-05 11:27:53,997][  INFO][PID:348122] Retry #1 (on other host)
[2026-01-05 11:27:53,998][  INFO][PID:348122] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-05 11:27:53,998][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:27:53,999][  INFO][PID:348122] VM allocation process starts
[2026-01-05 11:27:54,009][  INFO][PID:348122] Trying to allocate VM: ResallocHost, ticket_id=659028, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:27:57,023][  INFO][PID:348122] Allocated host ResallocHost, ticket_id=659028, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00921184_20260105_112139, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:27:57,023][  INFO][PID:348122] Allocating ssh connection to builder
[2026-01-05 11:27:57,024][  INFO][PID:348122] Checking that builder machine is OK
[2026-01-05 11:27:57,894][  INFO][PID:348122] Running remote command: copr-builder-ready fedora-43-ppc64le
[2026-01-05 11:27:58,372][  INFO][PID:348122] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2026-01-05 11:27:58,373][  INFO][PID:348122] Filling build.info file with builder info
[2026-01-05 11:27:58,374][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:27:58,374][  INFO][PID:348122] Not re-notifying FE and msg buses for the new host.
[2026-01-05 11:27:58,375][  INFO][PID:348122] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9975470-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2026-01-05 11:27:59,331][  INFO][PID:348122] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts.


[2026-01-05 11:27:59,332][  INFO][PID:348122] Downloading the builder-live.log file, attempt 1
[2026-01-05 11:27:59,333][  INFO][PID:348122] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2026-01-05 11:28:04,338][  INFO][PID:348122] Periodic builder liveness probe: alive
[2026-01-05 11:28:04,339][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:09,339][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:14,341][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:19,342][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:24,346][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:29,347][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:34,349][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:39,350][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:44,352][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:49,353][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:54,354][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:28:59,355][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:04,356][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:09,357][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:14,358][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:19,359][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:24,360][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:29,365][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:34,366][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:39,366][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:44,368][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:49,369][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:54,371][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:29:59,372][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:04,373][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:08,369][ ERROR][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-05 11:30:09,374][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:14,375][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:18,370][WARNING][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-05 11:30:19,375][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:24,376][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:28,371][  INFO][PID:348122] Downloading the builder-live.log file, attempt 2
[2026-01-05 11:30:28,372][  INFO][PID:348122] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2026-01-05 11:30:29,377][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:34,379][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:39,380][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:44,381][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:49,382][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:54,383][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:30:59,384][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:04,385][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:09,386][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:14,387][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:19,388][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:24,389][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:28,439][ ERROR][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-05 11:31:29,390][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:34,391][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:38,450][WARNING][PID:348122] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-05 11:31:39,392][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:44,393][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:48,451][  INFO][PID:348122] Downloading the builder-live.log file, attempt 3
[2026-01-05 11:31:48,452][  INFO][PID:348122] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2026-01-05 11:31:49,394][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:54,395][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:31:59,396][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:04,397][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:09,398][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:14,399][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:19,400][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:24,401][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:29,402][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:34,410][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:39,411][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:44,412][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:48,522][ ERROR][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-05 11:32:49,417][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:54,419][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:32:58,539][WARNING][PID:348122] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-05 11:32:59,420][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:04,421][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:08,541][  INFO][PID:348122] Downloading the builder-live.log file, attempt 4
[2026-01-05 11:33:08,543][  INFO][PID:348122] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2026-01-05 11:33:09,422][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:14,426][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:19,427][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:24,428][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:29,430][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:34,431][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:39,434][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:44,435][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:49,438][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:54,442][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:33:59,445][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:04,446][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:08,610][ ERROR][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-05 11:34:09,448][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:14,449][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:18,628][ ERROR][PID:348122] Giving up for unstable SSH, failures: 1767612618.3706472, 1767612698.4503076, 1767612778.5394757, 1767612858.6286585
[2026-01-05 11:34:18,629][ ERROR][PID:348122] Re-try request for task on 'ResallocHost, ticket_id=659028, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00921184_20260105_112139, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-01-05 11:34:18,630][  INFO][PID:348122] Releasing VM back to pool
[2026-01-05 11:34:18,687][  INFO][PID:348122] Retry #2 (on other host)
[2026-01-05 11:34:18,687][  INFO][PID:348122] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/repodata/repomd.xml exists
[2026-01-05 11:34:18,688][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:18,688][  INFO][PID:348122] VM allocation process starts
[2026-01-05 11:34:18,705][  INFO][PID:348122] Trying to allocate VM: ResallocHost, ticket_id=659147, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:34:21,721][  INFO][PID:348122] Allocated host ResallocHost, ticket_id=659147, hostname=2620:52:6:1161:dead:beef:cafe:c14d, name=vmhost_p09_03_prod_00920904_20260105_105413, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:34:21,722][  INFO][PID:348122] Allocating ssh connection to builder
[2026-01-05 11:34:21,723][  INFO][PID:348122] Checking that builder machine is OK
[2026-01-05 11:34:22,721][  INFO][PID:348122] Running remote command: copr-builder-ready fedora-43-ppc64le
[2026-01-05 11:34:23,203][  INFO][PID:348122] Red Hat subscription not needed for fedora-43-ppc64le
Builder is ready to be used

[2026-01-05 11:34:23,203][  INFO][PID:348122] Filling build.info file with builder info
[2026-01-05 11:34:23,218][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:23,219][  INFO][PID:348122] Not re-notifying FE and msg buses for the new host.
[2026-01-05 11:34:23,219][  INFO][PID:348122] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9975470-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached
[2026-01-05 11:34:24,150][  INFO][PID:348122] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14d' (ED25519) to the list of known hosts.


[2026-01-05 11:34:24,151][  INFO][PID:348122] Downloading the builder-live.log file, attempt 1
[2026-01-05 11:34:24,155][  INFO][PID:348122] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14d copr-rpmbuild-log
[2026-01-05 11:34:29,152][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:34,198][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:39,229][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:44,230][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:49,232][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:54,233][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:34:59,234][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:04,235][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:09,236][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:14,238][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:19,239][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:24,241][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:29,242][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:34,242][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:39,244][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:44,245][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:49,246][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:54,247][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:35:59,248][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:04,249][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:09,249][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:14,251][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:19,252][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:24,253][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:29,254][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:34,255][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:39,256][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:44,257][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:49,258][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:54,259][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:36:59,260][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:04,262][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:09,264][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:14,265][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:19,266][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:24,267][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:29,268][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:34,270][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:39,271][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:44,273][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:49,274][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:54,275][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:37:59,276][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:04,277][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:09,286][  INFO][PID:348122] Periodic builder liveness probe: alive
[2026-01-05 11:38:09,287][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:14,288][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:19,289][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:24,290][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:29,291][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:34,292][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:39,293][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:44,294][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:49,295][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:54,296][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:38:59,297][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:04,298][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:09,299][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:14,300][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:19,301][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:24,302][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:29,303][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:34,304][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:39,305][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:44,306][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:49,307][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:54,308][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:39:59,309][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:04,309][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:09,310][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:14,311][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:19,313][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:24,314][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:29,314][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:34,315][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:39,316][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:44,317][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:49,329][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:54,330][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:40:59,331][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:04,332][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:09,333][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:14,335][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:19,413][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:24,414][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:29,415][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:34,416][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:39,417][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:44,419][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:49,420][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:54,421][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:41:59,422][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:04,435][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:09,436][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:14,436][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:19,437][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:24,438][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:29,439][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:34,440][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:39,441][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:44,442][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:49,443][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:54,444][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:42:59,445][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:04,446][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:09,447][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:14,448][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:19,449][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:24,450][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:29,451][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:34,452][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:39,453][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:44,454][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:49,455][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:54,456][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:43:59,457][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:04,458][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:09,459][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:14,460][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:19,461][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:24,462][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:29,463][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:34,464][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:39,465][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:44,466][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:49,475][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:54,476][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:44:59,477][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:04,478][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:09,479][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:14,480][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:19,481][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:24,482][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:29,483][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:34,484][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:39,485][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:44,486][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:49,487][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:54,488][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:45:59,489][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:04,489][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:09,491][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:14,492][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:19,493][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:24,493][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:29,494][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:34,495][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:39,498][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:44,499][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:49,500][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:54,501][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:46:59,502][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:04,503][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:09,504][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:14,505][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:19,506][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:24,507][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:29,507][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:34,508][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:39,509][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:44,510][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:49,511][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:54,512][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:47:59,514][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:04,515][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:09,525][  INFO][PID:348122] Periodic builder liveness probe: alive
[2026-01-05 11:48:09,526][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:14,527][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:19,528][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:24,529][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:29,530][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:34,531][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:39,532][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:44,533][  INFO][PID:348122] Checking for cancel request
[2026-01-05 11:48:46,630][  INFO][PID:348122] Downloading results from builder
[2026-01-05 11:48:46,630][  INFO][PID:348122] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder started
[2026-01-05 11:48:46,631][  INFO][PID:348122] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/build-09975470.rsync.log
[2026-01-05 11:49:46,867][  INFO][PID:348122] rsyncing finished.
[2026-01-05 11:49:46,877][ ERROR][PID:348122] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-05 11:49:46,878][ ERROR][PID:348122] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-05 11:49:56,879][  INFO][PID:348122] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder started
[2026-01-05 11:49:56,880][  INFO][PID:348122] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/build-09975470.rsync.log
[2026-01-05 11:49:58,266][  INFO][PID:348122] rsyncing finished.
[2026-01-05 11:49:58,996][  INFO][PID:348122] Releasing VM back to pool
[2026-01-05 11:49:59,055][  INFO][PID:348122] Searching for 'success' file in resultdir
[2026-01-05 11:49:59,055][  INFO][PID:348122] Going to sign pkgs from source: 9975470-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le
[2026-01-05 11:49:59,056][  INFO][PID:348122] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1)
[2026-01-05 11:49:59,326][  INFO][PID:348122] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-debugsource-45-1.20260105112612118237.main.1.ge2a9768.fc43.ppc64le.rpm' (attempt #1)
[2026-01-05 11:50:00,082][  INFO][PID:348122] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-debugsource-45-1.20260105112612118237.main.1.ge2a9768.fc43.ppc64le.rpm
[2026-01-05 11:50:00,082][  INFO][PID:348122] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-debuginfo-45-1.20260105112612118237.main.1.ge2a9768.fc43.ppc64le.rpm' (attempt #1)
[2026-01-05 11:50:00,948][  INFO][PID:348122] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-debuginfo-45-1.20260105112612118237.main.1.ge2a9768.fc43.ppc64le.rpm
[2026-01-05 11:50:00,949][  INFO][PID:348122] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-45-1.20260105112612118237.main.1.ge2a9768.fc43.src.rpm' (attempt #1)
[2026-01-05 11:50:01,988][  INFO][PID:348122] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-45-1.20260105112612118237.main.1.ge2a9768.fc43.src.rpm
[2026-01-05 11:50:01,989][  INFO][PID:348122] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-45-1.20260105112612118237.main.1.ge2a9768.fc43.ppc64le.rpm' (attempt #1)
[2026-01-05 11:50:02,960][  INFO][PID:348122] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/image-builder-45-1.20260105112612118237.main.1.ge2a9768.fc43.ppc64le.rpm
[2026-01-05 11:50:02,961][  INFO][PID:348122] Sign done
[2026-01-05 11:50:02,962][  INFO][PID:348122] Incremental createrepo run, adding 09975470-image-builder into https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-43-ppc64le, (auto-create-repo=True)
[2026-01-05 11:50:02,963][  INFO][PID:348122] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le --add 09975470-image-builder --no-appstream-metadata' as PID 484909
[2026-01-05 11:50:03,977][  INFO][PID:348122] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le --add 09975470-image-builder --no-appstream-metadata)
[2026-01-05 11:50:03,978][  INFO][PID:348122] Getting build details
[2026-01-05 11:50:03,979][  INFO][PID:348122] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder
[2026-01-05 11:50:03,979][  INFO][PID:348122] Built packages:
['image-builder-debuginfo 45', 'image-builder-debugsource 45', 'image-builder 45']
[2026-01-05 11:50:03,980][  INFO][PID:348122] build details: {'built_packages': 'image-builder-debuginfo 45\nimage-builder-debugsource 45\nimage-builder 45'}
[2026-01-05 11:50:03,980][  INFO][PID:348122] Retrieving pubkey
[2026-01-05 11:50:03,981][  INFO][PID:348122] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1)
[2026-01-05 11:50:04,260][  INFO][PID:348122] Added pubkey for user @osbuild project image-builder into: /var/lib/copr/public_html/results/@osbuild/image-builder/pubkey.gpg
[2026-01-05 11:50:04,261][  INFO][PID:348122] Finished build: id=9975470 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/image-builder chroot=fedora-43-ppc64le 
[2026-01-05 11:50:04,263][  INFO][PID:348122] Worker succeeded build, took 941.044481754303
[2026-01-05 11:50:04,264][  INFO][PID:348122] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "image-builder",
            "project_dirname": "image-builder",
            "submitter": "packit",
            "ended_on": 1767613804.263658,
            "started_on": 1767612863.2191763,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-43-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9975470-fedora-43-ppc64le",
            "build_id": 9975470,
            "package_name": "image-builder",
            "package_version": "45-1.20260105112612118237.main.1.ge2a9768",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder",
            "git_hash": "24d91b9fef28626e082b0fbc1d0f632900678bfd",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/image-builder--packit",
            "results": {
                "packages": [
                    {
                        "name": "image-builder-debuginfo",
                        "epoch": null,
                        "version": "45",
                        "release": "1.20260105112612118237.main.1.ge2a9768.fc43",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "image-builder-debugsource",
                        "epoch": null,
                        "version": "45",
                        "release": "1.20260105112612118237.main.1.ge2a9768.fc43",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "image-builder",
                        "epoch": null,
                        "version": "45",
                        "release": "1.20260105112612118237.main.1.ge2a9768.fc43",
                        "arch": "src"
                    },
                    {
                        "name": "image-builder",
                        "epoch": null,
                        "version": "45",
                        "release": "1.20260105112612118237.main.1.ge2a9768.fc43",
                        "arch": "ppc64le"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-43-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder",
            "result_dir": "09975470-image-builder",
            "built_packages": "image-builder-debuginfo 45\nimage-builder-debugsource 45\nimage-builder 45",
            "id": 9975470,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "image-builder",
                "vendor": "Fedora Project COPR (@osbuild/image-builder)"
            }
        }
    ]
}
[2026-01-05 11:50:04,346][  INFO][PID:348122] Sending fedora-messaging bus message in build.end
[2026-01-05 11:50:04,882][  INFO][PID:348122] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/builder-live.log by gzip
[2026-01-05 11:50:04,884][  INFO][PID:348122] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/builder-live.log' as PID 485204
[2026-01-05 11:50:04,920][  INFO][PID:348122] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/builder-live.log)
[2026-01-05 11:50:04,921][  INFO][PID:348122] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/backend.log by gzip
[2026-01-05 11:50:04,922][  INFO][PID:348122] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/09975470-image-builder/backend.log' as PID 485212