[2026-01-12 13:55:24,497][ INFO][PID:38225] Marking build as starting [2026-01-12 13:55:24,616][ INFO][PID:38225] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 13:55:25,429][ INFO][PID:38225] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 13:55:26,338][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:55:26,341][ INFO][PID:38225] VM allocation process starts [2026-01-12 13:55:26,374][ INFO][PID:38225] Trying to allocate VM: ResallocHost, ticket_id=777178, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 13:55:29,405][ INFO][PID:38225] Allocated host ResallocHost, ticket_id=777178, hostname=2620:52:6:1161:dead:beef:cafe:c18d, name=vmhost_p09_04_prod_01146547_20260112_133828, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 13:55:29,406][ INFO][PID:38225] Allocating ssh connection to builder [2026-01-12 13:55:29,406][ INFO][PID:38225] Checking that builder machine is OK [2026-01-12 13:56:29,478][ ERROR][PID:38225] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18d port 22: Connection timed out [2026-01-12 13:56:39,487][ ERROR][PID:38225] Re-try request for task on 'ResallocHost, ticket_id=777178, hostname=2620:52:6:1161:dead:beef:cafe:c18d, name=vmhost_p09_04_prod_01146547_20260112_133828, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-12 13:56:39,490][ INFO][PID:38225] Releasing VM back to pool [2026-01-12 13:56:39,521][ INFO][PID:38225] Retry #1 (on other host) [2026-01-12 13:56:39,524][ INFO][PID:38225] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 13:56:40,045][ INFO][PID:38225] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 13:56:40,288][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:56:40,293][ INFO][PID:38225] VM allocation process starts [2026-01-12 13:56:40,320][ INFO][PID:38225] Trying to allocate VM: ResallocHost, ticket_id=777242, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 13:56:45,323][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:56:50,328][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:56:52,445][ INFO][PID:38225] Allocated host ResallocHost, ticket_id=777242, hostname=2620:52:6:1161:dead:beef:cafe:c18c, name=vmhost_p09_04_prod_01147496_20260112_135212, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 13:56:52,447][ INFO][PID:38225] Allocating ssh connection to builder [2026-01-12 13:56:52,449][ INFO][PID:38225] Checking that builder machine is OK [2026-01-12 13:56:53,500][ INFO][PID:38225] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 13:56:54,056][ INFO][PID:38225] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 13:56:54,056][ INFO][PID:38225] Filling build.info file with builder info [2026-01-12 13:56:54,057][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:56:54,058][ INFO][PID:38225] Not re-notifying FE and msg buses for the new host. [2026-01-12 13:56:54,060][ INFO][PID:38225] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10000948-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 13:56:55,099][ INFO][PID:38225] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18c' (ED25519) to the list of known hosts. [2026-01-12 13:56:55,100][ INFO][PID:38225] Downloading the builder-live.log file, attempt 1 [2026-01-12 13:56:55,106][ INFO][PID:38225] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18c copr-rpmbuild-log [2026-01-12 13:57:00,161][ INFO][PID:38225] Periodic builder liveness probe: alive [2026-01-12 13:57:00,162][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:05,164][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:10,166][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:15,171][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:20,180][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:25,186][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:30,195][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:35,196][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:40,202][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:45,208][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:50,209][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:57:55,210][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:00,214][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:05,223][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:10,225][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:15,233][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:20,242][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:25,254][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:30,262][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:35,267][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:40,269][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:45,277][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:50,282][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:58:55,299][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:00,317][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:05,319][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:10,324][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:15,326][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:20,334][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:25,341][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:30,345][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:35,352][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:40,355][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:45,363][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:50,369][ INFO][PID:38225] Checking for cancel request [2026-01-12 13:59:55,372][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:00,381][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:05,386][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:10,391][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:13,422][ ERROR][PID:38225] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:00:15,394][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:20,400][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:23,422][WARNING][PID:38225] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:00:25,401][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:30,403][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:33,424][ INFO][PID:38225] Downloading the builder-live.log file, attempt 2 [2026-01-12 14:00:33,430][ INFO][PID:38225] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18c copr-rpmbuild-log [2026-01-12 14:00:35,407][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:40,411][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:45,412][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:50,413][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:00:55,426][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:00,428][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:05,430][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:10,432][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:15,434][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:20,441][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:25,444][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:30,446][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:33,534][ ERROR][PID:38225] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:01:35,449][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:40,453][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:43,537][WARNING][PID:38225] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:01:45,457][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:50,460][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:01:53,539][ INFO][PID:38225] Downloading the builder-live.log file, attempt 3 [2026-01-12 14:01:53,544][ INFO][PID:38225] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18c copr-rpmbuild-log [2026-01-12 14:01:55,464][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:00,467][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:05,470][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:10,476][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:15,485][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:20,486][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:25,488][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:30,493][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:35,495][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:40,497][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:45,501][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:50,504][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:02:53,619][ ERROR][PID:38225] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:02:55,508][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:00,510][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:03,647][WARNING][PID:38225] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 14:03:05,513][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:10,541][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:13,648][ INFO][PID:38225] Downloading the builder-live.log file, attempt 4 [2026-01-12 14:03:13,653][ INFO][PID:38225] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18c copr-rpmbuild-log [2026-01-12 14:03:15,542][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:20,545][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:25,548][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:30,556][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:35,566][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:40,569][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:45,571][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:50,574][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:03:55,579][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:00,580][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:05,584][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:10,591][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:13,730][ ERROR][PID:38225] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 14:04:15,598][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:20,600][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:23,779][ ERROR][PID:38225] Giving up for unstable SSH, failures: 1768226423.4228482, 1768226503.537685, 1768226583.6471229, 1768226663.7790854 [2026-01-12 14:04:23,782][ ERROR][PID:38225] Re-try request for task on 'ResallocHost, ticket_id=777242, hostname=2620:52:6:1161:dead:beef:cafe:c18c, name=vmhost_p09_04_prod_01147496_20260112_135212, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-12 14:04:23,783][ INFO][PID:38225] Releasing VM back to pool [2026-01-12 14:04:23,814][ INFO][PID:38225] Retry #2 (on other host) [2026-01-12 14:04:23,817][ INFO][PID:38225] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 14:04:24,166][ INFO][PID:38225] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le//repodata/repomd.xml exists [2026-01-12 14:04:24,470][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:24,474][ INFO][PID:38225] VM allocation process starts [2026-01-12 14:04:24,512][ INFO][PID:38225] Trying to allocate VM: ResallocHost, ticket_id=777379, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:04:29,528][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:34,530][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:39,534][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:44,560][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:49,565][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:54,569][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:04:59,573][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:04,577][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:09,580][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:14,587][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:19,590][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:24,596][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:29,598][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:34,602][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:39,625][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:44,631][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:49,633][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:54,637][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:05:59,639][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:04,648][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:09,650][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:14,653][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:19,657][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:24,660][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:29,661][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:34,664][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:39,677][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:44,679][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:49,690][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:54,708][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:06:59,709][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:04,711][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:09,714][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:14,718][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:19,723][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:24,724][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:29,725][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:34,735][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:39,736][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:42,756][ INFO][PID:38225] Allocated host ResallocHost, ticket_id=777379, hostname=2620:52:6:1161:dead:beef:cafe:c191, name=vmhost_p09_04_prod_01148542_20260112_140211, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 14:07:42,756][ INFO][PID:38225] Allocating ssh connection to builder [2026-01-12 14:07:42,758][ INFO][PID:38225] Checking that builder machine is OK [2026-01-12 14:07:43,686][ INFO][PID:38225] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 14:07:44,230][ INFO][PID:38225] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 14:07:44,231][ INFO][PID:38225] Filling build.info file with builder info [2026-01-12 14:07:44,397][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:44,417][ INFO][PID:38225] Not re-notifying FE and msg buses for the new host. [2026-01-12 14:07:44,419][ INFO][PID:38225] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10000948-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 14:07:45,340][ INFO][PID:38225] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c191' (ED25519) to the list of known hosts. [2026-01-12 14:07:45,341][ INFO][PID:38225] Downloading the builder-live.log file, attempt 1 [2026-01-12 14:07:45,355][ INFO][PID:38225] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c191 copr-rpmbuild-log [2026-01-12 14:07:50,351][ INFO][PID:38225] Periodic builder liveness probe: alive [2026-01-12 14:07:50,351][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:07:55,352][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:00,353][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:05,359][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:10,361][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:15,365][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:20,366][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:25,376][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:30,379][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:35,384][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:40,386][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:45,387][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:50,399][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:08:55,401][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:00,421][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:05,424][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:10,459][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:15,464][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:20,466][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:25,469][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:30,473][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:35,491][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:40,494][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:45,498][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:50,501][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:09:55,507][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:00,512][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:05,518][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:10,520][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:15,526][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:20,530][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:25,537][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:30,541][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:35,559][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:40,561][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:45,564][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:50,577][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:10:55,578][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:00,579][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:05,583][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:10,584][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:15,586][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:20,592][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:25,594][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:30,603][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:35,607][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:40,608][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:45,619][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:50,627][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:11:55,629][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:00,630][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:05,633][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:10,641][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:15,643][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:20,644][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:25,646][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:30,657][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:35,658][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:40,661][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:45,662][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:50,666][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:12:55,669][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:13:00,671][ INFO][PID:38225] Checking for cancel request [2026-01-12 14:13:04,332][ INFO][PID:38225] Downloading results from builder [2026-01-12 14:13:04,333][ INFO][PID:38225] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c191]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild started [2026-01-12 14:13:04,335][ INFO][PID:38225] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c191]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/ &> /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/build-10000948.rsync.log [2026-01-12 14:13:05,012][ INFO][PID:38225] rsyncing finished. [2026-01-12 14:13:05,013][ INFO][PID:38225] Releasing VM back to pool [2026-01-12 14:13:05,025][ INFO][PID:38225] Searching for 'success' file in resultdir [2026-01-12 14:13:05,026][ INFO][PID:38225] Going to sign pkgs from source: 10000948-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le [2026-01-12 14:13:05,027][ INFO][PID:38225] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-12 14:13:05,210][ INFO][PID:38225] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.src.rpm' (attempt #1) [2026-01-12 14:13:05,866][ INFO][PID:38225] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.src.rpm [2026-01-12 14:13:05,867][ INFO][PID:38225] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm' (attempt #1) [2026-01-12 14:13:06,496][ INFO][PID:38225] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm [2026-01-12 14:13:06,497][ INFO][PID:38225] Calling '/bin/sign -4 -h sha256 -u @copr#copr-pull-requests@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-builder-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm' (attempt #1) [2026-01-12 14:13:07,041][ INFO][PID:38225] signed rpm: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-builder-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm [2026-01-12 14:13:07,042][ INFO][PID:38225] Sign done [2026-01-12 14:13:07,043][ INFO][PID:38225] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.src.rpm [2026-01-12 14:13:07,391][ INFO][PID:38225] [1/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.src.rpm [2026-01-12 14:13:07,391][ INFO][PID:38225] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm [2026-01-12 14:13:07,741][ INFO][PID:38225] [2/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm [2026-01-12 14:13:07,742][ INFO][PID:38225] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-builder-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm [2026-01-12 14:13:08,110][ INFO][PID:38225] [3/3] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-builder-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm [2026-01-12 14:13:08,119][ INFO][PID:38225] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-pull-requests%3Apr%3A4115%2Ffedora-43-ppc64le&offset=0&limit=1 [2026-01-12 14:13:08,461][ INFO][PID:38225] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28d-aeb9-75e2-8083-6ef9ad3dcbb2/ [2026-01-12 14:13:08,573][ INFO][PID:38225] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28d-aeb9-75e2-8083-6ef9ad3dcbb2/ [2026-01-12 14:13:13,706][ INFO][PID:38225] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28d-aeb9-75e2-8083-6ef9ad3dcbb2/ [2026-01-12 14:13:13,707][ INFO][PID:38225] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28d-aeb9-75e2-8083-6ef9ad3dcbb2/ [2026-01-12 14:13:13,858][ INFO][PID:38225] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-12 14:13:13,859][ INFO][PID:38225] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-12 14:13:14,023][ INFO][PID:38225] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28d-c47f-724f-85a7-8664307364b3/ [2026-01-12 14:13:14,024][ INFO][PID:38225] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28d-c47f-724f-85a7-8664307364b3/ [2026-01-12 14:13:19,196][ INFO][PID:38225] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019bb28d-c47f-724f-85a7-8664307364b3/ [2026-01-12 14:13:19,197][ INFO][PID:38225] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019bb28d-c47f-724f-85a7-8664307364b3/ [2026-01-12 14:13:19,349][ INFO][PID:38225] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ [2026-01-12 14:13:19,353][ INFO][PID:38225] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019ba8ef-da4d-715d-b4c0-19144e207d45/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019bb28d-aa52-709e-8453-cab4e2018d50/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019bb28d-abc0-7d50-b6c0-2e7821b7bacd/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019bb28d-ad41-7bc2-990f-eb6dfc78d747/']) [2026-01-12 14:13:19,356][ INFO][PID:38225] Getting build details [2026-01-12 14:13:19,358][ INFO][PID:38225] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild [2026-01-12 14:13:19,359][ INFO][PID:38225] Built packages: ['copr-builder 1.6.post1', 'copr-rpmbuild 1.6.post1'] [2026-01-12 14:13:19,360][ INFO][PID:38225] build details: {'built_packages': 'copr-builder 1.6.post1\ncopr-rpmbuild 1.6.post1'} [2026-01-12 14:13:19,361][ INFO][PID:38225] Retrieving pubkey [2026-01-12 14:13:19,362][ INFO][PID:38225] Calling '/bin/sign -u @copr#copr-pull-requests@copr.fedorahosted.org -p' (attempt #1) [2026-01-12 14:13:19,546][ INFO][PID:38225] Added pubkey for user @copr project copr-pull-requests into: /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/pubkey.gpg [2026-01-12 14:13:19,547][ INFO][PID:38225] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.src.rpm, it is stored in Pulp [2026-01-12 14:13:19,548][ INFO][PID:38225] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-rpmbuild-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm, it is stored in Pulp [2026-01-12 14:13:19,549][ INFO][PID:38225] Removing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/copr-builder-1.6.post1-1.git.84.0474e57.fc43.ppc64le.rpm, it is stored in Pulp [2026-01-12 14:13:19,549][ INFO][PID:38225] Finished build: id=10000948 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115 chroot=fedora-43-ppc64le [2026-01-12 14:13:19,552][ INFO][PID:38225] Worker succeeded build, took 335.1424551010132 [2026-01-12 14:13:19,553][ INFO][PID:38225] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-pull-requests", "project_dirname": "copr-pull-requests:pr:4115", "submitter": null, "ended_on": 1768227199.5522673, "started_on": 1768226864.4098122, "submitted_on": null, "status": 1, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10000948-fedora-43-ppc64le", "build_id": 10000948, "package_name": "copr-rpmbuild", "package_version": "1.6.post1-1.git.84.0474e57", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-pull-requests:pr:4115/copr-rpmbuild", "git_hash": "7b0b55b21924cbbafda66aea7b91fc89d63e08b4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-pull-requests--43f6292d-43df-4802-aead-344334051de0", "results": { "packages": [ { "name": "copr-builder", "epoch": null, "version": "1.6.post1", "release": "1.git.84.0474e57.fc43", "arch": "ppc64le" }, { "name": "copr-rpmbuild", "epoch": null, "version": "1.6.post1", "release": "1.git.84.0474e57.fc43", "arch": "src" }, { "name": "copr-rpmbuild", "epoch": null, "version": "1.6.post1", "release": "1.git.84.0474e57.fc43", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/fedora-43-ppc64le/", "id": "copr_copr_copr_dev", "name": "Additional repo copr_copr_copr_dev" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-pull-requests:pr:4115", "result_dir": "10000948-copr-rpmbuild", "built_packages": "copr-builder 1.6.post1\ncopr-rpmbuild 1.6.post1", "id": 10000948, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-pull-requests", "vendor": "Fedora Project COPR (@copr/copr-pull-requests)" } } ] } [2026-01-12 14:13:19,634][ INFO][PID:38225] Sending fedora-messaging bus message in build.end [2026-01-12 14:13:20,299][ INFO][PID:38225] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/builder-live.log by gzip [2026-01-12 14:13:20,303][ INFO][PID:38225] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/builder-live.log' as PID 235383 [2026-01-12 14:13:20,359][ INFO][PID:38225] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/builder-live.log) [2026-01-12 14:13:20,360][ INFO][PID:38225] Compressing /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/backend.log by gzip [2026-01-12 14:13:20,361][ INFO][PID:38225] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-pull-requests:pr:4115/fedora-43-ppc64le/10000948-copr-rpmbuild/backend.log' as PID 235393