[2026-01-30 19:08:23,166][ INFO][PID:2623825] Marking build as starting [2026-01-30 19:08:23,271][ INFO][PID:2623825] Checking that /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/repodata/repomd.xml exists [2026-01-30 19:08:23,281][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:08:23,283][ INFO][PID:2623825] VM allocation process starts [2026-01-30 19:08:23,309][ INFO][PID:2623825] Trying to allocate VM: ResallocHost, ticket_id=1109157, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-30 19:08:26,326][ INFO][PID:2623825] Allocated host ResallocHost, ticket_id=1109157, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_01786155_20260130_175644, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-30 19:08:26,326][ INFO][PID:2623825] Allocating ssh connection to builder [2026-01-30 19:08:26,327][ INFO][PID:2623825] Checking that builder machine is OK [2026-01-30 19:09:26,396][ ERROR][PID:2623825] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c189 port 22: Connection timed out [2026-01-30 19:09:36,397][ ERROR][PID:2623825] Re-try request for task on 'ResallocHost, ticket_id=1109157, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_01786155_20260130_175644, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2026-01-30 19:09:36,397][ INFO][PID:2623825] Releasing VM back to pool [2026-01-30 19:09:36,409][ INFO][PID:2623825] Retry #1 (on other host) [2026-01-30 19:09:36,410][ INFO][PID:2623825] Checking that /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/repodata/repomd.xml exists [2026-01-30 19:09:36,410][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:09:36,411][ INFO][PID:2623825] VM allocation process starts [2026-01-30 19:09:36,422][ INFO][PID:2623825] Trying to allocate VM: ResallocHost, ticket_id=1109190, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-30 19:09:39,442][ INFO][PID:2623825] Allocated host ResallocHost, ticket_id=1109190, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_01786416_20260130_180024, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-30 19:09:39,443][ INFO][PID:2623825] Allocating ssh connection to builder [2026-01-30 19:09:39,444][ INFO][PID:2623825] Checking that builder machine is OK [2026-01-30 19:10:39,519][ ERROR][PID:2623825] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c154 port 22: Connection timed out [2026-01-30 19:10:49,520][ ERROR][PID:2623825] Re-try request for task on 'ResallocHost, ticket_id=1109190, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_01786416_20260130_180024, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2026-01-30 19:10:49,521][ INFO][PID:2623825] Releasing VM back to pool [2026-01-30 19:10:49,552][ INFO][PID:2623825] Retry #2 (on other host) [2026-01-30 19:10:49,553][ INFO][PID:2623825] Checking that /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/repodata/repomd.xml exists [2026-01-30 19:10:49,554][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:10:49,556][ INFO][PID:2623825] VM allocation process starts [2026-01-30 19:10:49,578][ INFO][PID:2623825] Trying to allocate VM: ResallocHost, ticket_id=1109205, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-30 19:10:52,601][ INFO][PID:2623825] Allocated host ResallocHost, ticket_id=1109205, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_01786678_20260130_181113, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2026-01-30 19:10:52,602][ INFO][PID:2623825] Allocating ssh connection to builder [2026-01-30 19:10:52,602][ INFO][PID:2623825] Checking that builder machine is OK [2026-01-30 19:10:53,707][ INFO][PID:2623825] Running remote command: copr-builder-ready epel-10-ppc64le [2026-01-30 19:10:54,378][ INFO][PID:2623825] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-01-30 19:10:54,379][ INFO][PID:2623825] Filling build.info file with builder info [2026-01-30 19:10:54,381][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:10:54,387][ INFO][PID:2623825] Not re-notifying FE and msg buses for the new host. [2026-01-30 19:10:54,388][ INFO][PID:2623825] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10081573-epel-10-ppc64le --chroot epel-10-ppc64le --detached [2026-01-30 19:10:55,433][ INFO][PID:2623825] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c188' (ED25519) to the list of known hosts. [2026-01-30 19:10:55,437][ INFO][PID:2623825] Downloading the builder-live.log file, attempt 1 [2026-01-30 19:10:55,441][ INFO][PID:2623825] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log [2026-01-30 19:11:00,446][ INFO][PID:2623825] Periodic builder liveness probe: alive [2026-01-30 19:11:00,446][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:05,447][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:10,448][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:15,453][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:20,455][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:25,455][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:30,456][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:35,457][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:40,458][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:45,459][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:50,459][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:11:55,460][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:00,461][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:05,487][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:10,551][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:15,552][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:20,553][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:25,554][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:30,555][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:35,556][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:40,557][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:45,560][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:50,561][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:12:55,562][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:00,563][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:05,564][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:10,565][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:15,566][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:20,567][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:25,568][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:30,569][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:35,570][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:40,572][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:45,574][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:50,576][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:13:55,624][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:00,626][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:05,640][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:10,658][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:15,659][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:20,660][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:25,661][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:30,662][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:35,663][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:40,665][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:45,666][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:50,667][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:14:55,668][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:00,669][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:05,670][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:10,672][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:15,673][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:20,674][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:25,676][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:30,677][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:35,678][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:40,680][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:45,681][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:50,682][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:15:55,683][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:00,686][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:05,687][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:10,688][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:15,689][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:20,690][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:25,691][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:30,692][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:35,693][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:40,694][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:45,695][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:50,696][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:16:55,697][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:00,697][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:05,699][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:10,700][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:15,701][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:20,702][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:25,703][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:30,704][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:35,705][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:40,706][ INFO][PID:2623825] Checking for cancel request [2026-01-30 19:17:40,763][ INFO][PID:2623825] Downloading results from builder [2026-01-30 19:17:40,764][ INFO][PID:2623825] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c188]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF started [2026-01-30 19:17:40,764][ INFO][PID:2623825] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c188]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/ &> /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/build-10081573.rsync.log [2026-01-30 19:17:42,781][ INFO][PID:2623825] rsyncing finished. [2026-01-30 19:17:42,781][ INFO][PID:2623825] Releasing VM back to pool [2026-01-30 19:17:42,834][ INFO][PID:2623825] Searching for 'success' file in resultdir [2026-01-30 19:17:42,834][ ERROR][PID:2623825] Build failed: Backend process error: No success file => build failure [2026-01-30 19:17:42,835][ INFO][PID:2623825] Finished build: id=10081573 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mjg/mupdf-git chroot=epel-10-ppc64le [2026-01-30 19:17:42,836][ ERROR][PID:2623825] Backend process error: No success file => build failure [2026-01-30 19:17:42,837][ INFO][PID:2623825] Worker failed build, took 408.4500136375427 [2026-01-30 19:17:42,837][ INFO][PID:2623825] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mjg", "project_name": "mupdf-git", "project_dirname": "mupdf-git", "submitter": "https://api.github.com/users/mjg", "ended_on": 1769800662.8369954, "started_on": 1769800254.3869817, "submitted_on": null, "status": 0, "chroot": "epel-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10081573-epel-10-ppc64le", "build_id": 10081573, "package_name": "python-PyMuPDF", "package_version": "1.26.7^34.gb49a9a0d-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mjg/mupdf-git/python-PyMuPDF", "git_hash": "f40d55fe70d1f825debd5f94943995f91e8e208e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mjg/mupdf-git--https://api.github.com/users/mjg", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mjg/mupdf-git/epel-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mjg/mupdf-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mjg/mupdf-git", "result_dir": "10081573-python-PyMuPDF", "built_packages": "", "id": 10081573, "mockchain_macros": { "copr_username": "mjg", "copr_projectname": "mupdf-git", "vendor": "Fedora Project COPR (mjg/mupdf-git)" } } ] } [2026-01-30 19:17:42,896][ INFO][PID:2623825] Sending fedora-messaging bus message in build.end [2026-01-30 19:17:43,419][ INFO][PID:2623825] Compressing /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/builder-live.log by gzip [2026-01-30 19:17:43,422][ INFO][PID:2623825] Running command 'gzip /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/builder-live.log' as PID 2682929 [2026-01-30 19:17:43,449][ INFO][PID:2623825] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/builder-live.log) [2026-01-30 19:17:43,450][ INFO][PID:2623825] Compressing /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/backend.log by gzip [2026-01-30 19:17:43,454][ INFO][PID:2623825] Running command 'gzip /var/lib/copr/public_html/results/mjg/mupdf-git/epel-10-ppc64le/10081573-python-PyMuPDF/backend.log' as PID 2682931