[2026-11-10 15:10:57,090][ INFO][PID:2062538] Marking build as starting [2026-11-10 15:10:57,125][ INFO][PID:2062538] Checking that https://download.copr.fedorainfracloud.org/results/matthewdva/certbot/epel-9-s390x//repodata/repomd.xml exists [2026-11-10 15:10:57,414][ INFO][PID:2062538] Checking that https://download.copr.fedorainfracloud.org/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x//repodata/repomd.xml exists [2026-11-10 15:10:57,600][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:10:57,602][ INFO][PID:2062538] rpmeta: no HW info for arch s390x, skipping [2026-11-10 15:10:57,603][ INFO][PID:2062538] VM allocation process starts [2026-11-10 15:10:57,608][ INFO][PID:2062538] Trying to allocate VM: ResallocHost, ticket_id=6349276, requested_tags=['arch_s390x', 'copr_builder'] [2026-11-10 15:11:02,609][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:07,610][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:12,611][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:17,612][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:22,612][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:27,613][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:32,614][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:37,615][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:42,616][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:47,616][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:52,618][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:11:57,619][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:02,620][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:07,621][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:12,622][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:17,623][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:22,625][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:27,626][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:32,627][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:37,627][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:42,630][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:47,631][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:52,632][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:12:57,635][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:02,638][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:07,639][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:12,640][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:17,641][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:22,642][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:27,643][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:32,643][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:37,644][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:42,645][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:47,646][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:52,647][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:13:57,647][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:02,648][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:07,649][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:12,650][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:17,651][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:22,652][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:27,653][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:32,653][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:37,654][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:42,655][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:47,656][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:52,657][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:14:57,658][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:02,659][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:07,660][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:12,660][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:17,661][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:22,662][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:27,663][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:32,664][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:37,665][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:42,667][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:47,669][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:52,670][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:15:57,672][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:02,673][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:07,673][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:12,674][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:17,675][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:22,676][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:27,678][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:32,679][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:37,680][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:42,681][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:47,682][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:52,684][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:16:57,685][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:02,686][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:07,687][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:12,688][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:17,689][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:22,691][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:27,692][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:32,694][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:37,695][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:42,696][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:47,697][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:52,697][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:17:57,698][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:02,699][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:07,700][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:12,701][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:15,716][ INFO][PID:2062538] Allocated host ResallocHost, ticket_id=6349276, hostname=163.109.86.57, name=copr_ic_s390x_br_sao_3_prod_76164538_20261110_151409, requested_tags=['arch_s390x', 'copr_builder'] [2026-11-10 15:18:15,716][ INFO][PID:2062538] Allocating ssh connection to builder [2026-11-10 15:18:15,716][ INFO][PID:2062538] Checking that builder machine is OK [2026-11-10 15:18:17,325][ INFO][PID:2062538] Installed copr-rpmbuild version: 1.11 [2026-11-10 15:18:17,326][ INFO][PID:2062538] Running remote command: copr-builder-ready epel-9-s390x [2026-11-10 15:18:18,916][ INFO][PID:2062538] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-11-10 15:18:18,917][ INFO][PID:2062538] Filling build.info file with builder info [2026-11-10 15:18:18,917][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:18,918][ INFO][PID:2062538] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "matthewdva", "project_name": "certbot", "project_dirname": "certbot:pr:fork-packit-rpms-google-api-python-client-79", "submitter": "https://src.fedoraproject.org/user/packit", "ended_on": null, "started_on": 1794323898.9180927, "submitted_on": null, "status": 3, "chroot": "epel-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "11299607-epel-9-s390x", "build_id": 11299607, "package_name": "google-api-python-client", "package_version": "2:2.202.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/google-api-python-client", "git_hash": "67a0d00deaeb7a5a26b69c875fb174085f4e40bd", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "matthewdva/certbot--https://src.fedoraproject.org/user/packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot/epel-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://dl.fedoraproject.org/pub/epel/testing/$releasever/Everything/$basearch", "id": "https_dl_fedoraproject_org_pub_epel_testing_releasever_Everything_basearch", "name": "Additional repo https_dl_fedoraproject_org_pub_epel_testing_releasever_Everything_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79", "result_dir": "11299607-google-api-python-client", "built_packages": "", "rpmeta_prediction": null, "id": 11299607, "mockchain_macros": { "copr_username": "matthewdva", "copr_projectname": "certbot", "vendor": "Fedora Project COPR (matthewdva/certbot)" } } ] } [2026-11-10 15:18:18,947][ INFO][PID:2062538] Sending fedora-messaging bus message in build.start [2026-11-10 15:18:19,300][ INFO][PID:2062538] Sending fedora-messaging bus message in chroot.start [2026-11-10 15:18:19,320][ INFO][PID:2062538] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11299607-epel-9-s390x --chroot epel-9-s390x --detached [2026-11-10 15:18:21,167][ INFO][PID:2062538] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.109.86.57' (ED25519) to the list of known hosts. [2026-11-10 15:18:21,167][ INFO][PID:2062538] Downloading the builder-live.log file, attempt 1 [2026-11-10 15:18:21,169][ INFO][PID:2062538] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.109.86.57 copr-rpmbuild-log [2026-11-10 15:18:26,171][ INFO][PID:2062538] Periodic builder liveness probe: alive [2026-11-10 15:18:26,172][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:31,173][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:36,174][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:41,174][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:46,175][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:51,176][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:18:56,177][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:01,178][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:06,179][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:11,180][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:16,181][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:21,182][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:26,182][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:31,183][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:36,184][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:41,185][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:46,186][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:51,187][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:19:56,188][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:01,189][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:06,189][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:11,190][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:16,191][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:21,192][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:26,193][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:31,194][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:36,195][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:41,196][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:46,197][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:51,197][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:20:56,198][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:01,199][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:06,200][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:11,201][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:16,202][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:21,203][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:26,204][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:31,205][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:36,205][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:41,206][ INFO][PID:2062538] Checking for cancel request [2026-11-10 15:21:45,231][ INFO][PID:2062538] Downloading results from builder [2026-11-10 15:21:45,231][ INFO][PID:2062538] rsyncing of mockbuilder@163.109.86.57:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client started [2026-11-10 15:21:45,232][ INFO][PID:2062538] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.109.86.57:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/ &> /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/build-11299607.rsync.log [2026-11-10 15:21:53,471][ INFO][PID:2062538] rsyncing finished. [2026-11-10 15:21:53,471][ INFO][PID:2062538] VM Release request [2026-11-10 15:21:53,477][ INFO][PID:2062538] Searching for 'success' file in resultdir [2026-11-10 15:21:53,478][ ERROR][PID:2062538] Build failed: Backend process error: No success file => build failure [2026-11-10 15:21:53,483][ INFO][PID:2062538] Finished build: id=11299607 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79 chroot=epel-9-s390x [2026-11-10 15:21:53,485][ ERROR][PID:2062538] Backend process error: No success file => build failure [2026-11-10 15:21:53,489][ INFO][PID:2062538] Worker failed build, took 214.57170271873474 [2026-11-10 15:21:53,490][ INFO][PID:2062538] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "matthewdva", "project_name": "certbot", "project_dirname": "certbot:pr:fork-packit-rpms-google-api-python-client-79", "submitter": "https://src.fedoraproject.org/user/packit", "ended_on": 1794324113.4897954, "started_on": 1794323898.9180927, "submitted_on": null, "status": 0, "chroot": "epel-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "11299607-epel-9-s390x", "build_id": 11299607, "package_name": "google-api-python-client", "package_version": "2:2.202.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/google-api-python-client", "git_hash": "67a0d00deaeb7a5a26b69c875fb174085f4e40bd", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "matthewdva/certbot--https://src.fedoraproject.org/user/packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot/epel-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://dl.fedoraproject.org/pub/epel/testing/$releasever/Everything/$basearch", "id": "https_dl_fedoraproject_org_pub_epel_testing_releasever_Everything_basearch", "name": "Additional repo https_dl_fedoraproject_org_pub_epel_testing_releasever_Everything_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79", "result_dir": "11299607-google-api-python-client", "built_packages": "", "rpmeta_prediction": null, "id": 11299607, "mockchain_macros": { "copr_username": "matthewdva", "copr_projectname": "certbot", "vendor": "Fedora Project COPR (matthewdva/certbot)" } } ] } [2026-11-10 15:21:53,517][ INFO][PID:2062538] Sending fedora-messaging bus message in build.end [2026-11-10 15:21:53,539][ INFO][PID:2062538] Compressing /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/builder-live.log by gzip [2026-11-10 15:21:53,540][ INFO][PID:2062538] Running command 'gzip /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/builder-live.log' as PID 2226071 [2026-11-10 15:21:53,543][ INFO][PID:2062538] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/builder-live.log) [2026-11-10 15:21:53,543][ INFO][PID:2062538] Compressing /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/backend.log by gzip [2026-11-10 15:21:53,543][ INFO][PID:2062538] Running command 'gzip /var/lib/copr/public_html/results/matthewdva/certbot:pr:fork-packit-rpms-google-api-python-client-79/epel-9-s390x/11299607-google-api-python-client/backend.log' as PID 2226073