[2026-07-28 23:03:03,559][ INFO][PID:2864123] Marking build as starting [2026-07-28 23:03:03,629][ INFO][PID:2864123] Checking that https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x//repodata/repomd.xml exists [2026-07-28 23:03:03,828][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:03,856][WARNING][PID:2864123] rpmeta: cannot connect to https://rpmeta.fedoraproject.org, skipping [2026-07-28 23:03:03,857][ INFO][PID:2864123] VM allocation process starts [2026-07-28 23:03:03,879][ INFO][PID:2864123] Trying to allocate VM: ResallocHost, ticket_id=4152449, requested_tags=['arch_s390x', 'copr_builder'] [2026-07-28 23:03:08,881][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:13,882][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:15,907][ INFO][PID:2864123] Allocated host ResallocHost, ticket_id=4152449, hostname=13.120.86.2, name=copr_ic_s390x_eu_es_1_prod_14937821_20260728_224131, requested_tags=['arch_s390x', 'copr_builder'] [2026-07-28 23:03:15,908][ INFO][PID:2864123] Allocating ssh connection to builder [2026-07-28 23:03:15,908][ INFO][PID:2864123] Checking that builder machine is OK [2026-07-28 23:03:17,291][ INFO][PID:2864123] Installed copr-rpmbuild version: 1.8 [2026-07-28 23:03:17,292][ INFO][PID:2864123] Running remote command: copr-builder-ready centos-stream-9-s390x [2026-07-28 23:03:18,579][ INFO][PID:2864123] Red Hat subscription not needed for centos-stream-9-s390x Builder is ready to be used [2026-07-28 23:03:18,580][ INFO][PID:2864123] Filling build.info file with builder info [2026-07-28 23:03:18,582][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:18,592][ INFO][PID:2864123] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": null, "started_on": 1785279798.5918915, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10785247-centos-stream-9-s390x", "build_id": 10785247, "package_name": "bpftrace", "package_version": "0.26.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/bpftrace", "git_hash": "4ee4cf67840d9cfe47b3260c6300ff0dba0a496c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260728/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260728", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260728" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "10785247-bpftrace", "built_packages": "", "rpmeta_prediction": null, "id": 10785247, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2026-07-28 23:03:18,687][ INFO][PID:2864123] Sending fedora-messaging bus message in build.start [2026-07-28 23:03:19,663][ INFO][PID:2864123] Sending fedora-messaging bus message in chroot.start [2026-07-28 23:03:19,712][ INFO][PID:2864123] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10785247-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached [2026-07-28 23:03:21,469][ INFO][PID:2864123] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.120.86.2' (ED25519) to the list of known hosts. [2026-07-28 23:03:21,477][ INFO][PID:2864123] Downloading the builder-live.log file, attempt 1 [2026-07-28 23:03:21,482][ INFO][PID:2864123] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.120.86.2 copr-rpmbuild-log [2026-07-28 23:03:26,488][ INFO][PID:2864123] Periodic builder liveness probe: alive [2026-07-28 23:03:26,489][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:31,490][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:36,492][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:41,494][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:46,497][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:51,499][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:03:56,500][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:01,502][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:06,507][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:11,509][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:16,512][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:21,517][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:26,523][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:31,524][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:36,526][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:41,527][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:46,531][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:51,532][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:04:56,533][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:01,535][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:06,537][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:11,538][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:16,540][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:21,542][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:26,547][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:31,550][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:36,551][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:41,553][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:46,554][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:51,556][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:05:56,557][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:01,559][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:06,564][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:11,567][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:16,568][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:21,569][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:26,575][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:31,579][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:36,581][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:41,583][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:46,586][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:51,591][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:06:56,593][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:01,595][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:06,600][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:11,604][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:16,609][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:21,613][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:26,615][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:31,619][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:36,623][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:41,625][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:46,629][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:51,646][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:07:56,652][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:01,655][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:06,662][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:11,669][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:16,674][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:21,676][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:26,679][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:31,683][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:36,689][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:41,697][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:46,705][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:51,718][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:08:56,720][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:01,725][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:06,733][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:11,737][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:16,756][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:21,762][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:26,767][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:31,774][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:36,778][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:41,780][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:46,789][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:51,794][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:09:56,797][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:01,801][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:06,807][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:11,815][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:16,817][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:21,820][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:26,825][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:31,832][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:36,836][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:41,840][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:46,844][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:51,850][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:10:56,864][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:01,881][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:06,888][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:11,902][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:16,917][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:21,936][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:26,938][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:31,941][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:36,954][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:41,956][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:46,960][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:51,966][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:11:56,981][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:01,992][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:07,003][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:12,034][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:17,058][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:22,079][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:27,104][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:32,139][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:37,142][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:42,146][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:47,148][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:52,152][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:12:57,158][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:02,160][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:07,168][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:12,172][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:17,174][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:22,188][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:27,231][ INFO][PID:2864123] Periodic builder liveness probe: alive [2026-07-28 23:13:27,233][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:32,234][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:37,238][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:42,241][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:47,246][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:52,250][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:57,255][ INFO][PID:2864123] Checking for cancel request [2026-07-28 23:13:57,860][ INFO][PID:2864123] Downloading results from builder [2026-07-28 23:13:57,862][ INFO][PID:2864123] rsyncing of mockbuilder@13.120.86.2:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace started [2026-07-28 23:13:57,871][ INFO][PID:2864123] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.120.86.2:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/build-10785247.rsync.log [2026-07-28 23:14:00,887][ INFO][PID:2864123] rsyncing finished. [2026-07-28 23:14:00,889][ INFO][PID:2864123] VM Release request [2026-07-28 23:14:00,907][ INFO][PID:2864123] Searching for 'success' file in resultdir [2026-07-28 23:14:00,909][ ERROR][PID:2864123] Build failed: Backend process error: No success file => build failure [2026-07-28 23:14:00,945][ INFO][PID:2864123] Finished build: id=10785247 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=centos-stream-9-s390x [2026-07-28 23:14:00,953][ ERROR][PID:2864123] Backend process error: No success file => build failure [2026-07-28 23:14:00,996][ INFO][PID:2864123] Worker failed build, took 642.404369354248 [2026-07-28 23:14:00,998][ INFO][PID:2864123] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": 1785280440.996261, "started_on": 1785279798.5918915, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10785247-centos-stream-9-s390x", "build_id": 10785247, "package_name": "bpftrace", "package_version": "0.26.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/bpftrace", "git_hash": "4ee4cf67840d9cfe47b3260c6300ff0dba0a496c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260728/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260728", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260728" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "10785247-bpftrace", "built_packages": "", "rpmeta_prediction": null, "id": 10785247, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2026-07-28 23:14:01,061][ INFO][PID:2864123] Sending fedora-messaging bus message in build.end [2026-07-28 23:14:01,102][ INFO][PID:2864123] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/builder-live.log by gzip [2026-07-28 23:14:01,104][ INFO][PID:2864123] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/builder-live.log' as PID 2975350 [2026-07-28 23:14:01,120][ INFO][PID:2864123] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/builder-live.log) [2026-07-28 23:14:01,122][ INFO][PID:2864123] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/backend.log by gzip [2026-07-28 23:14:01,125][ INFO][PID:2864123] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/10785247-bpftrace/backend.log' as PID 2975358