[2026-09-03 10:53:44,653][ INFO][PID:33692] Marking build as starting [2026-09-03 10:53:44,809][ INFO][PID:33692] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/repodata/repomd.xml exists [2026-09-03 10:53:45,003][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:53:45,005][ INFO][PID:33692] rpmeta: no HW info for arch s390x, skipping [2026-09-03 10:53:45,006][ INFO][PID:33692] VM allocation process starts [2026-09-03 10:53:45,020][ INFO][PID:33692] Trying to allocate VM: ResallocHost, ticket_id=4805849, requested_tags=['arch_s390x', 'copr_builder'] [2026-09-03 10:53:50,021][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:02,044][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:10,980][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:19,169][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:27,580][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:36,456][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:42,491][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:50,020][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:54:57,064][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:02,186][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:07,204][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:12,226][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:17,358][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:23,954][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:29,094][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:34,105][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:42,151][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:49,950][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:55:55,415][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:03,427][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:09,672][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:16,682][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:22,524][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:28,383][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:33,407][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:38,434][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:43,443][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:48,446][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:53,469][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:56:58,482][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:03,494][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:08,497][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:13,499][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:18,501][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:23,502][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:28,503][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:33,504][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:38,504][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:43,505][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:48,506][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:53,506][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:57:58,507][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:03,508][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:08,508][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:13,509][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:18,510][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:23,511][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:28,511][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:33,512][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:38,513][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:43,514][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:48,515][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:53,516][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:58:58,517][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:03,518][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:08,519][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:13,519][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:18,575][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:23,577][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:28,578][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:33,579][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:38,580][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:43,582][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:48,585][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:53,586][ INFO][PID:33692] Checking for cancel request [2026-09-03 10:59:58,587][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:03,588][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:08,589][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:13,591][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:18,593][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:23,594][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:28,595][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:33,595][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:38,596][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:43,597][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:48,598][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:53,599][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:00:58,600][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:03,601][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:08,602][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:13,604][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:18,607][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:23,608][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:28,611][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:33,612][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:38,636][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:43,638][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:48,639][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:53,641][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:01:58,642][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:03,147][ INFO][PID:33692] Allocated host ResallocHost, ticket_id=4805849, hostname=13.121.85.98, name=copr_ic_s390x_eu_es_2_prod_26638665_20260903_105809, requested_tags=['arch_s390x', 'copr_builder'] [2026-09-03 11:02:03,147][ INFO][PID:33692] Allocating ssh connection to builder [2026-09-03 11:02:03,148][ INFO][PID:33692] Checking that builder machine is OK [2026-09-03 11:02:04,540][ INFO][PID:33692] Installed copr-rpmbuild version: 1.9 [2026-09-03 11:02:04,541][ INFO][PID:33692] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-09-03 11:02:05,680][ INFO][PID:33692] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-09-03 11:02:05,680][ INFO][PID:33692] Filling build.info file with builder info [2026-09-03 11:02:05,681][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:05,681][ INFO][PID:33692] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-monthly-fedora-rebuild", "project_dirname": "clang-monthly-fedora-rebuild", "submitter": "kkleine", "ended_on": null, "started_on": 1788433325.6814523, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [ "fedora-clang-default-cc" ], "task_id": "10928949-fedora-rawhide-s390x", "build_id": 10928949, "package_name": "python-pymilter", "package_version": "1.0.6-19", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/python-pymilter", "git_hash": "bc1004d2957c4b52bfc7898bd6b816a59889be55", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/", "id": "copr_tstellar_fedora_clang_default_cc", "name": "Additional repo copr_tstellar_fedora_clang_default_cc", "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260827/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "toolchain_clang", "clang_lto" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "result_dir": "10928949-python-pymilter", "built_packages": "", "rpmeta_prediction": null, "id": 10928949, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-monthly-fedora-rebuild", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)" } } ] } [2026-09-03 11:02:05,716][ INFO][PID:33692] Sending fedora-messaging bus message in build.start [2026-09-03 11:02:06,706][ INFO][PID:33692] Sending fedora-messaging bus message in chroot.start [2026-09-03 11:02:06,801][ INFO][PID:33692] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10928949-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-09-03 11:02:08,437][ INFO][PID:33692] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.121.85.98' (ED25519) to the list of known hosts. [2026-09-03 11:02:08,438][ INFO][PID:33692] Downloading the builder-live.log file, attempt 1 [2026-09-03 11:02:08,440][ INFO][PID:33692] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.121.85.98 copr-rpmbuild-log [2026-09-03 11:02:13,442][ INFO][PID:33692] Periodic builder liveness probe: alive [2026-09-03 11:02:13,443][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:18,443][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:23,444][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:28,445][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:33,446][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:38,447][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:43,448][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:48,448][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:53,449][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:58,450][ INFO][PID:33692] Checking for cancel request [2026-09-03 11:02:59,407][ INFO][PID:33692] Downloading results from builder [2026-09-03 11:02:59,407][ INFO][PID:33692] rsyncing of mockbuilder@13.121.85.98:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter started [2026-09-03 11:02:59,408][ INFO][PID:33692] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.121.85.98:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/build-10928949.rsync.log [2026-09-03 11:03:01,496][ INFO][PID:33692] rsyncing finished. [2026-09-03 11:03:01,496][ INFO][PID:33692] VM Release request [2026-09-03 11:03:01,503][ INFO][PID:33692] Searching for 'success' file in resultdir [2026-09-03 11:03:01,503][ ERROR][PID:33692] Build failed: Backend process error: No success file => build failure [2026-09-03 11:03:01,509][ INFO][PID:33692] Finished build: id=10928949 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-s390x [2026-09-03 11:03:01,510][ ERROR][PID:33692] Backend process error: No success file => build failure [2026-09-03 11:03:01,514][ INFO][PID:33692] Worker failed build, took 55.83351421356201 [2026-09-03 11:03:01,515][ INFO][PID:33692] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-monthly-fedora-rebuild", "project_dirname": "clang-monthly-fedora-rebuild", "submitter": "kkleine", "ended_on": 1788433381.5149665, "started_on": 1788433325.6814523, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [ "fedora-clang-default-cc" ], "task_id": "10928949-fedora-rawhide-s390x", "build_id": 10928949, "package_name": "python-pymilter", "package_version": "1.0.6-19", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/python-pymilter", "git_hash": "bc1004d2957c4b52bfc7898bd6b816a59889be55", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-s390x/", "id": "copr_tstellar_fedora_clang_default_cc", "name": "Additional repo copr_tstellar_fedora_clang_default_cc", "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260827/fedora-rawhide-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20260827", "repo_gpgcheck": false } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [ "toolchain_clang", "clang_lto" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild", "result_dir": "10928949-python-pymilter", "built_packages": "", "rpmeta_prediction": null, "id": 10928949, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-monthly-fedora-rebuild", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)" } } ] } [2026-09-03 11:03:01,553][ INFO][PID:33692] Sending fedora-messaging bus message in build.end [2026-09-03 11:03:01,648][ INFO][PID:33692] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/builder-live.log by gzip [2026-09-03 11:03:01,649][ INFO][PID:33692] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/builder-live.log' as PID 260524 [2026-09-03 11:03:01,650][ INFO][PID:33692] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/builder-live.log) [2026-09-03 11:03:01,650][ INFO][PID:33692] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/backend.log by gzip [2026-09-03 11:03:01,651][ INFO][PID:33692] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-s390x/10928949-python-pymilter/backend.log' as PID 260525