[2026-09-15 05:27:23,720][ INFO][PID:2929004] Marking build as starting [2026-09-15 05:27:23,769][ INFO][PID:2929004] Checking that https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le//repodata/repomd.xml exists [2026-09-15 05:27:24,116][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:24,140][ INFO][PID:2929004] rpmeta: predicted 103 min for llvm on centos-stream-9-ppc64le -> keeping powerful builder tag [2026-09-15 05:27:24,141][ INFO][PID:2929004] VM allocation process starts [2026-09-15 05:27:24,148][ INFO][PID:2929004] Trying to allocate VM: ResallocHost, ticket_id=5029404, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder', 'on_demand_powerful'] [2026-09-15 05:27:29,149][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:34,150][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:39,151][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:44,152][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:49,153][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:54,154][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:27:59,155][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:04,155][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:09,156][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:14,157][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:19,158][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:24,159][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:29,159][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:34,160][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:39,161][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:44,162][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:49,163][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:54,164][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:28:59,165][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:04,165][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:09,166][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:14,167][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:19,168][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:24,169][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:29,170][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:34,171][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:39,172][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:44,773][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:50,783][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:29:55,784][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:00,785][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:05,786][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:10,786][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:15,787][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:20,788][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:25,789][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:30,790][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:35,790][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:40,793][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:42,226][ INFO][PID:2929004] Allocated host ResallocHost, ticket_id=5029404, hostname=2620:52:6:1161:dead:beef:cafe:c171, name=vmhost_p_p09_02_prod_37596688_20260915_052724, requested_tags=['arch_power9', 'arch_ppc64le', 'copr_builder', 'on_demand_powerful'] [2026-09-15 05:30:42,226][ INFO][PID:2929004] Allocating ssh connection to builder [2026-09-15 05:30:42,226][ INFO][PID:2929004] Checking that builder machine is OK [2026-09-15 05:30:43,099][ INFO][PID:2929004] Installed copr-rpmbuild version: 1.9 [2026-09-15 05:30:43,100][ INFO][PID:2929004] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2026-09-15 05:30:43,698][ INFO][PID:2929004] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2026-09-15 05:30:43,699][ INFO][PID:2929004] Filling build.info file with builder info [2026-09-15 05:30:43,699][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:43,700][ INFO][PID:2929004] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20260915", "project_dirname": "llvm-snapshots-big-merge-20260915", "submitter": "kkleine", "ended_on": null, "started_on": 1789450243.7000716, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10986668-centos-stream-9-ppc64le", "build_id": 10986668, "package_name": "llvm", "package_version": "23.1.0-11", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/llvm", "git_hash": "7f19fc2914aedf629b44447cbf2f57e9766bc62a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20260915--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9", "on_demand_powerful", "on_demand_powerful" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915", "result_dir": "10986668-llvm", "built_packages": "", "rpmeta_prediction": 103, "id": 10986668, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20260915", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20260915)" } } ] } [2026-09-15 05:30:43,758][ INFO][PID:2929004] Sending fedora-messaging bus message in build.start [2026-09-15 05:30:44,114][ INFO][PID:2929004] Sending fedora-messaging bus message in chroot.start [2026-09-15 05:30:44,134][ INFO][PID:2929004] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10986668-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2026-09-15 05:30:45,126][ INFO][PID:2929004] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c171' (ED25519) to the list of known hosts. [2026-09-15 05:30:45,308][ INFO][PID:2929004] Downloading the builder-live.log file, attempt 1 [2026-09-15 05:30:45,309][ INFO][PID:2929004] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c171 copr-rpmbuild-log [2026-09-15 05:30:50,313][ INFO][PID:2929004] Periodic builder liveness probe: alive [2026-09-15 05:30:50,314][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:30:55,314][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:00,315][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:05,316][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:10,317][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:15,318][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:20,319][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:25,320][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:30,321][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:35,322][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:40,322][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:45,323][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:50,324][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:31:55,615][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:00,616][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:05,618][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:10,619][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:15,620][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:20,621][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:25,676][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:30,677][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:35,678][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:40,679][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:45,804][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:50,804][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:32:55,850][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:00,898][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:05,900][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:10,900][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:15,901][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:20,903][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:25,904][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:30,905][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:35,973][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:40,975][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:46,029][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:51,247][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:33:56,249][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:01,264][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:06,265][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:11,331][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:16,334][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:21,368][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:26,368][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:31,370][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:36,371][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:41,536][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:47,029][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:52,030][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:34:57,603][ INFO][PID:2929004] Checking for cancel request [2026-09-15 05:35:01,506][ INFO][PID:2929004] Downloading results from builder [2026-09-15 05:35:01,667][ INFO][PID:2929004] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c171]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm started [2026-09-15 05:35:01,668][ INFO][PID:2929004] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c171]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/build-10986668.rsync.log [2026-09-15 05:35:19,930][ INFO][PID:2929004] rsyncing finished. [2026-09-15 05:35:19,931][ INFO][PID:2929004] VM Release request [2026-09-15 05:35:19,936][ INFO][PID:2929004] Searching for 'success' file in resultdir [2026-09-15 05:35:19,937][ ERROR][PID:2929004] Build failed: Backend process error: No success file => build failure [2026-09-15 05:35:19,942][ INFO][PID:2929004] Finished build: id=10986668 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915 chroot=centos-stream-9-ppc64le [2026-09-15 05:35:19,943][ ERROR][PID:2929004] Backend process error: No success file => build failure [2026-09-15 05:35:19,947][ INFO][PID:2929004] Worker failed build, took 276.24781608581543 [2026-09-15 05:35:19,948][ INFO][PID:2929004] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@fedora-llvm-team", "project_name": "llvm-snapshots-big-merge-20260915", "project_dirname": "llvm-snapshots-big-merge-20260915", "submitter": "kkleine", "ended_on": 1789450519.9478877, "started_on": 1789450243.7000716, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10986668-centos-stream-9-ppc64le", "build_id": 10986668, "package_name": "llvm", "package_version": "23.1.0-11", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/llvm", "git_hash": "7f19fc2914aedf629b44447cbf2f57e9766bc62a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20260915--kkleine", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/", "id": "copr_base", "module_hotfixes": true, "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/centos-stream-9-ppc64le/", "id": "copr_fedora_llvm_team_llvm_test_suite", "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9", "on_demand_powerful", "on_demand_powerful" ], "with_opts": [ "snapshot_build" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915", "result_dir": "10986668-llvm", "built_packages": "", "rpmeta_prediction": 103, "id": 10986668, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "llvm-snapshots-big-merge-20260915", "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20260915)" } } ] } [2026-09-15 05:35:19,985][ INFO][PID:2929004] Sending fedora-messaging bus message in build.end [2026-09-15 05:35:20,006][ INFO][PID:2929004] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/builder-live.log by gzip [2026-09-15 05:35:20,007][ INFO][PID:2929004] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/builder-live.log' as PID 3015641 [2026-09-15 05:35:20,053][ INFO][PID:2929004] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/builder-live.log) [2026-09-15 05:35:20,054][ INFO][PID:2929004] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/backend.log by gzip [2026-09-15 05:35:20,054][ INFO][PID:2929004] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20260915/centos-stream-9-ppc64le/10986668-llvm/backend.log' as PID 3015647