[2026-10-02 16:15:54,498][ INFO][PID:3772860] Marking build as starting [2026-10-02 16:15:54,537][ INFO][PID:3772860] Checking that /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/repodata/repomd.xml exists [2026-10-02 16:15:54,539][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:15:54,559][ INFO][PID:3772860] rpmeta: predicted 76 min for mesa on fedora-44-x86_64 -> normal builder sufficient [2026-10-02 16:15:54,560][ INFO][PID:3772860] VM allocation process starts [2026-10-02 16:15:54,567][ INFO][PID:3772860] Trying to allocate VM: ResallocHost, ticket_id=5378002, requested_tags=['arch_x86_64', 'copr_builder'] [2026-10-02 16:15:59,569][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:04,569][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:09,570][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:14,571][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:19,572][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:24,573][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:29,574][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:34,575][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:39,576][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:44,576][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:49,577][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:54,578][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:16:59,579][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:04,580][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:09,581][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:14,582][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:19,583][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:24,584][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:29,585][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:34,586][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:39,587][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:44,588][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:49,589][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:54,590][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:17:59,591][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:04,591][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:09,592][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:14,593][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:19,594][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:24,597][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:29,597][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:34,598][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:39,599][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:44,600][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:49,601][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:54,602][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:18:59,603][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:04,604][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:09,604][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:14,605][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:19,606][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:24,607][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:29,608][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:34,609][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:39,609][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:44,612][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:49,613][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:54,613][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:19:59,614][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:04,615][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:09,616][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:14,617][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:19,618][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:24,620][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:29,621][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:34,630][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:39,631][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:44,631][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:49,632][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:54,633][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:20:59,634][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:04,634][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:09,635][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:14,636][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:19,637][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:24,638][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:29,639][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:34,640][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:39,640][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:44,641][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:49,642][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:54,643][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:21:59,644][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:04,645][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:09,646][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:14,647][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:19,648][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:24,649][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:29,650][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:34,651][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:39,651][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:44,652][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:49,653][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:54,654][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:22:59,654][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:04,655][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:09,656][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:14,657][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:19,658][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:24,659][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:29,660][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:34,661][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:39,661][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:44,663][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:49,663][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:54,665][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:23:59,666][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:04,667][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:09,668][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:14,668][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:19,670][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:24,672][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:29,673][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:34,674][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:39,675][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:44,675][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:49,676][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:54,677][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:24:59,678][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:04,679][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:09,680][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:12,668][ INFO][PID:3772860] Allocated host ResallocHost, ticket_id=5378002, hostname=2620:52:6:1161:dead:beef:cafe:c134, name=vmhost_x86_04_prod_44823363_20261002_162306, requested_tags=['arch_x86_64', 'copr_builder'] [2026-10-02 16:25:12,669][ INFO][PID:3772860] Allocating ssh connection to builder [2026-10-02 16:25:12,669][ INFO][PID:3772860] Checking that builder machine is OK [2026-10-02 16:25:13,236][ INFO][PID:3772860] Installed copr-rpmbuild version: 1.10 [2026-10-02 16:25:13,237][ INFO][PID:3772860] Running remote command: copr-builder-ready fedora-44-x86_64 [2026-10-02 16:25:13,562][ INFO][PID:3772860] Red Hat subscription not needed for fedora-44-x86_64 Builder is ready to be used [2026-10-02 16:25:13,562][ INFO][PID:3772860] Filling build.info file with builder info [2026-10-02 16:25:13,562][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:13,563][ INFO][PID:3772860] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "mesa-and-llvm-git", "project_dirname": "mesa-and-llvm-git", "submitter": null, "ended_on": null, "started_on": 1790958313.5632796, "submitted_on": null, "status": 3, "chroot": "fedora-44-x86_64", "arch": "x86_64", "buildroot_pkgs": [ "git", "libxml2" ], "task_id": "11064095-fedora-44-x86_64", "build_id": 11064095, "package_name": "mesa", "package_version": "26.3.0-0.3.20261002.15.9046ec1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/mesa-and-llvm-git/mesa", "git_hash": "8d2125862a9d0b8651c3ab728bdaf75d500c1bf2", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/mesa-and-llvm-git--241bf54e-feeb-4e81-b69e-a822149641e9", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/llvm/fedora-44-x86_64/", "id": "copr_xxmitsu_llvm_priority_10", "name": "Additional repo copr_xxmitsu_llvm_priority_10", "priority": 10, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/", "id": "copr_xxmitsu_mesa_and_llvm_git_priority_10", "name": "Additional repo copr_xxmitsu_mesa_and_llvm_git_priority_10", "priority": 10, "repo_gpgcheck": false } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-and-llvm-git", "result_dir": "11064095-mesa", "built_packages": "", "rpmeta_prediction": 76, "id": 11064095, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "mesa-and-llvm-git", "vendor": "Fedora Project COPR (xxmitsu/mesa-and-llvm-git)" } } ] } [2026-10-02 16:25:13,603][ INFO][PID:3772860] Sending fedora-messaging bus message in build.start [2026-10-02 16:25:13,969][ INFO][PID:3772860] Sending fedora-messaging bus message in chroot.start [2026-10-02 16:25:13,990][ INFO][PID:3772860] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11064095-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached [2026-10-02 16:25:14,593][ INFO][PID:3772860] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c134' (ED25519) to the list of known hosts. [2026-10-02 16:25:14,594][ INFO][PID:3772860] Downloading the builder-live.log file, attempt 1 [2026-10-02 16:25:14,595][ INFO][PID:3772860] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c134 copr-rpmbuild-log [2026-10-02 16:25:19,597][ INFO][PID:3772860] Periodic builder liveness probe: alive [2026-10-02 16:25:19,598][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:24,599][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:29,599][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:34,600][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:39,604][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:44,605][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:49,606][ INFO][PID:3772860] Checking for cancel request [2026-10-02 16:25:53,846][ INFO][PID:3772860] Downloading results from builder [2026-10-02 16:25:53,847][ INFO][PID:3772860] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c134]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa started [2026-10-02 16:25:53,848][ INFO][PID:3772860] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c134]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/ &> /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/build-11064095.rsync.log [2026-10-02 16:25:54,220][ INFO][PID:3772860] rsyncing finished. [2026-10-02 16:25:54,220][ INFO][PID:3772860] VM Release request [2026-10-02 16:25:54,227][ INFO][PID:3772860] Searching for 'success' file in resultdir [2026-10-02 16:25:54,228][ ERROR][PID:3772860] Build failed: Backend process error: No success file => build failure [2026-10-02 16:25:54,234][ INFO][PID:3772860] Finished build: id=11064095 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git chroot=fedora-44-x86_64 [2026-10-02 16:25:54,235][ ERROR][PID:3772860] Backend process error: No success file => build failure [2026-10-02 16:25:54,240][ INFO][PID:3772860] Worker failed build, took 40.67705988883972 [2026-10-02 16:25:54,241][ INFO][PID:3772860] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "mesa-and-llvm-git", "project_dirname": "mesa-and-llvm-git", "submitter": null, "ended_on": 1790958354.2403395, "started_on": 1790958313.5632796, "submitted_on": null, "status": 0, "chroot": "fedora-44-x86_64", "arch": "x86_64", "buildroot_pkgs": [ "git", "libxml2" ], "task_id": "11064095-fedora-44-x86_64", "build_id": 11064095, "package_name": "mesa", "package_version": "26.3.0-0.3.20261002.15.9046ec1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/mesa-and-llvm-git/mesa", "git_hash": "8d2125862a9d0b8651c3ab728bdaf75d500c1bf2", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/mesa-and-llvm-git--241bf54e-feeb-4e81-b69e-a822149641e9", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/llvm/fedora-44-x86_64/", "id": "copr_xxmitsu_llvm_priority_10", "name": "Additional repo copr_xxmitsu_llvm_priority_10", "priority": 10, "repo_gpgcheck": false }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/", "id": "copr_xxmitsu_mesa_and_llvm_git_priority_10", "name": "Additional repo copr_xxmitsu_mesa_and_llvm_git_priority_10", "priority": 10, "repo_gpgcheck": false } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-and-llvm-git", "result_dir": "11064095-mesa", "built_packages": "", "rpmeta_prediction": 76, "id": 11064095, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "mesa-and-llvm-git", "vendor": "Fedora Project COPR (xxmitsu/mesa-and-llvm-git)" } } ] } [2026-10-02 16:25:54,276][ INFO][PID:3772860] Sending fedora-messaging bus message in build.end [2026-10-02 16:25:54,299][ INFO][PID:3772860] Compressing /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/builder-live.log by gzip [2026-10-02 16:25:54,301][ INFO][PID:3772860] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/builder-live.log' as PID 3888993 [2026-10-02 16:25:54,304][ INFO][PID:3772860] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/builder-live.log) [2026-10-02 16:25:54,305][ INFO][PID:3772860] Compressing /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/backend.log by gzip [2026-10-02 16:25:54,307][ INFO][PID:3772860] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/mesa-and-llvm-git/fedora-44-x86_64/11064095-mesa/backend.log' as PID 3889001