[2026-06-06 05:47:11,820][ INFO][PID:1471181] Marking build as starting [2026-06-06 05:47:11,878][ INFO][PID:1471181] Checking that /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/repodata/repomd.xml exists [2026-06-06 05:47:11,950][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:11,988][ INFO][PID:1471181] rpmeta: predicted 5 min for vespa-jllama on epel-8-x86_64 -> normal builder sufficient [2026-06-06 05:47:11,990][ INFO][PID:1471181] VM allocation process starts [2026-06-06 05:47:12,014][ INFO][PID:1471181] Trying to allocate VM: ResallocHost, ticket_id=3312160, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-06 05:47:17,017][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:22,018][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:27,020][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:30,063][ INFO][PID:1471181] Allocated host ResallocHost, ticket_id=3312160, hostname=32.198.88.15, name=aws_x86_64_reserved_prod_10821826_20260606_050606, requested_tags=['arch_x86_64', 'copr_builder'] [2026-06-06 05:47:30,064][ INFO][PID:1471181] Allocating ssh connection to builder [2026-06-06 05:47:30,064][ INFO][PID:1471181] Checking that builder machine is OK [2026-06-06 05:47:30,400][ INFO][PID:1471181] Installed copr-rpmbuild version: 1.8 [2026-06-06 05:47:30,401][ INFO][PID:1471181] Running remote command: copr-builder-ready epel-8-x86_64 [2026-06-06 05:47:30,619][ INFO][PID:1471181] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-06-06 05:47:30,619][ INFO][PID:1471181] Filling build.info file with builder info [2026-06-06 05:47:30,620][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:30,621][ INFO][PID:1471181] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@vespa", "project_name": "vespa", "project_dirname": "vespa", "submitter": "arnej27959", "ended_on": null, "started_on": 1780724850.6213434, "submitted_on": null, "status": 3, "chroot": "epel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10572984-epel-8-x86_64", "build_id": 10572984, "package_name": "vespa-jllama", "package_version": "4.7.9-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@vespa/vespa/vespa-jllama", "git_hash": "005b97fa800b5d297b2209ea95f139ab0f0fa51c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@vespa/vespa--arnej27959", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa/epel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://copr-be.cloud.fedoraproject.org/results/@vespa/vespa/epel-8-$basearch/", "id": "https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch", "name": "Additional repo https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch" }, { "baseurl": "http://download.fedoraproject.org/pub/epel/8/Everything/$basearch", "id": "http_download_fedoraproject_org_pub_epel_8_Everything_basearch", "name": "Additional repo http_download_fedoraproject_org_pub_epel_8_Everything_basearch" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64" }, { "baseurl": "https://dl.cloudsmith.io/public/vespa/open-source-rpms/rpm/el/8/$basearch", "id": "https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch", "name": "Additional repo https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch" } ], "background": false, "fedora_review": false, "isolation": "default", "modules": { "toggle": [ { "enable": "maven:3.8" } ] }, "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@vespa/vespa", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa", "result_dir": "10572984-vespa-jllama", "built_packages": "", "rpmeta_prediction": 5, "id": 10572984, "mockchain_macros": { "copr_username": "@vespa", "copr_projectname": "vespa", "vendor": "Fedora Project COPR (@vespa/vespa)" } } ] } [2026-06-06 05:47:30,677][ INFO][PID:1471181] Sending fedora-messaging bus message in build.start [2026-06-06 05:47:31,170][ INFO][PID:1471181] Sending fedora-messaging bus message in chroot.start [2026-06-06 05:47:31,203][ INFO][PID:1471181] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10572984-epel-8-x86_64 --chroot epel-8-x86_64 --detached [2026-06-06 05:47:31,673][ INFO][PID:1471181] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '32.198.88.15' (ED25519) to the list of known hosts. [2026-06-06 05:47:31,674][ INFO][PID:1471181] Downloading the builder-live.log file, attempt 1 [2026-06-06 05:47:31,705][ INFO][PID:1471181] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@32.198.88.15 copr-rpmbuild-log [2026-06-06 05:47:36,686][ INFO][PID:1471181] Periodic builder liveness probe: alive [2026-06-06 05:47:36,686][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:41,687][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:46,689][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:51,690][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:47:56,692][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:01,693][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:06,694][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:11,695][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:16,697][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:21,698][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:26,700][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:31,817][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:36,819][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:41,821][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:46,822][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:51,824][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:48:56,825][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:01,827][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:06,828][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:11,830][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:16,831][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:22,015][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:27,022][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:32,215][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:37,322][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:42,340][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:47,362][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:52,503][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:49:57,531][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:02,615][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:07,701][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:12,733][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:17,771][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:22,789][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:27,986][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:33,125][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:38,262][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:43,308][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:48,330][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:53,432][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:50:58,469][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:03,600][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:08,742][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:13,749][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:19,013][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:24,029][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:29,344][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:34,357][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:39,478][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:44,863][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:49,864][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:51:55,019][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:00,049][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:05,056][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:10,198][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:15,484][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:20,609][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:25,786][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:30,790][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:35,846][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:40,865][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:45,877][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:50,905][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:52:55,910][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:00,951][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:05,967][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:10,980][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:16,071][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:21,074][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:26,116][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:31,165][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:36,349][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:41,389][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:46,720][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:51,856][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:53:57,982][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:03,087][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:08,339][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:14,496][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:19,704][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:24,952][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:30,090][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:35,201][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:40,322][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:45,597][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:50,824][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:54:55,827][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:00,881][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:06,031][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:11,115][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:16,130][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:21,250][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:26,741][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:31,760][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:36,799][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:42,896][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:47,907][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:52,951][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:55:58,063][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:04,290][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:09,316][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:14,503][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:19,846][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:25,818][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:30,917][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:36,739][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:42,020][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:47,084][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:52,103][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:56:57,468][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:03,711][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:08,856][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:14,098][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:20,708][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:26,241][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:32,129][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:37,788][ INFO][PID:1471181] Periodic builder liveness probe: alive [2026-06-06 05:57:37,894][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:42,897][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:47,898][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:52,900][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:57:57,905][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:02,908][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:07,910][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:12,912][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:17,914][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:22,915][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:27,917][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:32,929][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:38,839][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:44,153][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:50,049][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:58:55,289][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:59:00,834][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:59:06,530][ INFO][PID:1471181] Checking for cancel request [2026-06-06 05:59:08,876][ INFO][PID:1471181] Downloading results from builder [2026-06-06 05:59:09,035][ INFO][PID:1471181] rsyncing of mockbuilder@32.198.88.15:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama started [2026-06-06 05:59:09,308][ INFO][PID:1471181] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@32.198.88.15:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/ &> /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/build-10572984.rsync.log [2026-06-06 05:59:09,643][ INFO][PID:1471181] rsyncing finished. [2026-06-06 05:59:09,685][ INFO][PID:1471181] VM Release request [2026-06-06 05:59:09,765][ INFO][PID:1471181] Searching for 'success' file in resultdir [2026-06-06 05:59:09,773][ ERROR][PID:1471181] Build failed: Backend process error: No success file => build failure [2026-06-06 05:59:10,537][ INFO][PID:1471181] Finished build: id=10572984 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@vespa/vespa chroot=epel-8-x86_64 [2026-06-06 05:59:11,798][ ERROR][PID:1471181] Backend process error: No success file => build failure [2026-06-06 05:59:13,886][ INFO][PID:1471181] Worker failed build, took 703.2648906707764 [2026-06-06 05:59:14,011][ INFO][PID:1471181] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "@vespa", "project_name": "vespa", "project_dirname": "vespa", "submitter": "arnej27959", "ended_on": 1780725553.886234, "started_on": 1780724850.6213434, "submitted_on": null, "status": 0, "chroot": "epel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10572984-epel-8-x86_64", "build_id": 10572984, "package_name": "vespa-jllama", "package_version": "4.7.9-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@vespa/vespa/vespa-jllama", "git_hash": "005b97fa800b5d297b2209ea95f139ab0f0fa51c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@vespa/vespa--arnej27959", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa/epel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://copr-be.cloud.fedoraproject.org/results/@vespa/vespa/epel-8-$basearch/", "id": "https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch", "name": "Additional repo https_copr_be_cloud_fedoraproject_org_results_vespa_vespa_epel_8_basearch" }, { "baseurl": "http://download.fedoraproject.org/pub/epel/8/Everything/$basearch", "id": "http_download_fedoraproject_org_pub_epel_8_Everything_basearch", "name": "Additional repo http_download_fedoraproject_org_pub_epel_8_Everything_basearch" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel8_x86_64" }, { "baseurl": "https://dl.cloudsmith.io/public/vespa/open-source-rpms/rpm/el/8/$basearch", "id": "https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch", "name": "Additional repo https_dl_cloudsmith_io_public_vespa_open_source_rpms_rpm_el_8_basearch" } ], "background": false, "fedora_review": false, "isolation": "default", "modules": { "toggle": [ { "enable": "maven:3.8" } ] }, "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@vespa/vespa", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@vespa/vespa", "result_dir": "10572984-vespa-jllama", "built_packages": "", "rpmeta_prediction": 5, "id": 10572984, "mockchain_macros": { "copr_username": "@vespa", "copr_projectname": "vespa", "vendor": "Fedora Project COPR (@vespa/vespa)" } } ] } [2026-06-06 05:59:16,176][ INFO][PID:1471181] Sending fedora-messaging bus message in build.end [2026-06-06 05:59:16,723][ INFO][PID:1471181] Compressing /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/builder-live.log by gzip [2026-06-06 05:59:16,742][ INFO][PID:1471181] Running command 'gzip /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/builder-live.log' as PID 1536737 [2026-06-06 05:59:16,841][ INFO][PID:1471181] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/builder-live.log) [2026-06-06 05:59:16,848][ INFO][PID:1471181] Compressing /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/backend.log by gzip [2026-06-06 05:59:16,849][ INFO][PID:1471181] Running command 'gzip /var/lib/copr/public_html/results/@vespa/vespa/epel-8-x86_64/10572984-vespa-jllama/backend.log' as PID 1536741