[2025-08-10 08:28:47,193][ INFO][PID:261616] Marking build as starting [2025-08-10 08:28:47,309][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:28:47,310][ INFO][PID:261616] VM allocation process starts [2025-08-10 08:28:47,350][ INFO][PID:261616] Trying to allocate VM: ResallocHost, ticket_id=4403046, requested_tags=['copr_builder', 'arch_aarch64'] [2025-08-10 08:28:52,352][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:28:57,353][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:02,354][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:07,355][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:12,356][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:15,394][ INFO][PID:261616] Allocated host ResallocHost, ticket_id=4403046, hostname=13.223.59.97, name=aws_aarch64_spot_prod_06149548_20250810_082758, requested_tags=['copr_builder', 'arch_aarch64'] [2025-08-10 08:29:15,395][ INFO][PID:261616] Allocating ssh connection to builder [2025-08-10 08:29:15,395][ INFO][PID:261616] Checking that builder machine is OK [2025-08-10 08:29:15,754][ INFO][PID:261616] Running remote command: copr-builder-ready fedora-41-aarch64 [2025-08-10 08:29:15,981][ INFO][PID:261616] Red Hat subscription not needed for fedora-41-aarch64 Builder is ready to be used [2025-08-10 08:29:15,981][ INFO][PID:261616] Filling build.info file with builder info [2025-08-10 08:29:15,982][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:15,982][ INFO][PID:261616] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "fractal", "project_name": "PRD", "project_dirname": "PRD", "submitter": "fractal", "ended_on": null, "started_on": 1754814555.982777, "submitted_on": null, "status": 3, "chroot": "fedora-41-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9394766-fedora-41-aarch64", "build_id": 9394766, "package_name": "clasp", "package_version": "2.7.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/fractal/PRD/clasp", "git_hash": "99affbf9cf6a95d5552ac8fc8271414d982b4564", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "fractal/PRD--fractal", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/fractal/PRD/fedora-41-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/fractal/PRD/fedora-41-aarch64/", "id": "copr_fractal_PRD", "name": "Additional repo copr_fractal_PRD" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/fractal/PRD", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/fractal/PRD", "result_dir": "09394766-clasp", "built_packages": "", "id": 9394766, "mockchain_macros": { "copr_username": "fractal", "copr_projectname": "PRD", "vendor": "Fedora Project COPR (fractal/PRD)" } } ] } [2025-08-10 08:29:16,014][ INFO][PID:261616] Sending fedora-messaging bus message in build.start [2025-08-10 08:29:16,726][ INFO][PID:261616] Sending fedora-messaging bus message in chroot.start [2025-08-10 08:29:16,752][ INFO][PID:261616] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9394766-fedora-41-aarch64 --chroot fedora-41-aarch64 --detached [2025-08-10 08:29:17,148][ INFO][PID:261616] Downloading the builder-live.log file, attempt 1 [2025-08-10 08:29:17,150][ INFO][PID:261616] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.223.59.97 copr-rpmbuild-log [2025-08-10 08:29:22,156][ INFO][PID:261616] Periodic builder liveness probe: alive [2025-08-10 08:29:22,156][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:27,157][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:32,158][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:37,160][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:42,161][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:47,162][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:52,163][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:29:57,164][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:02,165][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:07,166][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:12,168][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:17,170][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:22,171][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:27,173][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:32,174][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:37,175][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:42,176][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:47,177][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:52,178][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:30:57,179][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:02,181][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:07,182][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:12,183][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:17,184][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:22,185][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:27,187][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:32,188][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:37,478][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:43,009][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:48,246][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:53,291][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:31:58,600][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:03,754][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:09,041][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:14,507][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:20,060][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:25,506][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:30,699][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:37,065][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:42,545][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:48,181][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:53,463][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:32:58,679][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:03,996][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:10,013][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:15,879][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:21,223][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:26,504][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:31,713][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:36,888][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:42,081][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:47,552][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:52,864][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:33:58,098][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:03,410][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:08,973][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:14,515][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:19,880][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:25,006][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:30,355][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:35,560][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:41,171][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:46,762][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:51,850][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:34:57,728][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:02,856][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:07,876][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:13,168][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:18,395][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:23,397][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:28,792][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:33,805][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:38,819][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:43,990][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:49,305][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:54,837][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:35:59,908][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:05,273][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:10,709][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:16,515][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:21,756][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:27,543][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:33,056][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:38,703][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:44,487][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:49,865][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:36:55,817][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:01,090][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:06,406][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:11,634][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:16,673][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:21,688][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:26,779][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:31,784][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:36,788][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:41,790][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:46,792][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:51,794][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:37:56,796][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:01,798][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:06,799][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:11,801][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:16,802][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:21,803][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:26,804][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:31,805][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:36,806][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:41,807][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:46,838][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:51,840][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:38:56,843][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:01,845][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:06,846][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:11,852][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:16,875][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:21,877][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:26,909][ INFO][PID:261616] Periodic builder liveness probe: alive [2025-08-10 08:39:26,910][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:31,911][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:36,923][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:41,955][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:46,967][ INFO][PID:261616] Checking for cancel request [2025-08-10 08:39:51,487][ INFO][PID:261616] Downloading results from builder [2025-08-10 08:39:51,488][ INFO][PID:261616] rsyncing of mockbuilder@13.223.59.97:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp started [2025-08-10 08:39:51,489][ INFO][PID:261616] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.223.59.97:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/ &> /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/build-09394766.rsync.log [2025-08-10 08:40:02,071][ INFO][PID:261616] rsyncing finished. [2025-08-10 08:40:02,071][ INFO][PID:261616] Releasing VM back to pool [2025-08-10 08:40:02,090][ INFO][PID:261616] Searching for 'success' file in resultdir [2025-08-10 08:40:02,090][ ERROR][PID:261616] Build failed: Backend process error: No success file => build failure [2025-08-10 08:40:02,091][ INFO][PID:261616] Finished build: id=9394766 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/fractal/PRD chroot=fedora-41-aarch64 [2025-08-10 08:40:02,093][ ERROR][PID:261616] Backend process error: No success file => build failure [2025-08-10 08:40:02,093][ INFO][PID:261616] Worker failed build, took 646.1109933853149 [2025-08-10 08:40:02,094][ INFO][PID:261616] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "fractal", "project_name": "PRD", "project_dirname": "PRD", "submitter": "fractal", "ended_on": 1754815202.0937705, "started_on": 1754814555.982777, "submitted_on": null, "status": 0, "chroot": "fedora-41-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "9394766-fedora-41-aarch64", "build_id": 9394766, "package_name": "clasp", "package_version": "2.7.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/fractal/PRD/clasp", "git_hash": "99affbf9cf6a95d5552ac8fc8271414d982b4564", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "fractal/PRD--fractal", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/fractal/PRD/fedora-41-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/fractal/PRD/fedora-41-aarch64/", "id": "copr_fractal_PRD", "name": "Additional repo copr_fractal_PRD" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/fractal/PRD", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/fractal/PRD", "result_dir": "09394766-clasp", "built_packages": "", "id": 9394766, "mockchain_macros": { "copr_username": "fractal", "copr_projectname": "PRD", "vendor": "Fedora Project COPR (fractal/PRD)" } } ] } [2025-08-10 08:40:02,129][ INFO][PID:261616] Sending fedora-messaging bus message in build.end [2025-08-10 08:40:02,152][ INFO][PID:261616] Compressing /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/builder-live.log by gzip [2025-08-10 08:40:02,154][ INFO][PID:261616] Running command 'gzip /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/builder-live.log' as PID 305235 [2025-08-10 08:40:02,176][ INFO][PID:261616] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/builder-live.log) [2025-08-10 08:40:02,176][ INFO][PID:261616] Compressing /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/backend.log by gzip [2025-08-10 08:40:02,177][ INFO][PID:261616] Running command 'gzip /var/lib/copr/public_html/results/fractal/PRD/fedora-41-aarch64/09394766-clasp/backend.log' as PID 305236