[2025-03-04 01:27:02,548][ INFO][PID:507916] Marking build as starting [2025-03-04 01:27:02,738][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:05,804][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617514, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105 [2025-03-04 01:27:05,804][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:05,805][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:06,199][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:06,428][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:06,429][ INFO][PID:507916] Warning: Permanently added '3.90.55.253' (ED25519) to the list of known hosts. [2025-03-04 01:27:06,429][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617514, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105': Builder wasn't ready, trying a new one [2025-03-04 01:27:06,430][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:06,441][ INFO][PID:507916] Retry #1 (on other host) [2025-03-04 01:27:06,443][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:09,478][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617515, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105 [2025-03-04 01:27:09,478][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:09,479][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:09,694][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:09,927][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:09,928][ INFO][PID:507916] Warning: Permanently added '3.90.55.253' (ED25519) to the list of known hosts. [2025-03-04 01:27:09,928][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617515, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105': Builder wasn't ready, trying a new one [2025-03-04 01:27:09,929][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:09,941][ INFO][PID:507916] Retry #2 (on other host) [2025-03-04 01:27:09,942][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:12,968][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617516, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105 [2025-03-04 01:27:12,969][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:12,969][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:13,165][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:13,387][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:13,388][ INFO][PID:507916] Warning: Permanently added '3.90.55.253' (ED25519) to the list of known hosts. [2025-03-04 01:27:13,388][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617516, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105': Builder wasn't ready, trying a new one [2025-03-04 01:27:13,389][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:13,401][ INFO][PID:507916] Retry #3 (on other host) [2025-03-04 01:27:13,402][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:16,435][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617517, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105 [2025-03-04 01:27:16,435][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:16,437][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:16,632][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:16,862][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:16,865][ INFO][PID:507916] Warning: Permanently added '3.90.55.253' (ED25519) to the list of known hosts. [2025-03-04 01:27:16,867][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617517, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105': Builder wasn't ready, trying a new one [2025-03-04 01:27:16,868][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:16,880][ INFO][PID:507916] Retry #4 (on other host) [2025-03-04 01:27:16,881][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:19,909][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617518, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105 [2025-03-04 01:27:19,909][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:19,910][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:20,107][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:20,332][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:20,333][ INFO][PID:507916] Warning: Permanently added '3.90.55.253' (ED25519) to the list of known hosts. [2025-03-04 01:27:20,333][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617518, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105': Builder wasn't ready, trying a new one [2025-03-04 01:27:20,334][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:20,343][ INFO][PID:507916] Retry #5 (on other host) [2025-03-04 01:27:20,344][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:23,369][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617519, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105 [2025-03-04 01:27:23,370][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:23,370][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:23,572][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:23,790][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:23,791][ INFO][PID:507916] Warning: Permanently added '3.90.55.253' (ED25519) to the list of known hosts. [2025-03-04 01:27:23,791][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617519, hostname=3.90.55.253, name=aws_aarch64_normal_prod_01655877_20250304_012105': Builder wasn't ready, trying a new one [2025-03-04 01:27:23,791][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:23,865][ INFO][PID:507916] Retry #6 (on other host) [2025-03-04 01:27:23,865][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:27:51,918][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617522, hostname=3.92.23.219, name=aws_aarch64_normalreserved_prod_01655887_20250304_012152 [2025-03-04 01:27:51,919][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:27:51,920][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:27:52,128][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:27:52,362][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:27:52,363][ INFO][PID:507916] Warning: Permanently added '3.92.23.219' (ED25519) to the list of known hosts. [2025-03-04 01:27:52,363][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617522, hostname=3.92.23.219, name=aws_aarch64_normalreserved_prod_01655887_20250304_012152': Builder wasn't ready, trying a new one [2025-03-04 01:27:52,364][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:27:52,376][ INFO][PID:507916] Retry #7 (on other host) [2025-03-04 01:27:52,377][ INFO][PID:507916] Trying to allocate VM [2025-03-04 01:28:04,419][ INFO][PID:507916] Allocated host ResallocHost, ticket_id=1617532, hostname=54.211.249.204, name=aws_aarch64_spot_prod_01655826_20250304_011742 [2025-03-04 01:28:04,420][ INFO][PID:507916] Allocating ssh connection to builder [2025-03-04 01:28:04,421][ INFO][PID:507916] Checking that builder machine is OK [2025-03-04 01:28:04,623][ INFO][PID:507916] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 01:28:04,850][ INFO][PID:507916] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 01:28:04,850][ INFO][PID:507916] Warning: Permanently added '54.211.249.204' (ED25519) to the list of known hosts. [2025-03-04 01:28:04,851][ ERROR][PID:507916] Re-try request for task on 'ResallocHost, ticket_id=1617532, hostname=54.211.249.204, name=aws_aarch64_spot_prod_01655826_20250304_011742': Builder wasn't ready, trying a new one [2025-03-04 01:28:04,851][ INFO][PID:507916] Releasing VM back to pool [2025-03-04 01:28:04,861][ ERROR][PID:507916] Backend process error: Three host tried without success: {'3.90.55.253', '3.92.23.219', '54.211.249.204'} [2025-03-04 01:28:04,862][WARNING][PID:507916] Switching not-finished job state to 'failed' [2025-03-04 01:28:04,862][ INFO][PID:507916] Worker failed build, took 62.32016634941101 [2025-03-04 01:28:04,864][ INFO][PID:507916] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "keithbowes", "project_name": "deponejo", "project_dirname": "deponejo", "submitter": "keithbowes", "ended_on": 1741051684.8622048, "started_on": 1741051622.5420384, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "8721518-opensuse-leap-15.5-aarch64", "build_id": 8721518, "package_name": "argagg", "package_version": "0.4.7-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/argagg", "git_hash": "381b2c8783b95fe0c4374c9b03883efff26f3a3e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "keithbowes/deponejo--keithbowes", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo", "result_dir": "08721518-argagg", "built_packages": "", "id": 8721518, "mockchain_macros": { "copr_username": "keithbowes", "copr_projectname": "deponejo", "vendor": "Fedora Project COPR (keithbowes/deponejo)" } } ] } [2025-03-04 01:28:05,035][ INFO][PID:507916] Sending fedora-messaging bus message in build.end [2025-03-04 01:28:06,732][ INFO][PID:507916] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721518-argagg/builder-live.log by gzip [2025-03-04 01:28:06,733][ INFO][PID:507916] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721518-argagg/builder-live.log' as PID 515288 [2025-03-04 01:28:06,734][ INFO][PID:507916] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721518-argagg/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721518-argagg/builder-live.log: No such file or directory [2025-03-04 01:28:06,735][ ERROR][PID:507916] Unable to compress file /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721518-argagg/builder-live.log [2025-03-04 01:28:06,736][ INFO][PID:507916] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721518-argagg/backend.log by gzip