[2025-03-02 11:13:55,873][ INFO][PID:1964791] Marking build as starting [2025-03-02 11:13:56,899][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:03,007][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589708, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742 [2025-03-02 11:14:03,008][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:03,009][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:03,422][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:03,650][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:03,651][ INFO][PID:1964791] Warning: Permanently added '3.87.154.32' (ED25519) to the list of known hosts. [2025-03-02 11:14:03,651][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589708, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:03,652][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:03,662][ INFO][PID:1964791] Retry #1 (on other host) [2025-03-02 11:14:03,664][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:06,688][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589714, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742 [2025-03-02 11:14:06,689][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:06,689][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:07,086][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:07,322][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:07,323][ INFO][PID:1964791] Warning: Permanently added '54.225.6.202' (ED25519) to the list of known hosts. [2025-03-02 11:14:07,323][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589714, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:07,323][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:07,332][ INFO][PID:1964791] Retry #2 (on other host) [2025-03-02 11:14:07,333][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:10,429][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589715, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742 [2025-03-02 11:14:10,430][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:10,430][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:10,629][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:10,854][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:10,854][ INFO][PID:1964791] Warning: Permanently added '3.87.154.32' (ED25519) to the list of known hosts. [2025-03-02 11:14:10,855][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589715, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:10,855][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:10,864][ INFO][PID:1964791] Retry #3 (on other host) [2025-03-02 11:14:10,865][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:13,972][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589717, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742 [2025-03-02 11:14:13,973][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:13,973][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:14,176][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:14,406][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:14,407][ INFO][PID:1964791] Warning: Permanently added '54.225.6.202' (ED25519) to the list of known hosts. [2025-03-02 11:14:14,407][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589717, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:14,408][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:14,416][ INFO][PID:1964791] Retry #4 (on other host) [2025-03-02 11:14:14,417][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:17,507][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589719, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742 [2025-03-02 11:14:17,508][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:17,508][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:17,702][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:17,925][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:17,926][ INFO][PID:1964791] Warning: Permanently added '3.87.154.32' (ED25519) to the list of known hosts. [2025-03-02 11:14:17,926][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589719, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:17,927][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:17,938][ INFO][PID:1964791] Retry #5 (on other host) [2025-03-02 11:14:17,939][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:20,963][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589721, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742 [2025-03-02 11:14:20,963][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:20,964][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:21,163][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:21,394][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:21,395][ INFO][PID:1964791] Warning: Permanently added '54.225.6.202' (ED25519) to the list of known hosts. [2025-03-02 11:14:21,395][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589721, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:21,396][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:21,449][ INFO][PID:1964791] Retry #6 (on other host) [2025-03-02 11:14:21,450][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:24,492][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589723, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742 [2025-03-02 11:14:24,493][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:24,493][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:24,688][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:24,910][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:24,910][ INFO][PID:1964791] Warning: Permanently added '3.87.154.32' (ED25519) to the list of known hosts. [2025-03-02 11:14:24,911][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589723, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:24,911][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:24,920][ INFO][PID:1964791] Retry #7 (on other host) [2025-03-02 11:14:24,921][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:28,020][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589725, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742 [2025-03-02 11:14:28,020][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:28,020][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:28,230][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:28,454][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:28,455][ INFO][PID:1964791] Warning: Permanently added '54.225.6.202' (ED25519) to the list of known hosts. [2025-03-02 11:14:28,455][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589725, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:28,455][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:28,463][ INFO][PID:1964791] Retry #8 (on other host) [2025-03-02 11:14:28,464][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:31,562][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589727, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742 [2025-03-02 11:14:31,562][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:31,563][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:31,758][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:31,980][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:31,980][ INFO][PID:1964791] Warning: Permanently added '3.87.154.32' (ED25519) to the list of known hosts. [2025-03-02 11:14:31,981][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589727, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:31,981][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:32,027][ INFO][PID:1964791] Retry #9 (on other host) [2025-03-02 11:14:32,027][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:35,052][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589729, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742 [2025-03-02 11:14:35,053][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:35,053][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:35,249][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:35,475][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:35,475][ INFO][PID:1964791] Warning: Permanently added '54.225.6.202' (ED25519) to the list of known hosts. [2025-03-02 11:14:35,476][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589729, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:35,476][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:35,490][ INFO][PID:1964791] Retry #10 (on other host) [2025-03-02 11:14:35,491][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:38,519][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589735, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742 [2025-03-02 11:14:38,520][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:38,521][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:38,714][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:38,935][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:38,936][ INFO][PID:1964791] Warning: Permanently added '3.87.154.32' (ED25519) to the list of known hosts. [2025-03-02 11:14:38,936][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589735, hostname=3.87.154.32, name=aws_aarch64_normalreserved_prod_01593551_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:38,937][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:38,949][ INFO][PID:1964791] Retry #11 (on other host) [2025-03-02 11:14:38,950][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:41,976][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589737, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742 [2025-03-02 11:14:41,977][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:41,977][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:42,182][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:42,410][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:42,410][ INFO][PID:1964791] Warning: Permanently added '54.225.6.202' (ED25519) to the list of known hosts. [2025-03-02 11:14:42,411][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589737, hostname=54.225.6.202, name=aws_aarch64_normalreserved_prod_01593553_20250302_110742': Builder wasn't ready, trying a new one [2025-03-02 11:14:42,411][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:42,420][ INFO][PID:1964791] Retry #12 (on other host) [2025-03-02 11:14:42,421][ INFO][PID:1964791] Trying to allocate VM [2025-03-02 11:14:45,519][ INFO][PID:1964791] Allocated host ResallocHost, ticket_id=1589738, hostname=3.92.31.116, name=aws_aarch64_normalreserved_prod_01593517_20250302_110445 [2025-03-02 11:14:45,520][ INFO][PID:1964791] Allocating ssh connection to builder [2025-03-02 11:14:45,520][ INFO][PID:1964791] Checking that builder machine is OK [2025-03-02 11:14:45,718][ INFO][PID:1964791] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-02 11:14:45,938][ INFO][PID:1964791] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-02 11:14:45,939][ INFO][PID:1964791] Warning: Permanently added '3.92.31.116' (ED25519) to the list of known hosts. [2025-03-02 11:14:45,939][ ERROR][PID:1964791] Re-try request for task on 'ResallocHost, ticket_id=1589738, hostname=3.92.31.116, name=aws_aarch64_normalreserved_prod_01593517_20250302_110445': Builder wasn't ready, trying a new one [2025-03-02 11:14:45,940][ INFO][PID:1964791] Releasing VM back to pool [2025-03-02 11:14:45,949][ ERROR][PID:1964791] Backend process error: Three host tried without success: {'54.225.6.202', '3.92.31.116', '3.87.154.32'} [2025-03-02 11:14:45,950][WARNING][PID:1964791] Switching not-finished job state to 'failed' [2025-03-02 11:14:45,950][ INFO][PID:1964791] Worker failed build, took 50.07734727859497 [2025-03-02 11:14:45,950][ INFO][PID:1964791] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "vandebugger", "project_name": "testing", "project_dirname": "testing", "submitter": "vandebugger", "ended_on": 1740914085.950037, "started_on": 1740914035.8726897, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "8716608-opensuse-leap-15.5-aarch64", "build_id": 8716608, "package_name": "vdb-color-prompt", "package_version": "0.1.0-0.vdb.1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/vandebugger/testing/vdb-color-prompt", "git_hash": "3e44a7caf0a843aa203eb3ac2667ee83996a83d2", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "vandebugger/testing--vandebugger", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/vandebugger/testing/opensuse-leap-15.5-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/vandebugger/testing/opensuse-leap-15.5-aarch64/", "id": "copr_vandebugger_testing", "name": "Additional repo copr_vandebugger_testing" } ], "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [ "gnome_45" ], "destdir": "/var/lib/copr/public_html/results/vandebugger/testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/vandebugger/testing", "result_dir": "08716608-vdb-color-prompt", "built_packages": "", "id": 8716608, "mockchain_macros": { "copr_username": "vandebugger", "copr_projectname": "testing", "vendor": "Fedora Project COPR (vandebugger/testing)" } } ] } [2025-03-02 11:14:46,046][ INFO][PID:1964791] Sending fedora-messaging bus message in build.end [2025-03-02 11:14:46,693][ INFO][PID:1964791] Compressing /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/builder-live.log by gzip [2025-03-02 11:14:46,695][ INFO][PID:1964791] Running command 'gzip /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/builder-live.log' as PID 1977907 [2025-03-02 11:14:46,696][ INFO][PID:1964791] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/builder-live.log: No such file or directory [2025-03-02 11:14:46,697][ ERROR][PID:1964791] Unable to compress file /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/builder-live.log [2025-03-02 11:14:46,697][ INFO][PID:1964791] Compressing /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/backend.log by gzip [2025-03-02 11:14:46,698][ INFO][PID:1964791] Running command 'gzip /var/lib/copr/public_html/results/vandebugger/testing/opensuse-leap-15.5-aarch64/08716608-vdb-color-prompt/backend.log' as PID 1977909