[2025-03-03 02:07:08,768][ INFO][PID:2539632] Marking build as starting [2025-03-03 02:07:08,819][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:11,976][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598013, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713 [2025-03-03 02:07:11,977][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:11,977][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:12,404][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:12,626][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:12,627][ INFO][PID:2539632] Warning: Permanently added '34.207.102.248' (ED25519) to the list of known hosts. [2025-03-03 02:07:12,628][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598013, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713': Builder wasn't ready, trying a new one [2025-03-03 02:07:12,628][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:12,674][ INFO][PID:2539632] Retry #1 (on other host) [2025-03-03 02:07:12,675][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:15,741][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598015, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210 [2025-03-03 02:07:15,742][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:15,742][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:16,143][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:16,384][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:16,385][ INFO][PID:2539632] Warning: Permanently added '44.207.6.148' (ED25519) to the list of known hosts. [2025-03-03 02:07:16,385][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598015, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210': Builder wasn't ready, trying a new one [2025-03-03 02:07:16,386][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:16,438][ INFO][PID:2539632] Retry #2 (on other host) [2025-03-03 02:07:16,439][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:19,481][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598016, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713 [2025-03-03 02:07:19,482][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:19,482][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:19,672][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:19,889][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:19,889][ INFO][PID:2539632] Warning: Permanently added '34.207.102.248' (ED25519) to the list of known hosts. [2025-03-03 02:07:19,890][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598016, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713': Builder wasn't ready, trying a new one [2025-03-03 02:07:19,890][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:19,901][ INFO][PID:2539632] Retry #3 (on other host) [2025-03-03 02:07:19,902][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:22,938][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598017, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210 [2025-03-03 02:07:22,939][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:22,939][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:23,143][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:23,371][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:23,371][ INFO][PID:2539632] Warning: Permanently added '44.207.6.148' (ED25519) to the list of known hosts. [2025-03-03 02:07:23,372][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598017, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210': Builder wasn't ready, trying a new one [2025-03-03 02:07:23,372][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:23,382][ INFO][PID:2539632] Retry #4 (on other host) [2025-03-03 02:07:23,383][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:26,466][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598018, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713 [2025-03-03 02:07:26,466][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:26,467][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:26,659][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:26,879][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:26,879][ INFO][PID:2539632] Warning: Permanently added '34.207.102.248' (ED25519) to the list of known hosts. [2025-03-03 02:07:26,880][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598018, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713': Builder wasn't ready, trying a new one [2025-03-03 02:07:26,880][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:26,890][ INFO][PID:2539632] Retry #5 (on other host) [2025-03-03 02:07:26,890][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:29,980][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598019, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210 [2025-03-03 02:07:29,984][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:29,985][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:30,243][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:30,512][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:30,513][ INFO][PID:2539632] Warning: Permanently added '44.207.6.148' (ED25519) to the list of known hosts. [2025-03-03 02:07:30,514][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598019, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210': Builder wasn't ready, trying a new one [2025-03-03 02:07:30,514][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:30,545][ INFO][PID:2539632] Retry #6 (on other host) [2025-03-03 02:07:30,546][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:33,629][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598023, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713 [2025-03-03 02:07:33,630][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:33,630][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:33,823][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:34,040][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:34,041][ INFO][PID:2539632] Warning: Permanently added '34.207.102.248' (ED25519) to the list of known hosts. [2025-03-03 02:07:34,042][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598023, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713': Builder wasn't ready, trying a new one [2025-03-03 02:07:34,042][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:34,055][ INFO][PID:2539632] Retry #7 (on other host) [2025-03-03 02:07:34,056][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:37,082][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598038, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210 [2025-03-03 02:07:37,082][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:37,083][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:37,290][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:37,524][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:37,525][ INFO][PID:2539632] Warning: Permanently added '44.207.6.148' (ED25519) to the list of known hosts. [2025-03-03 02:07:37,525][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598038, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210': Builder wasn't ready, trying a new one [2025-03-03 02:07:37,526][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:37,535][ INFO][PID:2539632] Retry #8 (on other host) [2025-03-03 02:07:37,536][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:40,627][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598039, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713 [2025-03-03 02:07:40,628][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:40,628][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:40,823][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:41,038][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:41,039][ INFO][PID:2539632] Warning: Permanently added '34.207.102.248' (ED25519) to the list of known hosts. [2025-03-03 02:07:41,039][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598039, hostname=34.207.102.248, name=aws_aarch64_normalreserved_prod_01606580_20250303_013713': Builder wasn't ready, trying a new one [2025-03-03 02:07:41,040][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:41,050][ INFO][PID:2539632] Retry #9 (on other host) [2025-03-03 02:07:41,051][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:44,078][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598040, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210 [2025-03-03 02:07:44,078][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:44,078][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:44,286][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:44,519][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:44,519][ INFO][PID:2539632] Warning: Permanently added '44.207.6.148' (ED25519) to the list of known hosts. [2025-03-03 02:07:44,520][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598040, hostname=44.207.6.148, name=aws_aarch64_spot_prod_01607889_20250303_020210': Builder wasn't ready, trying a new one [2025-03-03 02:07:44,520][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:44,533][ INFO][PID:2539632] Retry #10 (on other host) [2025-03-03 02:07:44,534][ INFO][PID:2539632] Trying to allocate VM [2025-03-03 02:07:47,562][ INFO][PID:2539632] Allocated host ResallocHost, ticket_id=1598041, hostname=34.229.234.250, name=aws_aarch64_spot_prod_01607904_20250303_020224 [2025-03-03 02:07:47,563][ INFO][PID:2539632] Allocating ssh connection to builder [2025-03-03 02:07:47,563][ INFO][PID:2539632] Checking that builder machine is OK [2025-03-03 02:07:47,969][ INFO][PID:2539632] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 02:07:48,192][ INFO][PID:2539632] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 02:07:48,193][ INFO][PID:2539632] Warning: Permanently added '34.229.234.250' (ED25519) to the list of known hosts. [2025-03-03 02:07:48,194][ ERROR][PID:2539632] Re-try request for task on 'ResallocHost, ticket_id=1598041, hostname=34.229.234.250, name=aws_aarch64_spot_prod_01607904_20250303_020224': Builder wasn't ready, trying a new one [2025-03-03 02:07:48,194][ INFO][PID:2539632] Releasing VM back to pool [2025-03-03 02:07:48,205][ ERROR][PID:2539632] Backend process error: Three host tried without success: {'44.207.6.148', '34.229.234.250', '34.207.102.248'} [2025-03-03 02:07:48,206][WARNING][PID:2539632] Switching not-finished job state to 'failed' [2025-03-03 02:07:48,207][ INFO][PID:2539632] Worker failed build, took 39.43897318840027 [2025-03-03 02:07:48,208][ INFO][PID:2539632] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "clarlok", "project_name": "tools", "project_dirname": "tools", "submitter": "clarlok", "ended_on": 1740967668.2067075, "started_on": 1740967628.7677343, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "8717902-opensuse-leap-15.5-aarch64", "build_id": 8717902, "package_name": "yazi", "package_version": "25.3.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/clarlok/tools/yazi", "git_hash": "3076e16a11429cdd00f4d2566890b14cf107735a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "clarlok/tools--clarlok", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/clarlok/tools/opensuse-leap-15.5-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/clarlok/tools", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/clarlok/tools", "result_dir": "08717902-yazi", "built_packages": "", "id": 8717902, "mockchain_macros": { "copr_username": "clarlok", "copr_projectname": "tools", "vendor": "Fedora Project COPR (clarlok/tools)" } } ] } [2025-03-03 02:07:48,246][ INFO][PID:2539632] Sending fedora-messaging bus message in build.end [2025-03-03 02:07:49,717][ INFO][PID:2539632] Compressing /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/builder-live.log by gzip [2025-03-03 02:07:49,719][ INFO][PID:2539632] Running command 'gzip /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/builder-live.log' as PID 2543420 [2025-03-03 02:07:49,720][ INFO][PID:2539632] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/builder-live.log: No such file or directory [2025-03-03 02:07:49,720][ ERROR][PID:2539632] Unable to compress file /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/builder-live.log [2025-03-03 02:07:49,721][ INFO][PID:2539632] Compressing /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/backend.log by gzip [2025-03-03 02:07:49,722][ INFO][PID:2539632] Running command 'gzip /var/lib/copr/public_html/results/clarlok/tools/opensuse-leap-15.5-aarch64/08717902-yazi/backend.log' as PID 2543422