[2025-03-04 02:43:14,213][ INFO][PID:943409] Marking build as starting [2025-03-04 02:43:14,373][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:17,437][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618592, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235 [2025-03-04 02:43:17,438][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:17,438][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:17,631][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:17,851][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:17,851][ INFO][PID:943409] Warning: Permanently added '3.89.152.20' (ED25519) to the list of known hosts. [2025-03-04 02:43:17,852][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618592, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235': Builder wasn't ready, trying a new one [2025-03-04 02:43:17,852][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:17,861][ INFO][PID:943409] Retry #1 (on other host) [2025-03-04 02:43:17,862][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:20,956][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618598, hostname=3.88.174.126, name=aws_aarch64_normalreserved_prod_01657155_20250304_023836 [2025-03-04 02:43:20,956][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:20,957][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:21,358][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:21,584][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:21,585][ INFO][PID:943409] Warning: Permanently added '3.88.174.126' (ED25519) to the list of known hosts. [2025-03-04 02:43:21,585][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618598, hostname=3.88.174.126, name=aws_aarch64_normalreserved_prod_01657155_20250304_023836': Builder wasn't ready, trying a new one [2025-03-04 02:43:21,586][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:21,597][ INFO][PID:943409] Retry #2 (on other host) [2025-03-04 02:43:21,598][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:24,628][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618600, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235 [2025-03-04 02:43:24,628][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:24,629][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:24,826][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:25,040][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:25,041][ INFO][PID:943409] Warning: Permanently added '3.89.152.20' (ED25519) to the list of known hosts. [2025-03-04 02:43:25,041][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618600, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235': Builder wasn't ready, trying a new one [2025-03-04 02:43:25,041][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:25,050][ INFO][PID:943409] Retry #3 (on other host) [2025-03-04 02:43:25,051][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:28,214][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618602, hostname=3.88.174.126, name=aws_aarch64_normalreserved_prod_01657155_20250304_023836 [2025-03-04 02:43:28,215][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:28,215][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:28,413][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:28,641][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:28,642][ INFO][PID:943409] Warning: Permanently added '3.88.174.126' (ED25519) to the list of known hosts. [2025-03-04 02:43:28,642][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618602, hostname=3.88.174.126, name=aws_aarch64_normalreserved_prod_01657155_20250304_023836': Builder wasn't ready, trying a new one [2025-03-04 02:43:28,642][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:28,652][ INFO][PID:943409] Retry #4 (on other host) [2025-03-04 02:43:28,653][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:31,680][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618604, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235 [2025-03-04 02:43:31,681][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:31,682][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:31,877][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:32,094][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:32,094][ INFO][PID:943409] Warning: Permanently added '3.89.152.20' (ED25519) to the list of known hosts. [2025-03-04 02:43:32,095][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618604, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235': Builder wasn't ready, trying a new one [2025-03-04 02:43:32,095][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:32,145][ INFO][PID:943409] Retry #5 (on other host) [2025-03-04 02:43:32,146][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:35,186][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618606, hostname=3.88.174.126, name=aws_aarch64_normalreserved_prod_01657155_20250304_023836 [2025-03-04 02:43:35,186][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:35,187][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:35,395][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:35,620][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:35,620][ INFO][PID:943409] Warning: Permanently added '3.88.174.126' (ED25519) to the list of known hosts. [2025-03-04 02:43:35,621][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618606, hostname=3.88.174.126, name=aws_aarch64_normalreserved_prod_01657155_20250304_023836': Builder wasn't ready, trying a new one [2025-03-04 02:43:35,621][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:35,631][ INFO][PID:943409] Retry #6 (on other host) [2025-03-04 02:43:35,631][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:38,652][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618611, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235 [2025-03-04 02:43:38,653][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:38,653][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:38,844][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:39,063][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:39,064][ INFO][PID:943409] Warning: Permanently added '3.89.152.20' (ED25519) to the list of known hosts. [2025-03-04 02:43:39,064][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618611, hostname=3.89.152.20, name=aws_aarch64_normalreserved_prod_01657087_20250304_023235': Builder wasn't ready, trying a new one [2025-03-04 02:43:39,065][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:39,075][ INFO][PID:943409] Retry #7 (on other host) [2025-03-04 02:43:39,076][ INFO][PID:943409] Trying to allocate VM [2025-03-04 02:43:42,099][ INFO][PID:943409] Allocated host ResallocHost, ticket_id=1618612, hostname=18.212.136.246, name=aws_aarch64_normalreserved_prod_01657130_20250304_023600 [2025-03-04 02:43:42,100][ INFO][PID:943409] Allocating ssh connection to builder [2025-03-04 02:43:42,100][ INFO][PID:943409] Checking that builder machine is OK [2025-03-04 02:43:42,292][ INFO][PID:943409] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-04 02:43:42,505][ INFO][PID:943409] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-04 02:43:42,506][ INFO][PID:943409] Warning: Permanently added '18.212.136.246' (ED25519) to the list of known hosts. [2025-03-04 02:43:42,506][ ERROR][PID:943409] Re-try request for task on 'ResallocHost, ticket_id=1618612, hostname=18.212.136.246, name=aws_aarch64_normalreserved_prod_01657130_20250304_023600': Builder wasn't ready, trying a new one [2025-03-04 02:43:42,506][ INFO][PID:943409] Releasing VM back to pool [2025-03-04 02:43:42,519][ ERROR][PID:943409] Backend process error: Three host tried without success: {'18.212.136.246', '3.89.152.20', '3.88.174.126'} [2025-03-04 02:43:42,519][WARNING][PID:943409] Switching not-finished job state to 'failed' [2025-03-04 02:43:42,520][ INFO][PID:943409] Worker failed build, took 28.30728793144226 [2025-03-04 02:43:42,521][ INFO][PID:943409] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "keithbowes", "project_name": "deponejo", "project_dirname": "deponejo", "submitter": "keithbowes", "ended_on": 1741056222.5197918, "started_on": 1741056194.212504, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "8721658-opensuse-leap-15.5-aarch64", "build_id": 8721658, "package_name": "argagg", "package_version": "0.4.7-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/argagg", "git_hash": "724cbb311257b2c7822130ee3cac400cb199e653", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "keithbowes/deponejo--keithbowes", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo", "result_dir": "08721658-argagg", "built_packages": "", "id": 8721658, "mockchain_macros": { "copr_username": "keithbowes", "copr_projectname": "deponejo", "vendor": "Fedora Project COPR (keithbowes/deponejo)" } } ] } [2025-03-04 02:43:42,595][ INFO][PID:943409] Sending fedora-messaging bus message in build.end [2025-03-04 02:43:43,150][ INFO][PID:943409] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/builder-live.log by gzip [2025-03-04 02:43:43,152][ INFO][PID:943409] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/builder-live.log' as PID 945758 [2025-03-04 02:43:43,153][ INFO][PID:943409] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/builder-live.log: No such file or directory [2025-03-04 02:43:43,153][ ERROR][PID:943409] Unable to compress file /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/builder-live.log [2025-03-04 02:43:43,154][ INFO][PID:943409] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/backend.log by gzip [2025-03-04 02:43:43,155][ INFO][PID:943409] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-aarch64/08721658-argagg/backend.log' as PID 945759