[2025-03-04 02:22:55,591][ INFO][PID:863509] Marking build as starting [2025-03-04 02:22:56,081][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:02,113][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618434, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:02,113][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:02,114][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:02,471][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:02,675][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:02,675][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:02,676][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618434, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:02,676][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:02,718][ INFO][PID:863509] Retry #1 (on other host) [2025-03-04 02:23:02,719][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:05,744][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618436, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020 [2025-03-04 02:23:05,744][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:05,745][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:06,093][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:06,301][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:06,301][ INFO][PID:863509] Warning: Permanently added '54.90.109.176' (ED25519) to the list of known hosts. [2025-03-04 02:23:06,302][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618436, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020': Builder wasn't ready, trying a new one [2025-03-04 02:23:06,302][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:06,311][ INFO][PID:863509] Retry #2 (on other host) [2025-03-04 02:23:06,312][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:09,422][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618437, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:09,422][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:09,423][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:09,609][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:09,818][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:09,819][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:09,819][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618437, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:09,819][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:09,829][ INFO][PID:863509] Retry #3 (on other host) [2025-03-04 02:23:09,830][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:12,886][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618439, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020 [2025-03-04 02:23:12,887][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:12,887][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:13,070][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:13,275][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:13,275][ INFO][PID:863509] Warning: Permanently added '54.90.109.176' (ED25519) to the list of known hosts. [2025-03-04 02:23:13,276][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618439, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020': Builder wasn't ready, trying a new one [2025-03-04 02:23:13,276][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:13,285][ INFO][PID:863509] Retry #4 (on other host) [2025-03-04 02:23:13,286][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:16,386][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618441, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:16,386][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:16,387][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:16,567][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:16,771][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:16,772][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:16,772][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618441, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:16,773][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:16,781][ INFO][PID:863509] Retry #5 (on other host) [2025-03-04 02:23:16,782][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:19,880][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618444, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020 [2025-03-04 02:23:19,880][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:19,881][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:20,070][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:20,271][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:20,272][ INFO][PID:863509] Warning: Permanently added '54.90.109.176' (ED25519) to the list of known hosts. [2025-03-04 02:23:20,272][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618444, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020': Builder wasn't ready, trying a new one [2025-03-04 02:23:20,272][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:20,281][ INFO][PID:863509] Retry #6 (on other host) [2025-03-04 02:23:20,282][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:23,379][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618446, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:23,380][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:23,381][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:23,558][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:23,764][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:23,764][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:23,764][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618446, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:23,765][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:23,774][ INFO][PID:863509] Retry #7 (on other host) [2025-03-04 02:23:23,775][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:26,876][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618448, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020 [2025-03-04 02:23:26,876][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:26,877][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:27,062][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:27,260][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:27,261][ INFO][PID:863509] Warning: Permanently added '54.90.109.176' (ED25519) to the list of known hosts. [2025-03-04 02:23:27,262][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618448, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020': Builder wasn't ready, trying a new one [2025-03-04 02:23:27,262][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:27,271][ INFO][PID:863509] Retry #8 (on other host) [2025-03-04 02:23:27,271][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:30,369][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618450, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:30,369][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:30,370][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:30,557][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:30,758][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:30,758][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:30,759][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618450, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:30,759][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:30,767][ INFO][PID:863509] Retry #9 (on other host) [2025-03-04 02:23:30,768][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:33,869][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618452, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020 [2025-03-04 02:23:33,870][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:33,870][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:34,051][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:34,248][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:34,249][ INFO][PID:863509] Warning: Permanently added '54.90.109.176' (ED25519) to the list of known hosts. [2025-03-04 02:23:34,249][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618452, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020': Builder wasn't ready, trying a new one [2025-03-04 02:23:34,249][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:34,258][ INFO][PID:863509] Retry #10 (on other host) [2025-03-04 02:23:34,259][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:37,348][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618454, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:37,349][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:37,349][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:37,534][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:37,734][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:37,734][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:37,735][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618454, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:37,735][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:37,744][ INFO][PID:863509] Retry #11 (on other host) [2025-03-04 02:23:37,745][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:40,851][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618456, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020 [2025-03-04 02:23:40,851][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:40,852][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:41,032][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:41,236][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:41,237][ INFO][PID:863509] Warning: Permanently added '54.90.109.176' (ED25519) to the list of known hosts. [2025-03-04 02:23:41,237][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618456, hostname=54.90.109.176, name=aws_x86_64_normalreserved_prod_01656941_20250304_022020': Builder wasn't ready, trying a new one [2025-03-04 02:23:41,238][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:41,265][ INFO][PID:863509] Retry #12 (on other host) [2025-03-04 02:23:41,266][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:44,291][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618458, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007 [2025-03-04 02:23:44,291][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:44,292][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:44,473][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:44,675][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:44,675][ INFO][PID:863509] Warning: Permanently added '44.220.57.77' (ED25519) to the list of known hosts. [2025-03-04 02:23:44,676][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618458, hostname=44.220.57.77, name=aws_x86_64_normalreserved_prod_01656932_20250304_022007': Builder wasn't ready, trying a new one [2025-03-04 02:23:44,676][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:44,685][ INFO][PID:863509] Retry #13 (on other host) [2025-03-04 02:23:44,686][ INFO][PID:863509] Trying to allocate VM [2025-03-04 02:23:47,767][ INFO][PID:863509] Allocated host ResallocHost, ticket_id=1618460, hostname=3.223.127.113, name=aws_x86_64_normalreserved_prod_01656930_20250304_022000 [2025-03-04 02:23:47,767][ INFO][PID:863509] Allocating ssh connection to builder [2025-03-04 02:23:47,768][ INFO][PID:863509] Checking that builder machine is OK [2025-03-04 02:23:47,945][ INFO][PID:863509] Running remote command: copr-builder-ready opensuse-leap-15.5-x86_64 [2025-03-04 02:23:48,150][ INFO][PID:863509] Chroot config /etc/mock/opensuse-leap-15.5-x86_64.cfg not found [2025-03-04 02:23:48,150][ INFO][PID:863509] Warning: Permanently added '3.223.127.113' (ED25519) to the list of known hosts. [2025-03-04 02:23:48,151][ ERROR][PID:863509] Re-try request for task on 'ResallocHost, ticket_id=1618460, hostname=3.223.127.113, name=aws_x86_64_normalreserved_prod_01656930_20250304_022000': Builder wasn't ready, trying a new one [2025-03-04 02:23:48,151][ INFO][PID:863509] Releasing VM back to pool [2025-03-04 02:23:48,159][ ERROR][PID:863509] Backend process error: Three host tried without success: {'44.220.57.77', '54.90.109.176', '3.223.127.113'} [2025-03-04 02:23:48,160][WARNING][PID:863509] Switching not-finished job state to 'failed' [2025-03-04 02:23:48,160][ INFO][PID:863509] Worker failed build, took 52.57012677192688 [2025-03-04 02:23:48,161][ INFO][PID:863509] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "keithbowes", "project_name": "deponejo", "project_dirname": "deponejo", "submitter": "keithbowes", "ended_on": 1741055028.1604078, "started_on": 1741054975.590281, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "8721644-opensuse-leap-15.5-x86_64", "build_id": 8721644, "package_name": "argagg", "package_version": "0.4.7-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/argagg", "git_hash": "14fe7a285c8b24a201d611778142f08701ab0b2a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "keithbowes/deponejo--keithbowes", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo", "result_dir": "08721644-argagg", "built_packages": "", "id": 8721644, "mockchain_macros": { "copr_username": "keithbowes", "copr_projectname": "deponejo", "vendor": "Fedora Project COPR (keithbowes/deponejo)" } } ] } [2025-03-04 02:23:48,244][ INFO][PID:863509] Sending fedora-messaging bus message in build.end [2025-03-04 02:23:49,696][ INFO][PID:863509] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/builder-live.log by gzip [2025-03-04 02:23:49,698][ INFO][PID:863509] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/builder-live.log' as PID 867478 [2025-03-04 02:23:49,699][ INFO][PID:863509] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/builder-live.log: No such file or directory [2025-03-04 02:23:49,700][ ERROR][PID:863509] Unable to compress file /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/builder-live.log [2025-03-04 02:23:49,700][ INFO][PID:863509] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/backend.log by gzip [2025-03-04 02:23:49,701][ INFO][PID:863509] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/opensuse-leap-15.5-x86_64/08721644-argagg/backend.log' as PID 867479