[2025-03-03 17:37:50,155][ INFO][PID:1611176] Marking build as starting [2025-03-03 17:37:50,214][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:37:53,238][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610905, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458 [2025-03-03 17:37:53,239][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:37:53,239][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:37:53,643][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:37:53,881][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:37:53,882][ INFO][PID:1611176] Warning: Permanently added '54.172.6.186' (ED25519) to the list of known hosts. [2025-03-03 17:37:53,882][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610905, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458': Builder wasn't ready, trying a new one [2025-03-03 17:37:53,883][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:37:53,895][ INFO][PID:1611176] Retry #1 (on other host) [2025-03-03 17:37:53,896][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:37:56,924][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610907, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438 [2025-03-03 17:37:56,924][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:37:56,925][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:37:57,122][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:37:57,339][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:37:57,340][ INFO][PID:1611176] Warning: Permanently added '34.229.180.42' (ED25519) to the list of known hosts. [2025-03-03 17:37:57,340][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610907, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438': Builder wasn't ready, trying a new one [2025-03-03 17:37:57,341][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:37:57,351][ INFO][PID:1611176] Retry #2 (on other host) [2025-03-03 17:37:57,352][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:00,378][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610908, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458 [2025-03-03 17:38:00,379][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:00,379][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:00,584][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:00,811][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:00,812][ INFO][PID:1611176] Warning: Permanently added '54.172.6.186' (ED25519) to the list of known hosts. [2025-03-03 17:38:00,812][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610908, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458': Builder wasn't ready, trying a new one [2025-03-03 17:38:00,813][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:00,825][ INFO][PID:1611176] Retry #3 (on other host) [2025-03-03 17:38:00,826][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:03,858][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610909, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438 [2025-03-03 17:38:03,858][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:03,859][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:04,054][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:04,274][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:04,275][ INFO][PID:1611176] Warning: Permanently added '34.229.180.42' (ED25519) to the list of known hosts. [2025-03-03 17:38:04,275][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610909, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438': Builder wasn't ready, trying a new one [2025-03-03 17:38:04,275][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:04,288][ INFO][PID:1611176] Retry #4 (on other host) [2025-03-03 17:38:04,289][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:07,332][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610910, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458 [2025-03-03 17:38:07,332][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:07,333][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:07,537][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:07,767][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:07,768][ INFO][PID:1611176] Warning: Permanently added '54.172.6.186' (ED25519) to the list of known hosts. [2025-03-03 17:38:07,768][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610910, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458': Builder wasn't ready, trying a new one [2025-03-03 17:38:07,769][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:07,780][ INFO][PID:1611176] Retry #5 (on other host) [2025-03-03 17:38:07,781][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:10,873][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610911, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438 [2025-03-03 17:38:10,881][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:10,882][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:11,200][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:11,533][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:11,535][ INFO][PID:1611176] Warning: Permanently added '34.229.180.42' (ED25519) to the list of known hosts. [2025-03-03 17:38:11,539][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610911, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438': Builder wasn't ready, trying a new one [2025-03-03 17:38:11,544][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:11,583][ INFO][PID:1611176] Retry #6 (on other host) [2025-03-03 17:38:11,590][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:17,726][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610912, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438 [2025-03-03 17:38:17,727][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:17,727][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:17,929][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:18,157][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:18,158][ INFO][PID:1611176] Warning: Permanently added '34.229.180.42' (ED25519) to the list of known hosts. [2025-03-03 17:38:18,159][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610912, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438': Builder wasn't ready, trying a new one [2025-03-03 17:38:18,159][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:18,171][ INFO][PID:1611176] Retry #7 (on other host) [2025-03-03 17:38:18,173][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:24,242][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610953, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438 [2025-03-03 17:38:24,243][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:24,244][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:24,442][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:24,661][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:24,661][ INFO][PID:1611176] Warning: Permanently added '34.229.180.42' (ED25519) to the list of known hosts. [2025-03-03 17:38:24,662][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610953, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438': Builder wasn't ready, trying a new one [2025-03-03 17:38:24,662][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:24,675][ INFO][PID:1611176] Retry #8 (on other host) [2025-03-03 17:38:24,676][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:27,706][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610954, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458 [2025-03-03 17:38:27,707][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:27,708][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:28,112][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:28,343][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:28,344][ INFO][PID:1611176] Warning: Permanently added '54.172.6.186' (ED25519) to the list of known hosts. [2025-03-03 17:38:28,345][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610954, hostname=54.172.6.186, name=aws_aarch64_normalreserved_prod_01646731_20250303_173458': Builder wasn't ready, trying a new one [2025-03-03 17:38:28,346][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:28,358][ INFO][PID:1611176] Retry #9 (on other host) [2025-03-03 17:38:28,359][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:34,401][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610955, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438 [2025-03-03 17:38:34,402][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:34,402][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:34,597][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:34,817][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:34,818][ INFO][PID:1611176] Warning: Permanently added '34.229.180.42' (ED25519) to the list of known hosts. [2025-03-03 17:38:34,818][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610955, hostname=34.229.180.42, name=aws_aarch64_normalreserved_prod_01646703_20250303_173438': Builder wasn't ready, trying a new one [2025-03-03 17:38:34,819][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:34,831][ INFO][PID:1611176] Retry #10 (on other host) [2025-03-03 17:38:34,832][ INFO][PID:1611176] Trying to allocate VM [2025-03-03 17:38:40,872][ INFO][PID:1611176] Allocated host ResallocHost, ticket_id=1610960, hostname=54.224.239.179, name=aws_aarch64_normalreserved_prod_01646745_20250303_173508 [2025-03-03 17:38:40,873][ INFO][PID:1611176] Allocating ssh connection to builder [2025-03-03 17:38:40,873][ INFO][PID:1611176] Checking that builder machine is OK [2025-03-03 17:38:41,260][ INFO][PID:1611176] Running remote command: copr-builder-ready opensuse-leap-15.5-aarch64 [2025-03-03 17:38:41,482][ INFO][PID:1611176] Chroot config /etc/mock/opensuse-leap-15.5-aarch64.cfg not found [2025-03-03 17:38:41,482][ INFO][PID:1611176] Warning: Permanently added '54.224.239.179' (ED25519) to the list of known hosts. [2025-03-03 17:38:41,483][ ERROR][PID:1611176] Re-try request for task on 'ResallocHost, ticket_id=1610960, hostname=54.224.239.179, name=aws_aarch64_normalreserved_prod_01646745_20250303_173508': Builder wasn't ready, trying a new one [2025-03-03 17:38:41,483][ INFO][PID:1611176] Releasing VM back to pool [2025-03-03 17:38:41,496][ ERROR][PID:1611176] Backend process error: Three host tried without success: {'54.224.239.179', '34.229.180.42', '54.172.6.186'} [2025-03-03 17:38:41,496][WARNING][PID:1611176] Switching not-finished job state to 'failed' [2025-03-03 17:38:41,497][ INFO][PID:1611176] Worker failed build, took 51.34199500083923 [2025-03-03 17:38:41,497][ INFO][PID:1611176] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "victoriametrics", "project_name": "VictoriaMetrics-LTS", "project_dirname": "VictoriaMetrics-LTS", "submitter": "https://api.github.com/users/denisgolius", "ended_on": 1741023521.4969454, "started_on": 1741023470.1549504, "submitted_on": null, "status": 0, "chroot": "opensuse-leap-15.5-aarch64", "arch": "aarch64", "buildroot_pkgs": [], "task_id": "8720400-opensuse-leap-15.5-aarch64", "build_id": 8720400, "package_name": "vmrestore", "package_version": "1.112.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/victoriametrics/VictoriaMetrics-LTS/vmrestore", "git_hash": "8b5b576f5cdbd16b58429f1846a317c10a553ca1", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "victoriametrics/VictoriaMetrics-LTS--https://api.github.com/users/denisgolius", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/", "id": "copr_base", "name": "Copr repository", "priority": 1 } ], "tags": [ "arch_aarch64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/victoriametrics/VictoriaMetrics-LTS", "result_dir": "08720400-vmrestore", "built_packages": "", "id": 8720400, "mockchain_macros": { "copr_username": "victoriametrics", "copr_projectname": "VictoriaMetrics-LTS", "vendor": "Fedora Project COPR (victoriametrics/VictoriaMetrics-LTS)" } } ] } [2025-03-03 17:38:41,556][ INFO][PID:1611176] Sending fedora-messaging bus message in build.end [2025-03-03 17:38:42,286][ INFO][PID:1611176] Compressing /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/builder-live.log by gzip [2025-03-03 17:38:42,289][ INFO][PID:1611176] Running command 'gzip /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/builder-live.log' as PID 1618243 [2025-03-03 17:38:42,290][ INFO][PID:1611176] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/builder-live.log: No such file or directory [2025-03-03 17:38:42,291][ ERROR][PID:1611176] Unable to compress file /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/builder-live.log [2025-03-03 17:38:42,291][ INFO][PID:1611176] Compressing /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/backend.log by gzip [2025-03-03 17:38:42,292][ INFO][PID:1611176] Running command 'gzip /var/lib/copr/public_html/results/victoriametrics/VictoriaMetrics-LTS/opensuse-leap-15.5-aarch64/08720400-vmrestore/backend.log' as PID 1618244