[2026-04-20 13:48:49,933][ INFO][PID:2382441] Marking build as starting [2026-04-20 13:48:50,022][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:48:50,029][ INFO][PID:2382441] VM allocation process starts [2026-04-20 13:48:50,065][ INFO][PID:2382441] Trying to allocate VM: ResallocHost, ticket_id=2423016, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-20 13:48:55,082][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:00,090][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:05,094][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:10,105][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:15,110][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:18,339][ INFO][PID:2382441] Allocated host ResallocHost, ticket_id=2423016, hostname=3.88.191.218, name=aws_x86_64_normal_prod_07133190_20260420_134330, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-20 13:49:18,340][ INFO][PID:2382441] Allocating ssh connection to builder [2026-04-20 13:49:18,345][ INFO][PID:2382441] Checking that builder machine is OK [2026-04-20 13:49:18,490][ ERROR][PID:2382441] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '3.88.191.218' (ED25519) to the list of known hosts. Load key "/home/copr/.ssh/id_rsa": Permission denied Permission denied, please try again. Permission denied, please try again. mockbuilder@3.88.191.218: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). [2026-04-20 13:49:28,512][ ERROR][PID:2382441] Re-try request for task on 'ResallocHost, ticket_id=2423016, hostname=3.88.191.218, name=aws_x86_64_normal_prod_07133190_20260420_134330, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-04-20 13:49:28,532][ INFO][PID:2382441] VM Release request [2026-04-20 13:49:28,569][ INFO][PID:2382441] Retry #1 (on other host) [2026-04-20 13:49:28,572][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:28,576][ INFO][PID:2382441] VM allocation process starts [2026-04-20 13:49:28,655][ INFO][PID:2382441] Trying to allocate VM: ResallocHost, ticket_id=2423045, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-20 13:49:33,672][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:38,683][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:43,688][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:48,696][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:53,700][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:49:58,719][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:03,728][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:08,732][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:13,735][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:18,738][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:23,742][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:28,752][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:33,757][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:37,182][ INFO][PID:2382441] Allocated host ResallocHost, ticket_id=2423045, hostname=100.28.219.119, name=aws_x86_64_spot_prod_07133404_20260420_134804, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-20 13:50:37,216][ INFO][PID:2382441] Allocating ssh connection to builder [2026-04-20 13:50:37,220][ INFO][PID:2382441] Checking that builder machine is OK [2026-04-20 13:50:37,429][ ERROR][PID:2382441] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '100.28.219.119' (ED25519) to the list of known hosts. Load key "/home/copr/.ssh/id_rsa": Permission denied Permission denied, please try again. Permission denied, please try again. mockbuilder@100.28.219.119: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). [2026-04-20 13:50:47,512][ ERROR][PID:2382441] Re-try request for task on 'ResallocHost, ticket_id=2423045, hostname=100.28.219.119, name=aws_x86_64_spot_prod_07133404_20260420_134804, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-04-20 13:50:47,604][ INFO][PID:2382441] VM Release request [2026-04-20 13:50:47,659][ INFO][PID:2382441] Retry #2 (on other host) [2026-04-20 13:50:47,661][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:47,662][ INFO][PID:2382441] VM allocation process starts [2026-04-20 13:50:47,708][ INFO][PID:2382441] Trying to allocate VM: ResallocHost, ticket_id=2423078, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-20 13:50:52,713][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:50:57,725][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:51:02,730][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:51:07,740][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:51:12,743][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:51:17,746][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:51:22,751][ INFO][PID:2382441] Checking for cancel request [2026-04-20 13:51:26,066][ INFO][PID:2382441] Allocated host ResallocHost, ticket_id=2423078, hostname=34.232.80.213, name=aws_x86_64_reserved_prod_07133422_20260420_134825, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-20 13:51:26,067][ INFO][PID:2382441] Allocating ssh connection to builder [2026-04-20 13:51:26,069][ INFO][PID:2382441] Checking that builder machine is OK [2026-04-20 13:51:26,246][ ERROR][PID:2382441] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '34.232.80.213' (ED25519) to the list of known hosts. Load key "/home/copr/.ssh/id_rsa": Permission denied Permission denied, please try again. Permission denied, please try again. mockbuilder@34.232.80.213: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). [2026-04-20 13:51:36,374][ ERROR][PID:2382441] Re-try request for task on 'ResallocHost, ticket_id=2423078, hostname=34.232.80.213, name=aws_x86_64_reserved_prod_07133422_20260420_134825, requested_tags=['arch_x86_64', 'copr_builder']': Unable to finish after 1 SSH attempts [2026-04-20 13:51:36,416][ INFO][PID:2382441] VM Release request [2026-04-20 13:51:36,490][ ERROR][PID:2382441] Backend process error: Three host tried without success: {'100.28.219.119', '3.88.191.218', '34.232.80.213'} [2026-04-20 13:51:36,564][WARNING][PID:2382441] Switching not-finished job state to 'failed' [2026-04-20 13:51:36,573][ INFO][PID:2382441] Worker failed build, took 166.70199489593506 [2026-04-20 13:51:36,574][ INFO][PID:2382441] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@rhel-lightspeed", "project_name": "goose-proxy", "project_dirname": "goose-proxy", "submitter": "packit", "ended_on": 1776693096.5645583, "started_on": 1776692929.8625634, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "10348654", "build_id": 10348654, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"\\n#!/bin/sh\\n\\ngit config --global user.email \\\"hello@packit.dev\\\"\\ngit config --global user.name \\\"Packit\\\"\\nresultdir=$PWD\\npackit -d prepare-sources --result-dir \\\"$resultdir\\\" --pr-id 38 --merge-pr --target-branch main --job-config-index 0 --merged-ref 'main' --no-create-symlinks https://github.com/rhel-lightspeed/goose-proxy\\n\\n\", \"chroot\": \"fedora-43-x86_64\", \"builddeps\": \"packit python3-pip uv\", \"resultdir\": null, \"repos\": \"copr://packit/packit-stable\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@rhel-lightspeed/goose-proxy--packit", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/packit-stable/fedora-43-x86_64/", "id": "copr_packit_packit_stable", "name": "Additional repo copr_packit_packit_stable" } ], "background": false, "distributions_in_build": [ "rhel-10", "rhel-9" ], "distributions_in_project": [ "fedora-43", "fedora-44", "fedora-rawhide", "rhel-10", "rhel-8", "rhel-9" ], "destdir": "/var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rhel-lightspeed/goose-proxy", "result_dir": "10348654", "built_packages": "", "tags": [ "arch_x86_64" ], "id": 10348654, "mockchain_macros": { "copr_username": "@rhel-lightspeed", "copr_projectname": "goose-proxy", "vendor": "Fedora Project COPR (@rhel-lightspeed/goose-proxy)" } } ] } [2026-04-20 13:51:36,672][ INFO][PID:2382441] Sending fedora-messaging bus message in build.end [2026-04-20 13:51:38,173][ INFO][PID:2382441] Compressing /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/builder-live.log by gzip [2026-04-20 13:51:38,177][ INFO][PID:2382441] Running command 'gzip /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/builder-live.log' as PID 2421948 [2026-04-20 13:51:38,197][ INFO][PID:2382441] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/builder-live.log: No such file or directory [2026-04-20 13:51:38,206][ ERROR][PID:2382441] Unable to compress file /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/builder-live.log [2026-04-20 13:51:38,248][ INFO][PID:2382441] Compressing /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/backend.log by gzip [2026-04-20 13:51:38,253][ INFO][PID:2382441] Running command 'gzip /var/lib/copr/public_html/results/@rhel-lightspeed/goose-proxy/srpm-builds/10348654/backend.log' as PID 2421961