[2026-04-20 14:00:21,761][  INFO][PID:2542262] Marking build as starting
[2026-04-20 14:00:21,882][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:21,900][  INFO][PID:2542262] VM allocation process starts
[2026-04-20 14:00:22,001][  INFO][PID:2542262] Trying to allocate VM: ResallocHost, ticket_id=2423415, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-20 14:00:27,024][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:32,044][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:37,076][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:42,120][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:47,151][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:52,154][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:00:57,162][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:02,175][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:07,185][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:12,219][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:17,241][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:22,249][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:27,254][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:32,272][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:37,304][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:42,306][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:47,347][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:52,357][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:01:57,369][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:02,391][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:07,393][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:12,396][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:17,405][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:22,417][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:27,436][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:32,468][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:37,484][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:42,498][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:47,528][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:52,554][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:02:57,557][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:02,579][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:07,609][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:12,624][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:17,640][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:22,662][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:27,681][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:32,691][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:37,719][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:42,724][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:47,730][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:52,736][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:03:57,738][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:02,744][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:07,748][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:12,758][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:17,767][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:22,776][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:27,785][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:32,788][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:37,795][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:40,928][  INFO][PID:2542262] Allocated host ResallocHost, ticket_id=2423415, hostname=52.91.239.56, name=aws_aarch64_reserved_prod_07133988_20260420_135957, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-20 14:04:40,930][  INFO][PID:2542262] Allocating ssh connection to builder
[2026-04-20 14:04:40,940][  INFO][PID:2542262] Checking that builder machine is OK
[2026-04-20 14:04:41,415][ ERROR][PID:2542262] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '52.91.239.56' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@52.91.239.56: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 14:04:51,683][ ERROR][PID:2542262] Re-try request for task on 'ResallocHost, ticket_id=2423415, hostname=52.91.239.56, name=aws_aarch64_reserved_prod_07133988_20260420_135957, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 14:04:51,778][  INFO][PID:2542262] VM Release request
[2026-04-20 14:04:51,859][  INFO][PID:2542262] Retry #1 (on other host)
[2026-04-20 14:04:51,861][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:04:51,868][  INFO][PID:2542262] VM allocation process starts
[2026-04-20 14:04:51,940][  INFO][PID:2542262] Trying to allocate VM: ResallocHost, ticket_id=2423540, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-20 14:04:56,962][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:01,970][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:06,973][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:11,992][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:17,002][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:22,029][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:27,043][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:32,060][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:37,070][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:42,075][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:47,079][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:52,090][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:05:57,095][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:02,098][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:07,102][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:12,107][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:17,116][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:20,627][  INFO][PID:2542262] Allocated host ResallocHost, ticket_id=2423540, hostname=2620:52:6:1161:dead:beef:cafe:c11d, name=vmhost_p09_01_prod_07134075_20260420_140147, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-20 14:06:20,635][  INFO][PID:2542262] Allocating ssh connection to builder
[2026-04-20 14:06:20,643][  INFO][PID:2542262] Checking that builder machine is OK
[2026-04-20 14:06:21,194][ ERROR][PID:2542262] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c11d' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@2620:52:6:1161:dead:beef:cafe:c11d: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 14:06:31,389][ ERROR][PID:2542262] Re-try request for task on 'ResallocHost, ticket_id=2423540, hostname=2620:52:6:1161:dead:beef:cafe:c11d, name=vmhost_p09_01_prod_07134075_20260420_140147, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 14:06:31,606][  INFO][PID:2542262] VM Release request
[2026-04-20 14:06:31,715][  INFO][PID:2542262] Retry #2 (on other host)
[2026-04-20 14:06:31,718][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:31,726][  INFO][PID:2542262] VM allocation process starts
[2026-04-20 14:06:31,766][  INFO][PID:2542262] Trying to allocate VM: ResallocHost, ticket_id=2423601, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-20 14:06:36,771][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:41,774][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:46,782][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:51,788][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:06:56,804][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:01,811][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:06,820][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:11,827][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:16,838][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:21,858][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:26,865][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:31,870][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:36,877][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:41,881][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:46,889][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:51,916][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:07:56,922][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:01,941][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:07,023][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:12,026][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:17,047][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:22,053][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:27,075][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:32,083][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:37,089][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:42,100][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:47,103][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:52,119][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:08:57,122][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:02,197][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:07,217][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:12,250][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:17,278][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:22,351][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:27,385][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:32,389][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:37,441][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:42,471][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:47,474][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:52,486][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:09:57,493][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:02,501][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:07,551][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:12,570][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:17,593][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:22,627][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:27,638][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:32,701][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:37,711][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:42,720][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:47,741][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:52,763][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:10:57,812][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:02,827][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:07,985][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:12,991][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:17,997][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:23,004][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:28,015][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:33,029][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:38,037][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:43,050][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:48,083][  INFO][PID:2542262] Checking for cancel request
[2026-04-20 14:11:50,796][  INFO][PID:2542262] Allocated host ResallocHost, ticket_id=2423601, hostname=3.81.234.47, name=aws_aarch64_normal_prod_07134449_20260420_140725, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-20 14:11:50,797][  INFO][PID:2542262] Allocating ssh connection to builder
[2026-04-20 14:11:50,798][  INFO][PID:2542262] Checking that builder machine is OK
[2026-04-20 14:11:51,072][ ERROR][PID:2542262] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '3.81.234.47' (ED25519) to the list of known hosts.
Load key "/home/copr/.ssh/id_rsa": Permission denied
Permission denied, please try again.
Permission denied, please try again.
mockbuilder@3.81.234.47: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).

[2026-04-20 14:12:01,143][ ERROR][PID:2542262] Re-try request for task on 'ResallocHost, ticket_id=2423601, hostname=3.81.234.47, name=aws_aarch64_normal_prod_07134449_20260420_140725, requested_tags=['arch_noarch', 'copr_builder']': Unable to finish after 1 SSH attempts
[2026-04-20 14:12:01,427][  INFO][PID:2542262] VM Release request
[2026-04-20 14:12:01,520][ ERROR][PID:2542262] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c11d', '52.91.239.56', '3.81.234.47'}
[2026-04-20 14:12:01,710][WARNING][PID:2542262] Switching not-finished job state to 'failed'
[2026-04-20 14:12:01,719][  INFO][PID:2542262] Worker failed build, took 700.1427502632141
[2026-04-20 14:12:01,724][  INFO][PID:2542262] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "ligenix",
            "project_name": "enterprise-xibo",
            "project_dirname": "enterprise-xibo",
            "submitter": "ligenix",
            "ended_on": 1776694321.7105336,
            "started_on": 1776693621.5677834,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "10348689",
            "build_id": 10348689,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 2,
            "source_json": "{\"url\": \"https://copr.fedorainfracloud.org/tmp/tmpsd7m06nn/arexibo-0.4.0-1.elf.src.rpm\", \"pkg\": \"arexibo-0.4.0-1.elf.src.rpm\", \"tmp\": \"tmpsd7m06nn\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "ligenix/enterprise-xibo--ligenix",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "distributions_in_build": [
                "epel-10",
                "epel-7",
                "epel-8",
                "epel-9",
                "fedora-42",
                "fedora-43",
                "fedora-44"
            ],
            "distributions_in_project": [
                "epel-10",
                "epel-7",
                "epel-8",
                "epel-9",
                "fedora-42",
                "fedora-43",
                "fedora-44"
            ],
            "destdir": "/var/lib/copr/public_html/results/ligenix/enterprise-xibo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ligenix/enterprise-xibo",
            "result_dir": "10348689",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 10348689,
            "mockchain_macros": {
                "copr_username": "ligenix",
                "copr_projectname": "enterprise-xibo",
                "vendor": "Fedora Project COPR (ligenix/enterprise-xibo)"
            }
        }
    ]
}
[2026-04-20 14:12:01,868][  INFO][PID:2542262] Sending fedora-messaging bus message in build.end
[2026-04-20 14:12:08,539][  INFO][PID:2542262] Compressing /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/builder-live.log by gzip
[2026-04-20 14:12:08,546][  INFO][PID:2542262] Running command 'gzip /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/builder-live.log' as PID 2727489
[2026-04-20 14:12:08,599][  INFO][PID:2542262] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/builder-live.log)
stdout:

stderr:
gzip: /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/builder-live.log: No such file or directory


[2026-04-20 14:12:08,600][ ERROR][PID:2542262] Unable to compress file /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/builder-live.log
[2026-04-20 14:12:08,677][  INFO][PID:2542262] Compressing /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/backend.log by gzip
[2026-04-20 14:12:08,688][  INFO][PID:2542262] Running command 'gzip /var/lib/copr/public_html/results/ligenix/enterprise-xibo/srpm-builds/10348689/backend.log' as PID 2727508