[2026-02-05 22:58:33,413][  INFO][PID:2945202] Marking build as starting
[2026-02-05 22:58:33,560][  INFO][PID:2945202] Checking that /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-02-05 22:58:33,615][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 22:58:33,621][  INFO][PID:2945202] VM allocation process starts
[2026-02-05 22:58:33,701][  INFO][PID:2945202] Trying to allocate VM: ResallocHost, ticket_id=1191238, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-05 22:58:38,715][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 22:58:39,821][  INFO][PID:2945202] Allocated host ResallocHost, ticket_id=1191238, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_01967609_20260205_221036, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-05 22:58:39,822][  INFO][PID:2945202] Allocating ssh connection to builder
[2026-02-05 22:58:39,823][  INFO][PID:2945202] Checking that builder machine is OK
[2026-02-05 22:59:39,877][ ERROR][PID:2945202] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18e port 22: Connection timed out

[2026-02-05 22:59:49,878][ ERROR][PID:2945202] Re-try request for task on 'ResallocHost, ticket_id=1191238, hostname=2620:52:6:1161:dead:beef:cafe:c18e, name=vmhost_p09_04_prod_01967609_20260205_221036, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-02-05 22:59:49,878][  INFO][PID:2945202] Releasing VM back to pool
[2026-02-05 22:59:49,888][  INFO][PID:2945202] Retry #1 (on other host)
[2026-02-05 22:59:49,889][  INFO][PID:2945202] Checking that /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-02-05 22:59:49,889][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 22:59:49,890][  INFO][PID:2945202] VM allocation process starts
[2026-02-05 22:59:49,902][  INFO][PID:2945202] Trying to allocate VM: ResallocHost, ticket_id=1191281, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-05 22:59:52,915][  INFO][PID:2945202] Allocated host ResallocHost, ticket_id=1191281, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_01967943_20260205_225456, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-02-05 22:59:52,915][  INFO][PID:2945202] Allocating ssh connection to builder
[2026-02-05 22:59:52,916][  INFO][PID:2945202] Checking that builder machine is OK
[2026-02-05 22:59:54,024][  INFO][PID:2945202] Running remote command: copr-builder-ready fedora-42-ppc64le
[2026-02-05 22:59:54,571][  INFO][PID:2945202] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2026-02-05 22:59:54,572][  INFO][PID:2945202] Filling build.info file with builder info
[2026-02-05 22:59:54,572][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 22:59:54,573][  INFO][PID:2945202] Not re-notifying FE and msg buses for the new host.
[2026-02-05 22:59:54,573][  INFO][PID:2945202] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10097769-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2026-02-05 22:59:55,599][  INFO][PID:2945202] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c113' (ED25519) to the list of known hosts.


[2026-02-05 22:59:55,600][  INFO][PID:2945202] Downloading the builder-live.log file, attempt 1
[2026-02-05 22:59:55,602][  INFO][PID:2945202] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c113 copr-rpmbuild-log
[2026-02-05 23:00:00,605][  INFO][PID:2945202] Periodic builder liveness probe: alive
[2026-02-05 23:00:00,606][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:05,607][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:10,608][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:15,609][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:20,610][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:25,611][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:30,612][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:35,612][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:40,613][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:45,614][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:50,615][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:00:55,616][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:00,617][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:05,618][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:10,619][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:15,620][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:20,622][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:25,626][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:30,628][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:35,629][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:40,630][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:45,631][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:50,632][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:01:55,633][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:00,636][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:05,637][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:10,640][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:15,641][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:20,643][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:25,648][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:30,651][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:33,371][ ERROR][PID:2945202] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-05 23:02:35,653][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:40,654][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:43,375][WARNING][PID:2945202] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-02-05 23:02:45,655][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:50,656][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:02:53,375][  INFO][PID:2945202] Downloading the builder-live.log file, attempt 2
[2026-02-05 23:02:53,377][  INFO][PID:2945202] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c113 copr-rpmbuild-log
[2026-02-05 23:02:55,657][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:00,658][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:05,659][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:10,660][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:15,661][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:20,662][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:25,663][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:30,664][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:35,665][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:40,666][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:45,667][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:50,668][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:03:53,443][ ERROR][PID:2945202] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-05 23:03:55,669][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:00,670][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:03,463][WARNING][PID:2945202] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-02-05 23:04:05,671][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:10,672][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:13,464][  INFO][PID:2945202] Downloading the builder-live.log file, attempt 3
[2026-02-05 23:04:13,465][  INFO][PID:2945202] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c113 copr-rpmbuild-log
[2026-02-05 23:04:15,673][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:20,674][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:25,675][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:30,676][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:35,677][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:40,678][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:45,679][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:50,680][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:04:55,681][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:00,682][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:05,683][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:10,684][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:13,533][ ERROR][PID:2945202] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-02-05 23:05:15,685][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:20,688][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:23,564][WARNING][PID:2945202] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-02-05 23:05:25,689][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:30,690][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:33,687][  INFO][PID:2945202] Downloading the builder-live.log file, attempt 4
[2026-02-05 23:05:33,689][  INFO][PID:2945202] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c113 copr-rpmbuild-log
[2026-02-05 23:05:35,691][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:40,692][  INFO][PID:2945202] Checking for cancel request
[2026-02-05 23:05:43,652][  INFO][PID:2945202] Downloading results from builder
[2026-02-05 23:05:43,653][  INFO][PID:2945202] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c113]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect started
[2026-02-05 23:05:43,654][  INFO][PID:2945202] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c113]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/ &> /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/build-10097769.rsync.log
[2026-02-05 23:05:44,458][  INFO][PID:2945202] rsyncing finished.
[2026-02-05 23:05:44,458][  INFO][PID:2945202] Releasing VM back to pool
[2026-02-05 23:05:44,467][  INFO][PID:2945202] Searching for 'success' file in resultdir
[2026-02-05 23:05:44,468][ ERROR][PID:2945202] Build failed: Backend process error: No success file => build failure
[2026-02-05 23:05:44,468][  INFO][PID:2945202] Finished build: id=10097769 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/dwmw2/openconnect chroot=fedora-42-ppc64le 
[2026-02-05 23:05:44,470][ ERROR][PID:2945202] Backend process error: No success file => build failure
[2026-02-05 23:05:44,470][  INFO][PID:2945202] Worker failed build, took 349.89752888679504
[2026-02-05 23:05:44,471][  INFO][PID:2945202] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "dwmw2",
            "project_name": "openconnect",
            "project_dirname": "openconnect",
            "submitter": null,
            "ended_on": 1770332744.4707277,
            "started_on": 1770332394.5731988,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10097769-fedora-42-ppc64le",
            "build_id": 10097769,
            "package_name": "NetworkManager-openconnect",
            "package_version": "1.2.10.git.89.dd4c10e-0",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/dwmw2/openconnect/NetworkManager-openconnect",
            "git_hash": "65b67c5c85f4f1298e39817f4af33225e2dcec26",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "dwmw2/openconnect--543e055f-0986-42ba-97b7-feab43f04d46",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/dwmw2/openconnect",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/dwmw2/openconnect",
            "result_dir": "10097769-NetworkManager-openconnect",
            "built_packages": "",
            "id": 10097769,
            "mockchain_macros": {
                "copr_username": "dwmw2",
                "copr_projectname": "openconnect",
                "vendor": "Fedora Project COPR (dwmw2/openconnect)"
            }
        }
    ]
}
[2026-02-05 23:05:44,549][  INFO][PID:2945202] Sending fedora-messaging bus message in build.end
[2026-02-05 23:05:45,075][  INFO][PID:2945202] Compressing /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/builder-live.log by gzip
[2026-02-05 23:05:45,077][  INFO][PID:2945202] Running command 'gzip /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/builder-live.log' as PID 2986921
[2026-02-05 23:05:45,087][  INFO][PID:2945202] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/builder-live.log)
[2026-02-05 23:05:45,088][  INFO][PID:2945202] Compressing /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/backend.log by gzip
[2026-02-05 23:05:45,089][  INFO][PID:2945202] Running command 'gzip /var/lib/copr/public_html/results/dwmw2/openconnect/fedora-42-ppc64le/10097769-NetworkManager-openconnect/backend.log' as PID 2986922