[2025-09-04 08:12:35,696][  INFO][PID:1027838] Marking build as starting
[2025-09-04 08:12:35,832][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:12:35,838][  INFO][PID:1027838] VM allocation process starts
[2025-09-04 08:12:35,874][  INFO][PID:1027838] Trying to allocate VM: ResallocHost, ticket_id=4905642, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-04 08:12:40,879][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:12:41,947][  INFO][PID:1027838] Allocated host ResallocHost, ticket_id=4905642, hostname=140.211.168.2, name=copr_osuosl_p09_prod_06568553_20250904_074912, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-04 08:12:41,948][  INFO][PID:1027838] Allocating ssh connection to builder
[2025-09-04 08:12:41,949][  INFO][PID:1027838] Checking that builder machine is OK
[2025-09-04 08:12:43,467][  INFO][PID:1027838] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-09-04 08:12:44,546][  INFO][PID:1027838] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-09-04 08:12:44,547][  INFO][PID:1027838] Filling build.info file with builder info
[2025-09-04 08:12:44,548][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:12:44,550][  INFO][PID:1027838] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "wanzenbug",
            "project_name": "buildkit",
            "project_dirname": "buildkit",
            "submitter": "https://api.github.com/users/WanzenBug",
            "ended_on": null,
            "started_on": 1756973564.5506384,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9522103-fedora-41-ppc64le",
            "build_id": 9522103,
            "package_name": "buildkit",
            "package_version": "0.24.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/wanzenbug/buildkit/buildkit",
            "git_hash": "fd7c80da0bbba56b2e9a9481300c5539ae910aa4",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "wanzenbug/buildkit--https://api.github.com/users/WanzenBug",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/wanzenbug/buildkit/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/wanzenbug/buildkit",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/wanzenbug/buildkit",
            "result_dir": "09522103-buildkit",
            "built_packages": "",
            "id": 9522103,
            "mockchain_macros": {
                "copr_username": "wanzenbug",
                "copr_projectname": "buildkit",
                "vendor": "Fedora Project COPR (wanzenbug/buildkit)"
            }
        }
    ]
}
[2025-09-04 08:12:44,598][  INFO][PID:1027838] Sending fedora-messaging bus message in build.start
[2025-09-04 08:12:45,985][  INFO][PID:1027838] Sending fedora-messaging bus message in chroot.start
[2025-09-04 08:12:46,022][  INFO][PID:1027838] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9522103-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-09-04 08:12:47,348][  INFO][PID:1027838] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.2' (ED25519) to the list of known hosts.


[2025-09-04 08:12:47,349][  INFO][PID:1027838] Downloading the builder-live.log file, attempt 1
[2025-09-04 08:12:47,351][  INFO][PID:1027838] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-09-04 08:12:52,357][  INFO][PID:1027838] Periodic builder liveness probe: alive
[2025-09-04 08:12:52,359][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:12:57,360][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:02,362][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:07,363][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:12,367][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:17,369][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:22,370][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:27,372][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:32,375][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:37,380][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:42,384][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:47,388][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:52,391][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:13:57,393][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:02,395][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:07,397][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:12,399][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:17,402][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:22,408][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:27,415][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:32,417][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:37,418][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:42,421][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:47,423][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:52,426][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:14:57,428][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:02,432][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:07,433][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:12,434][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:17,435][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:22,437][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:27,439][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:32,441][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:37,446][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:42,450][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:47,451][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:52,458][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:15:57,459][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:02,460][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:07,462][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:12,464][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:17,465][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:22,465][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:27,466][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:32,469][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:37,471][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:42,477][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:47,479][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:52,480][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:16:57,482][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:02,485][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:07,486][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:12,489][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:17,491][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:22,494][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:27,495][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:32,496][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:37,497][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:42,499][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:47,500][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:52,501][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:17:57,502][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:02,503][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:07,504][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:12,505][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:17,506][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:22,507][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:27,508][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:32,509][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:37,512][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:42,513][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:47,514][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:52,515][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:18:57,516][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:02,517][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:07,519][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:12,519][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:17,521][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:22,522][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:27,523][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:32,524][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:37,525][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:42,526][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:47,528][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:52,529][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:19:57,530][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:02,531][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:07,532][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:12,534][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:17,536][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:22,537][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:27,539][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:32,540][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:37,541][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:42,542][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:47,543][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:52,545][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:20:57,546][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:02,547][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:07,548][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:12,549][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:17,550][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:22,551][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:27,553][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:32,554][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:37,555][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:42,556][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:47,558][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:52,559][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:21:57,561][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:02,562][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:07,563][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:12,564][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:17,565][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:22,566][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:27,567][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:32,568][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:37,569][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:42,570][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:47,571][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:52,583][  INFO][PID:1027838] Periodic builder liveness probe: alive
[2025-09-04 08:22:52,584][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:22:57,585][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:02,586][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:07,587][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:12,588][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:17,589][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:22,590][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:27,591][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:32,592][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:37,593][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:42,594][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:47,595][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:52,596][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:23:57,597][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:02,598][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:07,600][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:12,601][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:17,602][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:22,603][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:27,604][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:32,605][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:37,606][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:42,609][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:47,611][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:52,614][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:24:57,620][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:02,628][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:07,629][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:12,631][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:17,632][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:22,633][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:27,634][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:32,636][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:37,637][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:42,638][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:47,641][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:52,642][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:25:57,646][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:02,647][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:07,649][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:12,651][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:17,654][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:22,655][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:27,657][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:32,659][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:37,661][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:42,662][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:47,663][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:52,664][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:26:57,665][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:02,665][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:07,666][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:12,668][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:17,668][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:22,670][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:27,671][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:32,672][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:37,673][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:42,674][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:47,675][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:52,677][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:27:57,678][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:02,679][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:07,680][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:12,681][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:17,682][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:22,683][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:27,684][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:32,685][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:37,687][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:42,688][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:47,689][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:52,690][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:28:57,691][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:02,692][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:07,693][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:12,694][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:17,695][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:22,697][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:27,698][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:32,700][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:37,701][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:42,702][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:47,703][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:52,704][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:29:57,705][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:02,707][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:07,715][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:12,716][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:17,718][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:22,720][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:27,722][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:32,723][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:37,725][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:42,726][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:47,727][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:52,728][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:30:57,729][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:02,730][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:07,731][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:12,732][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:17,734][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:22,735][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:27,736][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:32,737][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:37,739][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:42,741][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:47,754][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:52,756][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:31:57,756][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:02,758][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:07,759][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:12,760][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:17,761][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:22,762][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:27,764][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:32,772][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:37,773][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:42,774][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:47,776][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:52,799][  INFO][PID:1027838] Periodic builder liveness probe: alive
[2025-09-04 08:32:52,801][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:32:57,805][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:02,806][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:07,808][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:12,810][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:17,811][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:22,812][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:27,813][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:32,815][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:37,816][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:42,817][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:47,818][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:52,819][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:33:57,820][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:02,824][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:07,829][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:12,831][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:17,832][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:22,834][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:27,836][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:32,837][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:37,838][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:42,840][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:47,841][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:52,842][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:34:57,843][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:02,844][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:07,845][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:12,846][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:17,847][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:22,848][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:27,849][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:32,851][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:37,855][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:42,856][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:47,857][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:52,858][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:35:57,858][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:02,860][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:07,861][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:12,862][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:17,864][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:22,865][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:27,866][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:32,867][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:37,868][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:42,869][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:47,870][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:52,871][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:36:57,872][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:02,873][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:07,874][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:12,875][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:17,876][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:22,877][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:27,879][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:32,880][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:37,881][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:42,882][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:47,883][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:52,884][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:37:57,885][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:02,886][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:07,887][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:12,888][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:17,889][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:22,891][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:27,891][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:32,893][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:37,894][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:42,895][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:47,897][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:52,898][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:38:57,899][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:02,900][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:07,901][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:12,902][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:17,903][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:22,904][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:27,905][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:32,906][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:37,909][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:42,911][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:47,913][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:52,914][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:39:57,915][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:02,916][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:07,917][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:12,918][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:17,919][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:22,920][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:27,921][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:32,923][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:37,924][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:42,925][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:47,926][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:52,927][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:40:57,928][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:02,929][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:07,930][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:12,931][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:17,932][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:22,933][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:27,934][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:32,935][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:37,936][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:42,936][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:47,939][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:52,943][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:41:57,945][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:02,946][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:07,947][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:12,947][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:17,948][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:22,949][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:27,950][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:32,951][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:37,952][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:42,953][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:47,954][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:52,963][  INFO][PID:1027838] Periodic builder liveness probe: alive
[2025-09-04 08:42:52,964][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:42:57,965][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:02,966][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:07,967][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:12,968][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:17,969][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:22,970][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:27,971][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:32,971][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:37,972][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:42,973][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:47,974][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:52,975][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:43:57,976][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:02,977][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:07,978][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:12,978][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:17,986][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:22,987][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:27,988][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:32,989][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:37,991][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:42,992][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:47,993][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:52,994][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:44:57,995][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:02,996][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:07,997][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:12,998][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:17,999][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:23,000][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:28,001][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:33,002][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:38,004][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:43,011][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:48,016][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:53,018][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:45:58,019][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:03,020][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:08,021][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:13,022][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:18,024][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:23,025][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:28,027][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:33,031][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:38,032][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:43,034][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:48,036][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:53,037][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:46:58,038][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:03,039][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:08,040][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:13,042][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:18,044][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:23,048][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:28,050][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:33,051][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:38,061][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:43,064][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:48,067][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:53,070][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:47:58,074][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:03,076][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:08,079][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:13,082][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:18,083][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:23,085][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:28,088][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:33,090][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:38,091][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:43,092][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:48,093][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:53,094][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:48:58,095][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:03,097][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:08,098][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:13,099][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:18,100][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:23,101][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:28,102][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:33,104][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:38,105][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:43,106][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:48,107][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:53,108][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:49:58,109][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:03,110][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:08,114][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:13,116][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:18,117][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:23,119][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:28,120][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:33,121][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:38,123][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:43,126][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:48,128][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:53,131][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:50:58,133][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:03,134][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:08,135][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:13,136][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:18,137][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:23,139][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:28,142][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:33,143][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:38,144][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:43,146][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:48,146][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:53,148][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:51:58,156][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:03,157][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:08,158][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:13,159][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:18,165][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:19,142][ ERROR][PID:1027838] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-04 08:52:23,166][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:28,170][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:29,143][WARNING][PID:1027838] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-04 08:52:33,171][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:38,172][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:39,144][  INFO][PID:1027838] Downloading the builder-live.log file, attempt 2
[2025-09-04 08:52:39,145][  INFO][PID:1027838] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-09-04 08:52:43,173][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:48,174][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:52:53,181][  INFO][PID:1027838] Periodic builder liveness probe: dead
[2025-09-04 08:52:53,182][  INFO][PID:1027838] calling cancel callback, and waiting
[2025-09-04 08:53:39,213][ ERROR][PID:1027838] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-04 08:53:49,219][WARNING][PID:1027838] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-04 08:53:53,252][ ERROR][PID:1027838] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-09-04 08:53:59,220][  INFO][PID:1027838] Downloading the builder-live.log file, attempt 3
[2025-09-04 08:53:59,222][  INFO][PID:1027838] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-09-04 08:54:59,292][ ERROR][PID:1027838] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-04 08:55:03,326][ ERROR][PID:1027838] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-09-04 08:55:09,319][WARNING][PID:1027838] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-04 08:55:19,322][  INFO][PID:1027838] Downloading the builder-live.log file, attempt 4
[2025-09-04 08:55:19,323][  INFO][PID:1027838] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-09-04 08:56:13,400][ ERROR][PID:1027838] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-09-04 08:56:19,393][ ERROR][PID:1027838] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-04 08:56:29,395][ ERROR][PID:1027838] Giving up for unstable SSH, failures: 1756975949.1432478, 1756976029.2195172, 1756976109.3190224, 1756976189.3957317
[2025-09-04 08:57:23,482][ ERROR][PID:1027838] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-09-04 08:57:33,483][ ERROR][PID:1027838] Can't ssh to cancel build.
[2025-09-04 08:57:33,483][ ERROR][PID:1027838] Re-try request for task on 'ResallocHost, ticket_id=4905642, hostname=140.211.168.2, name=copr_osuosl_p09_prod_06568553_20250904_074912, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-04 08:57:33,489][  INFO][PID:1027838] Releasing VM back to pool
[2025-09-04 08:57:33,530][  INFO][PID:1027838] Retry #1 (on other host)
[2025-09-04 08:57:33,532][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:57:33,537][  INFO][PID:1027838] VM allocation process starts
[2025-09-04 08:57:33,577][  INFO][PID:1027838] Trying to allocate VM: ResallocHost, ticket_id=4906668, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-04 08:57:38,582][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:57:39,636][  INFO][PID:1027838] Allocated host ResallocHost, ticket_id=4906668, hostname=2620:52:3:1:dead:beef:cafe:c24a, name=copr_hv_ppc64le_02_prod_06569392_20250904_084623, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-04 08:57:39,638][  INFO][PID:1027838] Allocating ssh connection to builder
[2025-09-04 08:57:39,639][  INFO][PID:1027838] Checking that builder machine is OK
[2025-09-04 08:57:40,633][  INFO][PID:1027838] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-09-04 08:57:41,080][  INFO][PID:1027838] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-09-04 08:57:41,081][  INFO][PID:1027838] Filling build.info file with builder info
[2025-09-04 08:57:41,089][  INFO][PID:1027838] Checking for cancel request
[2025-09-04 08:57:41,090][  INFO][PID:1027838] Not re-notifying FE and msg buses for the new host.
[2025-09-04 08:57:41,091][  INFO][PID:1027838] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9522103-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-09-04 08:57:41,828][  INFO][PID:1027838] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24a' (ED25519) to the list of known hosts.


[2025-09-04 08:57:41,829][  INFO][PID:1027838] Downloading the builder-live.log file, attempt 1
[2025-09-04 08:57:41,831][  INFO][PID:1027838] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24a copr-rpmbuild-log
[2025-09-04 08:57:46,830][  INFO][PID:1027838] calling cancel callback, and waiting
[2025-09-04 08:57:50,392][  INFO][PID:1027838] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24a' (ED25519) to the list of known hosts.

[2025-09-04 08:57:50,393][  INFO][PID:1027838] Downloading results from builder
[2025-09-04 08:57:50,393][  INFO][PID:1027838] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit started
[2025-09-04 08:57:50,394][  INFO][PID:1027838] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/ &> /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/build-09522103.rsync.log
[2025-09-04 08:57:50,821][  INFO][PID:1027838] rsyncing finished.
[2025-09-04 08:57:50,821][  INFO][PID:1027838] Releasing VM back to pool
[2025-09-04 08:57:50,830][  INFO][PID:1027838] Searching for 'success' file in resultdir
[2025-09-04 08:57:50,831][ ERROR][PID:1027838] Build failed: Backend process error: No success file => build failure
[2025-09-04 08:57:50,832][  INFO][PID:1027838] Finished build: id=9522103 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/wanzenbug/buildkit chroot=fedora-41-ppc64le 
[2025-09-04 08:57:50,834][ ERROR][PID:1027838] Backend process error: No success file => build failure
[2025-09-04 08:57:50,835][  INFO][PID:1027838] Worker failed build, took 9.744149208068848
[2025-09-04 08:57:50,835][  INFO][PID:1027838] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "wanzenbug",
            "project_name": "buildkit",
            "project_dirname": "buildkit",
            "submitter": "https://api.github.com/users/WanzenBug",
            "ended_on": 1756976270.8350692,
            "started_on": 1756976261.09092,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9522103-fedora-41-ppc64le",
            "build_id": 9522103,
            "package_name": "buildkit",
            "package_version": "0.24.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/wanzenbug/buildkit/buildkit",
            "git_hash": "fd7c80da0bbba56b2e9a9481300c5539ae910aa4",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "wanzenbug/buildkit--https://api.github.com/users/WanzenBug",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/wanzenbug/buildkit/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/wanzenbug/buildkit",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/wanzenbug/buildkit",
            "result_dir": "09522103-buildkit",
            "built_packages": "",
            "id": 9522103,
            "mockchain_macros": {
                "copr_username": "wanzenbug",
                "copr_projectname": "buildkit",
                "vendor": "Fedora Project COPR (wanzenbug/buildkit)"
            }
        }
    ]
}
[2025-09-04 08:57:50,874][  INFO][PID:1027838] Sending fedora-messaging bus message in build.end
[2025-09-04 08:57:50,912][  INFO][PID:1027838] Compressing /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/builder-live.log by gzip
[2025-09-04 08:57:50,913][  INFO][PID:1027838] Running command 'gzip /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/builder-live.log' as PID 1407137
[2025-09-04 08:57:50,915][  INFO][PID:1027838] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/builder-live.log)
[2025-09-04 08:57:50,916][  INFO][PID:1027838] Compressing /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/backend.log by gzip
[2025-09-04 08:57:50,917][  INFO][PID:1027838] Running command 'gzip /var/lib/copr/public_html/results/wanzenbug/buildkit/fedora-41-ppc64le/09522103-buildkit/backend.log' as PID 1407138