[2025-07-26 01:23:00,586][  INFO][PID:2697206] Marking build as starting
[2025-07-26 01:23:00,663][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:00,664][  INFO][PID:2697206] VM allocation process starts
[2025-07-26 01:23:00,676][  INFO][PID:2697206] Trying to allocate VM: ResallocHost, ticket_id=4169193, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-26 01:23:05,678][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:10,680][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:15,682][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:20,683][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:25,684][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:30,686][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:35,687][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:40,689][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:45,690][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:50,691][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:23:55,692][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:00,694][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:05,695][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:10,696][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:15,698][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:20,699][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:25,702][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:30,703][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:35,711][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:40,713][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:45,715][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:50,716][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:24:55,717][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:00,718][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:05,719][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:10,720][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:15,722][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:20,728][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:25,729][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:30,732][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:35,733][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:40,734][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:45,735][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:50,737][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:25:55,739][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:00,741][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:05,748][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:10,751][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:15,753][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:20,755][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:25,757][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:30,762][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:35,764][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:40,765][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:45,766][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:50,767][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:26:55,769][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:00,771][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:05,772][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:10,774][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:15,775][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:20,776][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:25,777][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:30,778][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:35,779][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:40,780][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:45,781][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:50,782][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:27:55,783][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:00,784][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:05,785][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:10,787][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:15,788][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:20,789][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:25,789][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:30,791][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:35,792][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:40,793][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:45,794][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:50,795][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:28:55,796][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:00,797][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:05,798][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:10,799][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:15,800][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:20,801][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:25,802][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:30,803][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:35,804][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:40,805][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:45,806][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:50,807][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:29:55,808][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:00,809][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:05,811][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:10,812][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:15,813][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:18,830][  INFO][PID:2697206] Allocated host ResallocHost, ticket_id=4169193, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05888685_20250726_012647, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-26 01:30:18,831][  INFO][PID:2697206] Allocating ssh connection to builder
[2025-07-26 01:30:18,831][  INFO][PID:2697206] Checking that builder machine is OK
[2025-07-26 01:30:20,434][  INFO][PID:2697206] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-26 01:30:21,476][  INFO][PID:2697206] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-26 01:30:21,477][  INFO][PID:2697206] Filling build.info file with builder info
[2025-07-26 01:30:21,478][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:21,478][  INFO][PID:2697206] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1753493421.4785807,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339907-fedora-eln-ppc64le",
            "build_id": 9339907,
            "package_name": "librepo",
            "package_version": "1.20.0-20250726011817.3.g0fc4b98",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/librepo",
            "git_hash": "de5e2692c9c15bf4d64c5da9c0db32f472263048",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339907-librepo",
            "built_packages": "",
            "id": 9339907,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 01:30:21,546][  INFO][PID:2697206] Sending fedora-messaging bus message in build.start
[2025-07-26 01:30:22,177][  INFO][PID:2697206] Sending fedora-messaging bus message in chroot.start
[2025-07-26 01:30:22,201][  INFO][PID:2697206] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339907-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-26 01:30:23,576][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 1
[2025-07-26 01:30:23,578][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-26 01:30:28,582][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 01:30:28,582][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:33,583][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:38,584][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:43,585][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:48,586][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:53,588][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:30:58,589][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:03,590][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:08,591][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:13,595][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:18,597][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:23,598][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:28,600][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:33,604][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:38,607][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:43,608][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:48,609][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:53,610][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:31:58,611][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:03,613][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:08,615][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:13,616][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:18,617][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:23,618][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:28,619][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:33,620][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:38,621][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:43,622][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:48,623][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:53,624][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:32:58,625][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:03,626][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:08,628][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:13,629][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:18,630][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:23,632][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:28,633][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:33,634][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:38,635][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:43,637][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:48,639][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:53,640][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:33:58,641][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:03,642][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:08,644][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:13,646][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:18,647][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:23,648][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:28,649][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:33,650][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:38,651][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:43,652][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:48,653][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:53,655][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:34:58,656][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:03,658][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:08,659][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:13,660][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:18,661][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:23,662][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:28,664][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:33,665][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:38,666][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:43,667][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:48,668][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:53,670][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:35:58,671][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:03,672][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:08,673][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:13,674][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:18,676][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:23,677][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:28,678][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:33,679][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:38,680][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:43,681][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:48,683][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:53,684][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:36:58,685][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:03,686][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:08,687][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:13,688][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:18,689][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:23,690][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:28,691][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:33,692][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:38,693][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:43,776][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:48,777][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:53,778][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:37:58,779][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:03,780][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:08,782][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:13,783][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:18,784][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:23,785][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:28,796][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:33,797][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:38,798][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:43,799][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:48,801][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:53,802][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:38:58,803][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:03,805][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:08,807][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:13,808][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:18,809][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:23,810][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:28,811][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:33,812][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:38,813][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:43,814][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:48,815][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:53,816][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:39:58,817][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:03,818][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:08,819][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:13,820][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:18,821][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:23,823][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:28,876][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 01:40:28,877][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:33,878][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:38,879][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:43,880][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:48,881][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:53,882][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:40:58,883][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:03,884][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:08,885][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:13,886][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:18,887][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:23,888][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:28,889][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:33,890][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:38,891][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:43,893][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:48,895][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:53,896][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:41:58,897][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:03,899][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:08,900][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:13,901][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:18,902][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:23,903][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:28,904][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:33,905][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:38,906][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:43,907][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:48,908][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:53,909][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:42:58,910][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:03,911][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:08,912][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:13,913][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:18,914][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:23,916][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:28,917][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:33,918][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:38,919][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:43,920][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:48,921][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:53,921][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:43:58,922][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:03,924][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:08,925][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:13,926][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:18,927][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:23,928][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:28,929][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:33,930][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:38,931][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:43,932][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:48,933][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:53,934][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:44:58,935][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:03,937][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:08,938][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:13,938][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:18,940][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:23,941][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:28,942][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:33,943][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:38,944][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:43,945][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:48,946][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:53,946][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:45:58,948][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:03,949][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:08,950][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:13,951][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:18,952][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:23,953][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:28,954][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:33,955][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:38,956][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:43,957][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:48,958][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:53,959][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:46:58,960][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:03,961][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:08,962][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:13,963][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:18,964][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:23,965][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:28,966][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:33,967][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:38,968][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:43,969][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:48,970][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:53,971][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:47:58,972][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:03,973][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:08,974][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:13,975][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:18,976][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:23,977][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:28,978][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:33,979][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:38,980][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:43,981][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:48,982][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:53,983][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:48:58,984][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:03,985][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:08,986][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:13,987][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:18,988][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:23,989][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:28,991][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:33,992][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:38,993][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:43,994][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:48,995][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:53,996][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:49:58,998][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:03,999][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:09,000][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:14,001][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:19,002][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:24,003][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:29,009][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 01:50:29,010][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:34,011][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:39,012][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:44,013][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:49,014][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:54,015][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:50:59,016][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:04,017][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:09,018][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:14,020][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:19,023][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:24,024][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:29,025][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:34,026][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:39,027][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:44,029][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:49,030][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:54,031][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:51:59,032][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:04,036][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:09,037][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:14,038][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:19,040][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:24,041][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:29,042][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:34,043][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:39,045][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:44,046][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:49,047][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:54,049][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:52:59,050][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:04,051][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:09,052][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:14,053][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:19,054][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:24,055][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:29,056][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:34,057][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:39,058][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:44,059][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:49,060][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:54,061][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:53:59,062][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:04,063][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:09,064][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:14,065][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:19,067][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:24,068][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:29,068][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:34,070][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:39,071][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:44,072][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:49,073][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:54,074][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:54:59,075][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:04,076][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:09,077][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:14,078][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:19,079][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:24,080][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:29,081][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:34,082][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:39,083][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:44,084][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:49,085][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:54,086][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:55:59,087][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:04,089][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:09,092][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:14,093][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:19,094][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:24,095][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:29,096][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:34,097][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:39,098][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:44,099][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:49,100][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:54,101][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:56:59,103][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:04,104][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:09,105][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:14,106][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:19,107][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:24,108][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:29,110][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:34,111][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:39,112][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:44,115][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:49,118][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:54,120][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:57:59,121][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:04,122][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:09,124][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:14,125][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:19,126][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:24,127][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:29,128][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:34,129][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:39,130][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:44,131][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:49,132][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:54,133][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:58:59,134][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:04,135][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:09,136][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:14,137][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:19,138][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:24,140][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:29,141][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:34,142][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:39,143][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:44,144][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:49,145][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:54,147][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 01:59:59,148][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:04,149][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:09,150][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:14,151][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:19,152][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:24,153][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:29,160][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 02:00:29,161][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:34,162][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:39,163][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:44,164][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:49,165][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:54,166][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:00:59,167][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:04,169][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:09,170][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:14,172][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:19,173][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:24,174][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:29,176][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:34,178][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:39,180][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:44,181][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:49,182][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:54,183][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:01:59,184][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:04,185][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:09,186][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:14,187][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:19,189][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:24,190][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:29,191][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:34,192][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:39,193][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:44,194][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:49,195][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:54,197][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:02:59,198][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:04,199][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:09,200][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:14,201][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:19,202][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:24,203][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:29,204][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:34,206][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:39,207][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:44,208][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:49,209][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:54,211][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:03:59,223][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:04,225][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:09,226][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:14,227][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:19,229][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:24,230][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:29,231][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:34,232][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:39,233][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:44,238][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:49,243][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:54,245][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:04:59,246][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:04,248][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:09,249][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:14,250][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:19,251][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:24,252][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:29,254][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:34,255][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:39,256][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:42,139][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:05:44,257][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:49,258][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:52,142][WARNING][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 02:05:54,264][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:05:59,269][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:02,149][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 2
[2025-07-26 02:06:02,179][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-26 02:06:04,272][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:09,275][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:14,277][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:19,282][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:24,283][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:29,285][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:34,288][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:39,289][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:44,292][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:49,294][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:54,299][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:06:59,305][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:02,271][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:07:04,307][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:09,308][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:12,276][WARNING][PID:2697206] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 02:07:14,310][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:19,311][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:22,277][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 3
[2025-07-26 02:07:22,283][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-26 02:07:24,313][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:29,314][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:34,315][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:39,316][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:44,319][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:49,320][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:54,327][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:07:59,329][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:04,330][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:09,332][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:14,335][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:19,341][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:22,352][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:08:24,343][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:29,349][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:32,355][WARNING][PID:2697206] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 02:08:34,350][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:39,356][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:42,361][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 4
[2025-07-26 02:08:42,363][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-26 02:08:44,359][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:49,362][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:54,365][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:08:59,372][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:04,375][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:09,377][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:14,378][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:19,384][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:24,385][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:29,388][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:34,460][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:39,462][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:42,452][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:09:44,463][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:49,464][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:52,472][ ERROR][PID:2697206] Giving up for unstable SSH, failures: 1753495552.1425908, 1753495632.2762065, 1753495712.3551533, 1753495792.471884
[2025-07-26 02:09:52,477][ ERROR][PID:2697206] Re-try request for task on 'ResallocHost, ticket_id=4169193, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05888685_20250726_012647, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-26 02:09:52,478][  INFO][PID:2697206] Releasing VM back to pool
[2025-07-26 02:09:52,502][  INFO][PID:2697206] Retry #1 (on other host)
[2025-07-26 02:09:52,504][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:09:52,506][  INFO][PID:2697206] VM allocation process starts
[2025-07-26 02:09:52,536][  INFO][PID:2697206] Trying to allocate VM: ResallocHost, ticket_id=4169756, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-26 02:09:57,545][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:02,547][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:07,548][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:12,550][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:17,551][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:22,554][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:27,558][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:32,560][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:37,561][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:42,563][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:47,564][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:52,565][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:10:57,569][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:02,570][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:07,575][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:12,579][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:17,581][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:22,582][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:27,585][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:32,596][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:37,598][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:42,599][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:47,603][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:52,611][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:11:57,612][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:02,615][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:07,616][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:10,653][  INFO][PID:2697206] Allocated host ResallocHost, ticket_id=4169756, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05889102_20250726_020821, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-26 02:12:10,653][  INFO][PID:2697206] Allocating ssh connection to builder
[2025-07-26 02:12:10,654][  INFO][PID:2697206] Checking that builder machine is OK
[2025-07-26 02:12:11,884][  INFO][PID:2697206] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-26 02:12:12,936][  INFO][PID:2697206] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-26 02:12:12,937][  INFO][PID:2697206] Filling build.info file with builder info
[2025-07-26 02:12:12,941][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:12,944][  INFO][PID:2697206] Not re-notifying FE and msg buses for the new host.
[2025-07-26 02:12:12,945][  INFO][PID:2697206] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339907-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-26 02:12:14,413][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 1
[2025-07-26 02:12:14,417][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 02:12:19,424][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 02:12:19,425][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:24,426][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:29,428][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:34,429][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:39,430][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:44,432][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:49,434][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:54,436][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:12:59,438][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:04,443][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:09,445][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:14,446][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:19,447][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:24,448][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:29,450][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:34,451][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:39,452][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:44,454][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:49,455][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:54,457][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:13:59,458][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:04,459][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:09,463][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:14,464][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:19,465][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:24,467][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:29,471][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:34,473][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:39,475][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:44,476][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:49,479][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:54,482][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:14:59,483][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:04,484][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:09,488][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:14,489][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:19,513][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:24,515][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:29,516][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:34,519][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:39,520][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:44,528][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:49,537][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:54,543][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:15:59,545][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:04,551][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:09,554][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:14,557][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:19,560][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:24,561][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:29,563][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:34,566][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:39,580][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:44,585][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:49,590][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:54,591][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:16:59,594][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:04,595][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:09,597][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:14,599][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:19,602][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:24,604][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:29,607][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:34,610][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:39,617][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:44,619][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:49,623][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:54,624][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:17:59,626][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:04,628][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:09,630][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:14,631][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:19,633][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:24,635][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:29,638][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:34,645][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:39,646][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:44,647][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:49,650][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:54,653][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:18:59,654][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:04,656][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:09,657][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:14,659][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:19,661][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:24,662][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:29,663][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:34,664][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:39,665][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:44,667][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:49,668][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:54,669][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:19:59,673][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:04,674][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:09,675][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:14,676][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:19,677][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:24,683][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:29,685][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:34,686][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:39,688][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:44,689][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:49,691][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:54,693][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:20:59,694][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:04,695][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:09,696][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:14,699][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:19,700][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:24,703][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:29,704][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:34,706][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:39,707][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:44,709][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:49,711][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:54,712][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:21:59,716][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:04,717][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:09,719][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:14,722][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:19,730][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 02:22:19,731][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:24,733][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:29,735][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:34,736][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:39,738][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:44,739][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:49,740][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:54,742][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:22:59,744][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:04,745][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:09,746][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:14,748][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:19,751][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:24,752][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:29,756][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:34,757][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:39,758][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:44,759][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:49,760][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:54,761][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:23:59,763][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:04,764][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:09,765][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:14,767][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:19,768][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:24,769][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:29,770][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:34,771][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:39,772][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:44,773][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:49,774][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:54,775][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:24:59,776][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:04,778][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:09,779][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:14,780][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:19,781][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:24,782][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:29,783][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:34,784][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:39,785][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:44,786][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:49,787][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:54,788][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:25:59,789][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:04,790][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:09,791][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:14,792][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:19,793][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:24,794][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:29,795][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:34,796][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:39,797][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:44,798][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:49,799][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:54,800][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:26:59,801][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:04,802][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:09,803][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:14,804][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:19,805][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:24,806][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:29,807][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:34,808][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:39,809][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:44,810][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:49,811][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:54,813][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:27:59,814][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:04,815][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:09,816][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:14,817][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:19,818][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:24,819][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:29,821][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:34,822][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:39,823][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:44,824][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:49,825][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:54,826][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:28:59,827][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:04,828][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:09,829][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:14,830][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:19,831][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:24,832][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:29,833][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:34,834][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:39,835][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:44,836][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:49,837][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:54,838][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:29:59,839][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:04,840][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:09,841][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:14,842][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:19,843][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:24,843][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:29,845][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:34,846][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:39,847][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:44,848][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:49,849][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:54,850][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:30:59,851][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:04,852][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:09,853][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:14,854][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:19,855][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:24,856][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:29,857][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:34,858][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:39,859][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:44,860][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:49,861][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:54,862][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:31:59,863][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:04,864][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:09,865][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:14,866][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:19,872][  INFO][PID:2697206] Periodic builder liveness probe: alive
[2025-07-26 02:32:19,873][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:24,873][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:29,874][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:34,875][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:39,876][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:44,877][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:49,878][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:54,879][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:32:59,880][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:04,881][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:09,882][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:14,884][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:19,884][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:24,886][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:29,887][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:34,888][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:39,889][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:44,890][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:49,891][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:54,892][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:33:59,893][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:04,894][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:09,895][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:14,896][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:19,897][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:24,898][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:29,899][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:34,900][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:39,901][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:44,902][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:49,903][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:54,904][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:34:59,905][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:04,907][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:09,908][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:14,909][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:19,910][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:24,911][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:29,912][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:34,913][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:39,914][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:44,915][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:49,916][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:54,917][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:35:59,918][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:04,919][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:09,921][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:14,922][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:19,923][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:24,923][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:29,924][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:34,925][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:39,926][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:44,928][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:49,928][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:54,930][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:36:59,931][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:04,932][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:09,933][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:14,934][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:19,935][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:24,936][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:29,937][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:34,938][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:39,940][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:44,943][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:49,944][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:54,945][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:37:59,946][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:04,947][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:09,948][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:14,949][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:19,951][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:24,952][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:29,954][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:34,955][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:39,958][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:44,960][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:49,144][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:38:49,961][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:54,962][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:38:59,145][WARNING][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 02:38:59,963][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:04,964][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:09,146][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 2
[2025-07-26 02:39:09,148][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 02:39:09,965][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:14,966][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:19,969][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:24,970][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:29,972][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:34,973][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:39,974][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:44,975][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:49,976][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:54,978][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:39:59,979][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:04,980][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:09,218][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:40:09,982][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:14,986][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:19,225][WARNING][PID:2697206] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 02:40:19,988][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:24,989][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:29,227][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 3
[2025-07-26 02:40:29,229][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 02:40:29,990][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:34,992][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:39,993][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:44,998][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:50,003][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:40:55,006][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:00,007][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:05,017][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:10,018][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:15,019][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:20,020][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:25,021][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:29,297][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:41:30,022][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:35,023][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:39,301][WARNING][PID:2697206] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 02:41:40,024][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:45,025][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:49,301][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 4
[2025-07-26 02:41:49,303][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 02:41:50,027][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:41:55,029][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:42:00,034][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:42:05,035][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:42:10,036][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:42:15,038][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:42:20,046][  INFO][PID:2697206] Periodic builder liveness probe: dead
[2025-07-26 02:42:49,371][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 02:42:59,377][ ERROR][PID:2697206] Giving up for unstable SSH, failures: 1753497539.1456387, 1753497619.2259185, 1753497699.3012078, 1753497779.3769512
[2025-07-26 02:43:20,117][ ERROR][PID:2697206] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-07-26 02:44:30,188][ ERROR][PID:2697206] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-07-26 02:45:40,258][ ERROR][PID:2697206] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-07-26 02:46:50,329][ ERROR][PID:2697206] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.163 port 22: Connection timed out

[2025-07-26 02:47:00,330][ ERROR][PID:2697206] Can't ssh to cancel build.
[2025-07-26 02:47:00,332][ ERROR][PID:2697206] Re-try request for task on 'ResallocHost, ticket_id=4169756, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05889102_20250726_020821, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-26 02:47:00,332][  INFO][PID:2697206] Releasing VM back to pool
[2025-07-26 02:47:00,351][  INFO][PID:2697206] Retry #2 (on other host)
[2025-07-26 02:47:00,351][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:00,352][  INFO][PID:2697206] VM allocation process starts
[2025-07-26 02:47:00,373][  INFO][PID:2697206] Trying to allocate VM: ResallocHost, ticket_id=4170213, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-26 02:47:05,375][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:10,376][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:15,377][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:20,378][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:25,379][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:30,381][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:35,382][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:40,383][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:45,385][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:50,391][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:47:55,392][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:00,393][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:05,394][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:10,395][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:15,396][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:20,400][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:25,405][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:30,406][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:35,407][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:40,409][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:45,409][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:50,410][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:48:55,411][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:00,413][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:05,414][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:10,415][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:15,417][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:20,418][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:25,419][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:30,420][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:35,421][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:40,422][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:45,423][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:50,427][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:49:55,429][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:50:00,430][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:50:05,431][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:50:10,432][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:50:15,433][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:50:18,487][  INFO][PID:2697206] Allocated host ResallocHost, ticket_id=4170213, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05889512_20250726_024620, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-26 02:50:18,488][  INFO][PID:2697206] Allocating ssh connection to builder
[2025-07-26 02:50:18,489][  INFO][PID:2697206] Checking that builder machine is OK
[2025-07-26 02:50:19,754][  INFO][PID:2697206] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-26 02:50:20,739][  INFO][PID:2697206] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-26 02:50:20,740][  INFO][PID:2697206] Filling build.info file with builder info
[2025-07-26 02:50:20,866][  INFO][PID:2697206] Checking for cancel request
[2025-07-26 02:50:20,866][  INFO][PID:2697206] Not re-notifying FE and msg buses for the new host.
[2025-07-26 02:50:20,867][  INFO][PID:2697206] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339907-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-26 02:50:22,131][  INFO][PID:2697206] Downloading the builder-live.log file, attempt 1
[2025-07-26 02:50:22,132][  INFO][PID:2697206] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log
[2025-07-26 02:50:31,328][  INFO][PID:2697206] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.89' (ED25519) to the list of known hosts.

[2025-07-26 02:50:31,328][  INFO][PID:2697206] Downloading results from builder
[2025-07-26 02:50:31,329][  INFO][PID:2697206] rsyncing of mockbuilder@140.211.168.89:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo started
[2025-07-26 02:50:31,330][  INFO][PID:2697206] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.89:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/build-09339907.rsync.log
[2025-07-26 02:50:32,890][  INFO][PID:2697206] rsyncing finished.
[2025-07-26 02:50:32,890][  INFO][PID:2697206] Releasing VM back to pool
[2025-07-26 02:50:32,901][  INFO][PID:2697206] Searching for 'success' file in resultdir
[2025-07-26 02:50:32,901][ ERROR][PID:2697206] Build failed: Backend process error: No success file => build failure
[2025-07-26 02:50:32,902][  INFO][PID:2697206] Finished build: id=9339907 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-eln-ppc64le 
[2025-07-26 02:50:32,904][ ERROR][PID:2697206] Backend process error: No success file => build failure
[2025-07-26 02:50:32,905][  INFO][PID:2697206] Worker failed build, took 12.038255214691162
[2025-07-26 02:50:32,905][  INFO][PID:2697206] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1753498232.9050949,
            "started_on": 1753498220.8668396,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339907-fedora-eln-ppc64le",
            "build_id": 9339907,
            "package_name": "librepo",
            "package_version": "1.20.0-20250726011817.3.g0fc4b98",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/librepo",
            "git_hash": "de5e2692c9c15bf4d64c5da9c0db32f472263048",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch",
                    "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch",
                    "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch"
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339907-librepo",
            "built_packages": "",
            "id": 9339907,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 02:50:32,951][  INFO][PID:2697206] Sending fedora-messaging bus message in build.end
[2025-07-26 02:50:32,976][  INFO][PID:2697206] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/builder-live.log by gzip
[2025-07-26 02:50:32,977][  INFO][PID:2697206] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/builder-live.log' as PID 3125272
[2025-07-26 02:50:32,979][  INFO][PID:2697206] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/builder-live.log)
[2025-07-26 02:50:32,979][  INFO][PID:2697206] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/backend.log by gzip
[2025-07-26 02:50:32,981][  INFO][PID:2697206] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09339907-librepo/backend.log' as PID 3125273