[2025-07-26 02:51:46,920][  INFO][PID:3132406] Marking build as starting
[2025-07-26 02:51:46,989][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:51:46,990][  INFO][PID:3132406] VM allocation process starts
[2025-07-26 02:51:47,015][  INFO][PID:3132406] Trying to allocate VM: ResallocHost, ticket_id=4170296, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 02:51:52,020][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:51:57,022][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:02,024][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:07,025][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:12,031][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:17,033][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:22,034][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:27,037][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:32,038][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:37,043][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:42,044][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:47,045][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:52,046][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:52:57,048][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:02,055][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:07,056][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:12,057][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:17,058][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:22,059][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:27,061][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:32,062][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:37,063][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:42,064][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:47,065][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:52,066][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:53:57,067][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:02,068][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:07,070][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:12,071][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:17,073][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:22,076][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:27,077][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:32,078][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:37,079][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:42,080][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:47,081][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:52,082][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:54:57,083][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:02,084][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:07,086][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:12,087][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:17,089][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:22,090][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:27,091][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:32,092][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:37,093][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:42,094][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:47,095][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:52,096][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:55:57,097][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:02,099][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:07,101][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:12,103][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:17,104][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:22,105][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:27,106][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:32,107][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:37,108][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:42,109][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:47,110][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:52,111][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:56:57,113][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:02,114][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:07,115][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:12,117][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:17,118][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:22,119][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:27,120][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:32,122][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:37,122][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:42,124][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:47,125][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:52,126][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:57:57,127][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:02,128][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:07,129][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:12,131][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:17,132][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:22,133][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:27,134][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:32,135][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:37,137][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:42,138][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:47,139][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:52,140][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:58:57,141][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:02,142][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:07,143][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:12,144][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:17,147][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:22,151][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:27,152][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:32,153][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:37,154][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:42,156][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:47,157][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:52,158][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 02:59:57,159][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:02,160][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:07,161][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:12,162][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:17,163][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:22,165][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:27,165][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:32,167][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:37,168][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:42,169][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:47,170][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:52,171][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:00:57,175][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:02,176][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:07,177][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:12,178][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:17,179][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:22,180][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:27,181][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:32,182][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:37,184][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:42,185][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:47,186][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:52,187][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:01:57,188][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:02,189][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:05,204][  INFO][PID:3132406] Allocated host ResallocHost, ticket_id=4170296, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05889624_20250726_025833, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:02:05,205][  INFO][PID:3132406] Allocating ssh connection to builder
[2025-07-26 03:02:05,205][  INFO][PID:3132406] Checking that builder machine is OK
[2025-07-26 03:02:06,650][  INFO][PID:3132406] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-26 03:02:07,641][  INFO][PID:3132406] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-26 03:02:07,641][  INFO][PID:3132406] Filling build.info file with builder info
[2025-07-26 03:02:07,642][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:07,643][  INFO][PID:3132406] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1753498927.6428046,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339913-fedora-rawhide-ppc64le",
            "build_id": 9339913,
            "package_name": "libdnf",
            "package_version": "0.75.0-0.20250726011821.0.74.0+27.g96de9331",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libdnf",
            "git_hash": "4b1c7e16c201bc6a014b1ace788d80b73aab45a4",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339913-libdnf",
            "built_packages": "",
            "id": 9339913,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 03:02:07,708][  INFO][PID:3132406] Sending fedora-messaging bus message in build.start
[2025-07-26 03:02:08,354][  INFO][PID:3132406] Sending fedora-messaging bus message in chroot.start
[2025-07-26 03:02:08,381][  INFO][PID:3132406] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339913-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-26 03:02:09,647][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 1
[2025-07-26 03:02:09,648][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 03:02:14,658][  INFO][PID:3132406] Periodic builder liveness probe: alive
[2025-07-26 03:02:14,659][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:19,660][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:24,662][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:29,664][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:34,666][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:39,667][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:44,668][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:49,669][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:54,670][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:02:59,671][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:04,673][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:09,674][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:14,676][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:19,677][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:24,678][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:29,679][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:34,680][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:39,682][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:44,683][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:49,685][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:54,686][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:03:59,687][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:04,689][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:09,692][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:14,693][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:19,694][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:24,695][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:29,696][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:34,698][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:39,699][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:44,700][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:49,702][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:54,703][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:04:59,704][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:04,705][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:09,706][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:14,707][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:19,708][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:24,709][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:29,710][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:34,711][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:39,712][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:44,714][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:49,715][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:54,716][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:05:59,718][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:04,720][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:09,722][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:14,723][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:19,724][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:24,726][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:29,727][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:34,729][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:39,730][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:44,731][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:49,732][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:54,734][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:06:59,735][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:04,737][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:09,738][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:14,740][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:19,742][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:24,743][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:29,746][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:34,749][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:39,750][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:44,751][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:49,753][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:54,754][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:07:59,755][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:04,756][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:09,757][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:14,759][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:19,760][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:24,762][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:29,763][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:34,765][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:39,766][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:44,769][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:49,771][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:54,773][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:08:59,775][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:04,776][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:09,777][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:14,779][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:19,783][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:24,784][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:29,785][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:34,786][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:39,787][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:44,788][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:49,789][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:54,791][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:09:59,792][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:04,793][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:09,794][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:14,795][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:19,797][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:24,798][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:29,800][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:34,801][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:39,803][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:44,804][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:49,805][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:54,806][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:10:59,807][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:04,808][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:09,809][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:14,810][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:19,811][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:24,813][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:29,814][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:34,815][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:39,817][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:44,818][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:49,820][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:54,823][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:11:59,825][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:04,827][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:09,828][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:14,848][  INFO][PID:3132406] Periodic builder liveness probe: alive
[2025-07-26 03:12:14,852][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:19,854][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:24,856][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:29,857][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:34,858][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:39,859][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:44,860][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:49,865][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:54,866][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:12:59,867][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:04,869][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:09,871][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:14,872][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:19,874][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:24,875][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:29,876][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:34,877][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:39,878][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:44,880][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:49,881][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:54,882][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:13:59,883][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:04,884][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:09,885][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:14,886][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:19,887][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:24,889][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:29,890][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:34,891][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:39,892][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:44,896][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:49,898][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:54,900][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:14:59,901][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:04,902][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:09,903][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:14,904][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:19,905][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:24,906][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:29,907][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:34,908][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:39,910][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:44,911][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:49,912][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:54,914][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:15:59,915][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:04,916][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:09,917][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:14,920][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:19,921][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:24,925][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:29,927][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:34,928][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:39,929][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:44,930][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:49,931][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:54,932][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:16:59,933][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:04,934][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:09,935][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:14,936][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:19,937][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:24,938][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:29,940][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:34,941][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:39,942][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:44,943][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:49,944][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:54,945][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:17:59,946][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:04,947][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:09,948][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:14,949][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:19,950][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:24,952][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:29,953][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:34,954][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:39,955][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:44,957][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:49,959][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:54,960][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:18:59,961][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:04,962][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:09,963][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:14,965][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:19,967][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:24,968][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:29,970][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:34,971][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:39,974][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:44,975][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:49,976][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:54,978][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:19:59,979][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:04,980][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:09,981][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:14,984][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:19,985][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:24,986][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:29,987][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:34,988][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:39,989][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:44,990][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:49,991][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:54,992][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:20:59,994][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:04,995][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:09,999][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:15,000][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:20,001][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:25,002][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:30,005][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:35,009][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:40,011][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:45,069][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:50,103][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:21:55,112][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:00,115][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:05,179][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:10,190][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:15,199][  INFO][PID:3132406] Periodic builder liveness probe: alive
[2025-07-26 03:22:15,199][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:20,200][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:25,201][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:30,202][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:35,203][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:40,209][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:45,212][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:50,257][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:22:55,423][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:00,426][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:05,427][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:10,428][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:15,595][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:20,737][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:25,814][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:30,816][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:35,817][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:40,818][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:45,819][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:50,821][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:23:55,822][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:00,823][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:05,824][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:10,825][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:15,826][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:20,828][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:25,829][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:30,830][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:35,833][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:40,835][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:45,843][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:50,844][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:24:55,845][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:00,847][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:05,850][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:10,851][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:15,853][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:20,854][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:25,855][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:30,856][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:35,858][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:40,864][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:45,866][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:50,867][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:25:55,898][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:00,899][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:05,900][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:10,902][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:15,903][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:20,906][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:25,910][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:30,911][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:35,912][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:40,913][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:45,932][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:51,216][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:26:56,218][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:01,362][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:06,625][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:11,816][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:16,819][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:21,822][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:26,827][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:31,830][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:36,831][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:41,833][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:46,835][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:51,837][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:27:56,838][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:01,840][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:06,841][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:11,842][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:16,843][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:21,847][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:26,851][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:31,853][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:36,855][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:41,856][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:46,857][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:51,858][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:28:56,860][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:01,862][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:06,864][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:11,866][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:16,866][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:21,867][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:26,868][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:31,870][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:36,871][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:41,872][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:46,873][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:51,874][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:29:56,875][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:01,876][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:06,878][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:11,879][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:16,882][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:21,883][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:26,885][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:31,890][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:36,892][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:41,895][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:46,897][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:51,899][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:30:56,900][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:01,901][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:06,902][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:11,903][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:16,904][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:21,906][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:26,908][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:31,909][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:36,911][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:41,918][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:46,923][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:51,929][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:31:56,930][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:01,932][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:06,933][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:11,935][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:16,942][  INFO][PID:3132406] Periodic builder liveness probe: alive
[2025-07-26 03:32:16,943][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:21,944][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:26,946][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:31,947][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:36,948][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:41,949][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:46,950][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:51,951][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:32:56,952][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:01,954][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:06,955][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:11,956][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:16,957][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:21,958][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:26,960][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:31,961][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:36,962][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:41,966][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:46,967][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:51,968][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:33:56,970][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:01,971][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:06,973][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:11,974][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:17,249][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:22,252][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:27,254][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:32,256][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:37,257][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:42,259][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:47,261][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:52,263][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:34:57,264][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:02,265][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:07,267][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:12,268][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:17,293][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:22,294][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:27,295][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:32,296][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:37,297][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:42,299][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:47,300][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:52,301][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:35:57,303][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:02,303][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:07,305][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:12,306][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:17,307][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:22,308][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:27,309][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:32,311][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:37,312][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:42,314][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:47,315][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:52,316][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:36:57,317][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:02,318][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:07,319][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:12,337][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:17,338][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:22,340][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:27,342][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:30,146][ ERROR][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:37:32,343][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:37,345][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:40,147][WARNING][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:37:42,346][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:47,352][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:50,239][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 2
[2025-07-26 03:37:50,399][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 03:37:52,358][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:37:57,364][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:02,366][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:07,367][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:12,368][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:17,370][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:22,371][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:27,373][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:32,377][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:37,378][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:42,380][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:47,382][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:50,465][ ERROR][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:38:52,383][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:38:57,385][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:00,516][WARNING][PID:3132406] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:39:02,386][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:07,389][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:10,517][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 3
[2025-07-26 03:39:10,518][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 03:39:12,393][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:17,394][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:22,396][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:27,399][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:32,400][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:37,401][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:42,403][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:47,406][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:52,407][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:39:57,408][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:02,410][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:07,411][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:10,586][ ERROR][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:40:12,412][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:17,413][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:20,587][WARNING][PID:3132406] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:40:22,414][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:27,415][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:30,588][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 4
[2025-07-26 03:40:30,631][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-26 03:40:32,416][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:37,418][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:42,418][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:47,420][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:52,420][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:40:57,421][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:02,422][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:07,424][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:12,425][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:17,426][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:22,427][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:27,428][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:30,700][ ERROR][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:41:32,429][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:37,431][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:40,736][ ERROR][PID:3132406] Giving up for unstable SSH, failures: 1753501060.1474962, 1753501140.51674, 1753501220.5874116, 1753501300.7363071
[2025-07-26 03:41:40,737][ ERROR][PID:3132406] Re-try request for task on 'ResallocHost, ticket_id=4170296, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05889624_20250726_025833, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-26 03:41:40,737][  INFO][PID:3132406] Releasing VM back to pool
[2025-07-26 03:41:40,746][  INFO][PID:3132406] Retry #1 (on other host)
[2025-07-26 03:41:40,747][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:40,748][  INFO][PID:3132406] VM allocation process starts
[2025-07-26 03:41:40,782][  INFO][PID:3132406] Trying to allocate VM: ResallocHost, ticket_id=4170855, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:41:45,783][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:50,784][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:41:55,785][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:00,787][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:05,788][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:10,789][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:15,790][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:20,793][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:25,794][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:30,916][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:35,918][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:40,920][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:45,921][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:50,923][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:42:55,925][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:00,926][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:05,928][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:10,929][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:15,931][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:20,932][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:25,934][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:30,935][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:35,938][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:40,946][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:45,949][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:50,950][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:43:55,953][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:01,321][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:06,329][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:11,338][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:16,415][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:21,437][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:26,458][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:31,468][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:36,475][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:41,483][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:46,488][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:51,493][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:56,510][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:44:58,925][  INFO][PID:3132406] Allocated host ResallocHost, ticket_id=4170855, hostname=140.211.168.14, name=copr_osuosl_p09_prod_05890014_20250726_034100, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:44:58,927][  INFO][PID:3132406] Allocating ssh connection to builder
[2025-07-26 03:44:58,928][  INFO][PID:3132406] Checking that builder machine is OK
[2025-07-26 03:45:00,442][  INFO][PID:3132406] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-26 03:45:01,589][  INFO][PID:3132406] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-26 03:45:01,875][  INFO][PID:3132406] Filling build.info file with builder info
[2025-07-26 03:45:01,883][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:01,884][  INFO][PID:3132406] Not re-notifying FE and msg buses for the new host.
[2025-07-26 03:45:01,885][  INFO][PID:3132406] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339913-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-26 03:45:03,282][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 1
[2025-07-26 03:45:03,290][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.14 copr-rpmbuild-log
[2025-07-26 03:45:08,303][  INFO][PID:3132406] Periodic builder liveness probe: alive
[2025-07-26 03:45:08,306][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:13,312][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:18,315][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:23,318][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:28,322][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:33,323][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:38,324][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:43,327][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:48,328][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:53,331][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:45:58,334][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:03,338][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:08,340][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:13,343][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:18,347][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:23,352][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:28,361][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:33,366][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:38,374][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:43,378][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:48,380][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:53,386][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:46:58,390][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:03,392][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:08,394][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:13,395][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:18,396][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:23,398][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:28,400][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:33,407][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:38,408][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:43,411][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:48,420][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:53,427][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:47:58,429][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:03,430][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:08,435][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:13,436][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:18,441][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:23,445][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:28,447][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:33,453][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:38,456][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:43,461][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:48,464][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:53,466][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:48:58,467][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:03,468][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:08,469][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:13,470][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:18,472][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:23,473][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:28,475][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:33,478][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:38,480][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:43,481][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:48,482][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:53,484][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:49:58,485][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:03,487][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:08,488][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:13,489][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:18,490][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:23,491][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:28,492][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:33,494][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:38,495][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:43,496][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:48,498][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:53,500][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:50:58,502][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:03,503][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:08,504][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:13,505][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:18,507][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:23,508][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:28,509][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:33,510][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:38,511][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:43,513][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:48,514][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:53,515][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:51:58,516][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:03,517][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:08,518][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:13,519][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:18,521][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:23,522][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:28,523][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:33,524][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:38,525][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:43,526][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:48,528][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:53,529][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:52:58,530][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:03,531][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:08,532][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:13,533][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:18,534][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:23,535][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:28,536][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:33,537][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:38,538][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:43,539][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:48,540][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:53,541][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:53:58,543][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:03,544][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:08,546][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:13,547][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:18,548][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:23,549][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:28,551][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:33,553][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:38,554][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:43,555][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:48,556][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:53,558][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:54:58,559][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:03,560][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:08,567][  INFO][PID:3132406] Periodic builder liveness probe: alive
[2025-07-26 03:55:08,568][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:13,569][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:18,570][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:23,571][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:28,572][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:33,574][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:38,575][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:43,576][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:48,577][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:53,578][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:55:58,579][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:03,580][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:08,581][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:13,582][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:18,583][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:23,584][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:28,585][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:33,586][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:38,587][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:43,588][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:48,589][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:53,590][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:56:58,591][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:03,592][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:08,593][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:13,594][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:18,595][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:23,596][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:28,597][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:33,598][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:38,599][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:43,600][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:48,602][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:53,603][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:57:58,604][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:03,605][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:08,606][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:13,607][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:18,608][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:23,609][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:28,611][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:33,612][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:38,613][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:43,614][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:48,615][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:53,616][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:58:58,617][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:03,618][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:08,619][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:13,620][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:18,621][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:23,623][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:28,624][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:33,625][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:38,626][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:43,627][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:48,628][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:53,629][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 03:59:58,630][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:03,631][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:08,632][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:13,633][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:18,635][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:23,636][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:28,637][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:33,638][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:38,639][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:43,641][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:48,642][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:53,643][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:00:58,644][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:03,645][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:08,646][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:13,647][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:18,648][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:23,649][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:28,650][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:33,651][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:38,652][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:43,653][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:48,655][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:53,656][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:01:58,658][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:03,659][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:08,660][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:13,661][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:18,662][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:23,663][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:28,664][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:33,665][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:38,666][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:43,667][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:48,668][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:49,138][ ERROR][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 04:02:53,669][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:58,670][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:02:59,139][WARNING][PID:3132406] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 04:03:03,671][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:08,672][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:09,140][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 2
[2025-07-26 04:03:09,141][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.14 copr-rpmbuild-log
[2025-07-26 04:03:13,674][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:18,675][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:23,676][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:28,677][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:33,678][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:38,679][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:43,680][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:48,681][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:53,684][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:03:58,685][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:03,687][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:08,688][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:13,689][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:18,690][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:23,691][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:28,692][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:33,693][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:38,695][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:43,696][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:48,697][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:53,698][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:04:58,700][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:05:03,701][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:05:08,711][  INFO][PID:3132406] Periodic builder liveness probe: dead
[2025-07-26 04:05:09,925][  INFO][PID:3132406] Cancel request succeeded
out:
err:
Warning: Permanently added '140.211.168.14' (ED25519) to the list of known hosts.
Unexpected exception
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 86, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2025-07-26 04:05:47,899][ ERROR][PID:3132406] Re-try request for task on 'ResallocHost, ticket_id=4170855, hostname=140.211.168.14, name=copr_osuosl_p09_prod_05890014_20250726_034100, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-26 04:05:47,899][  INFO][PID:3132406] Releasing VM back to pool
[2025-07-26 04:05:47,909][  INFO][PID:3132406] Retry #2 (on other host)
[2025-07-26 04:05:47,910][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:05:47,911][  INFO][PID:3132406] VM allocation process starts
[2025-07-26 04:05:47,965][  INFO][PID:3132406] Trying to allocate VM: ResallocHost, ticket_id=4171032, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 04:05:51,007][  INFO][PID:3132406] Allocated host ResallocHost, ticket_id=4171032, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05890116_20250726_035833, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 04:05:51,008][  INFO][PID:3132406] Allocating ssh connection to builder
[2025-07-26 04:05:51,009][  INFO][PID:3132406] Checking that builder machine is OK
[2025-07-26 04:05:52,309][  INFO][PID:3132406] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-26 04:05:53,310][  INFO][PID:3132406] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-26 04:05:53,313][  INFO][PID:3132406] Filling build.info file with builder info
[2025-07-26 04:05:53,319][  INFO][PID:3132406] Checking for cancel request
[2025-07-26 04:05:53,320][  INFO][PID:3132406] Not re-notifying FE and msg buses for the new host.
[2025-07-26 04:05:53,320][  INFO][PID:3132406] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339913-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-26 04:05:54,579][  INFO][PID:3132406] Downloading the builder-live.log file, attempt 1
[2025-07-26 04:05:54,584][  INFO][PID:3132406] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-26 04:06:03,716][  INFO][PID:3132406] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.35' (ED25519) to the list of known hosts.

[2025-07-26 04:06:03,717][  INFO][PID:3132406] Downloading results from builder
[2025-07-26 04:06:03,718][  INFO][PID:3132406] rsyncing of mockbuilder@140.211.168.35:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf started
[2025-07-26 04:06:03,719][  INFO][PID:3132406] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.35:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/build-09339913.rsync.log
[2025-07-26 04:06:05,251][  INFO][PID:3132406] rsyncing finished.
[2025-07-26 04:06:05,252][  INFO][PID:3132406] Releasing VM back to pool
[2025-07-26 04:06:05,267][  INFO][PID:3132406] Searching for 'success' file in resultdir
[2025-07-26 04:06:05,268][ ERROR][PID:3132406] Build failed: Backend process error: No success file => build failure
[2025-07-26 04:06:05,269][  INFO][PID:3132406] Finished build: id=9339913 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-rawhide-ppc64le 
[2025-07-26 04:06:05,272][ ERROR][PID:3132406] Backend process error: No success file => build failure
[2025-07-26 04:06:05,273][  INFO][PID:3132406] Worker failed build, took 11.952883005142212
[2025-07-26 04:06:05,274][  INFO][PID:3132406] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1753502765.2732913,
            "started_on": 1753502753.3204083,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339913-fedora-rawhide-ppc64le",
            "build_id": 9339913,
            "package_name": "libdnf",
            "package_version": "0.75.0-0.20250726011821.0.74.0+27.g96de9331",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libdnf",
            "git_hash": "4b1c7e16c201bc6a014b1ace788d80b73aab45a4",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339913-libdnf",
            "built_packages": "",
            "id": 9339913,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 04:06:05,343][  INFO][PID:3132406] Sending fedora-messaging bus message in build.end
[2025-07-26 04:06:05,370][  INFO][PID:3132406] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/builder-live.log by gzip
[2025-07-26 04:06:05,372][  INFO][PID:3132406] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/builder-live.log' as PID 3501305
[2025-07-26 04:06:05,374][  INFO][PID:3132406] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/builder-live.log)
[2025-07-26 04:06:05,375][  INFO][PID:3132406] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/backend.log by gzip
[2025-07-26 04:06:05,376][  INFO][PID:3132406] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339913-libdnf/backend.log' as PID 3501307