[2025-07-26 02:52:31,733][  INFO][PID:3139073] Marking build as starting
[2025-07-26 02:52:31,857][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:52:31,861][  INFO][PID:3139073] VM allocation process starts
[2025-07-26 02:52:31,899][  INFO][PID:3139073] Trying to allocate VM: ResallocHost, ticket_id=4170303, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 02:52:36,904][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:52:41,910][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:52:46,911][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:52:51,913][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:52:56,916][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:01,917][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:06,919][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:11,920][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:16,921][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:21,923][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:26,924][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:31,926][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:36,927][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:41,928][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:46,929][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:51,930][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:53:56,931][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:01,932][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:06,934][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:11,935][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:16,936][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:21,937][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:26,938][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:31,941][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:36,942][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:41,943][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:46,944][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:51,945][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:54:56,947][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:01,948][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:06,949][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:11,951][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:16,953][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:21,954][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:26,955][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:31,956][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:36,957][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:41,958][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:46,959][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:51,960][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:55:56,961][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:01,962][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:06,964][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:11,967][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:16,968][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:21,969][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:26,970][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:31,971][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:36,972][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:41,974][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:46,975][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:51,976][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:56:56,977][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:01,978][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:06,980][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:11,981][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:16,982][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:21,983][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:26,984][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:31,985][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:36,986][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:41,987][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:46,989][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:51,990][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:57:56,990][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:01,991][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:06,993][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:11,994][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:16,995][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:21,996][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:26,997][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:31,999][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:37,000][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:42,001][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:47,002][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:52,003][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:58:57,004][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:02,005][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:07,006][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:12,007][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:17,008][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:22,012][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:27,013][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:32,014][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:37,016][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:42,018][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:47,019][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:52,020][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 02:59:57,022][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:02,024][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:07,025][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:12,026][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:17,027][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:22,028][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:27,029][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:32,030][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:37,031][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:42,032][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:47,033][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:52,036][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:00:57,037][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:02,039][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:07,040][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:12,041][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:17,042][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:22,043][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:27,044][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:32,045][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:37,046][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:42,047][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:47,049][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:52,050][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:01:57,051][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:02,052][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:07,053][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:12,054][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:17,056][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:22,058][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:27,060][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:32,061][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:37,063][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:42,064][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:47,065][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:50,174][  INFO][PID:3139073] Allocated host ResallocHost, ticket_id=4170303, hostname=140.211.168.2, name=copr_osuosl_p09_prod_05889623_20250726_025833, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:02:50,174][  INFO][PID:3139073] Allocating ssh connection to builder
[2025-07-26 03:02:50,175][  INFO][PID:3139073] Checking that builder machine is OK
[2025-07-26 03:02:51,649][  INFO][PID:3139073] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-26 03:02:52,698][  INFO][PID:3139073] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-26 03:02:52,699][  INFO][PID:3139073] Filling build.info file with builder info
[2025-07-26 03:02:52,699][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:02:52,701][  INFO][PID:3139073] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1753498972.7007775,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339915-fedora-rawhide-ppc64le",
            "build_id": 9339915,
            "package_name": "dnf5",
            "package_version": "5.2.15.0-20250726011825.22.g2463666a",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/dnf5",
            "git_hash": "f199806d11937a3a090cd1744bf0f14c7effdfed",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339915-dnf5",
            "built_packages": "",
            "id": 9339915,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 03:02:52,751][  INFO][PID:3139073] Sending fedora-messaging bus message in build.start
[2025-07-26 03:02:53,767][  INFO][PID:3139073] Sending fedora-messaging bus message in chroot.start
[2025-07-26 03:02:53,800][  INFO][PID:3139073] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339915-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-26 03:02:55,076][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 1
[2025-07-26 03:02:55,078][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-26 03:03:00,088][  INFO][PID:3139073] Periodic builder liveness probe: alive
[2025-07-26 03:03:00,090][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:05,092][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:10,093][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:15,094][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:20,096][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:25,097][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:30,099][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:35,100][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:40,101][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:45,102][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:50,104][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:03:55,105][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:00,106][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:05,107][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:10,108][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:15,110][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:20,111][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:25,115][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:30,116][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:35,117][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:40,120][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:45,121][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:50,123][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:04:55,125][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:00,127][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:05,129][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:10,130][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:15,131][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:20,133][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:25,134][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:30,135][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:35,136][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:40,137][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:45,139][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:50,140][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:05:55,141][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:00,142][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:05,143][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:10,145][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:15,146][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:20,147][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:25,148][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:30,150][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:35,151][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:40,152][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:45,153][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:50,155][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:06:55,156][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:00,157][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:05,159][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:10,160][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:15,162][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:20,164][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:25,165][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:30,167][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:35,168][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:40,170][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:45,175][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:50,176][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:07:55,177][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:00,178][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:05,179][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:10,180][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:15,181][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:20,182][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:25,184][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:30,185][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:35,187][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:40,189][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:45,190][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:50,194][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:08:55,196][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:00,197][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:05,198][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:10,199][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:15,203][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:20,205][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:25,206][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:30,207][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:35,208][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:40,210][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:45,211][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:50,212][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:09:55,213][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:00,215][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:05,216][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:10,217][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:15,218][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:20,220][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:25,222][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:30,223][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:35,224][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:40,225][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:45,227][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:50,228][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:10:55,230][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:00,231][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:05,232][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:10,233][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:15,234][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:20,235][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:25,236][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:30,238][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:35,239][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:40,241][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:45,242][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:50,246][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:11:55,253][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:00,255][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:05,256][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:10,258][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:15,261][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:20,262][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:25,263][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:30,264][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:35,266][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:40,267][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:45,268][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:50,270][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:12:55,273][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:00,286][  INFO][PID:3139073] Periodic builder liveness probe: alive
[2025-07-26 03:13:00,286][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:05,288][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:10,290][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:15,296][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:20,300][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:25,303][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:30,304][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:35,305][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:40,307][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:45,308][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:50,309][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:13:55,310][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:00,312][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:05,313][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:10,314][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:15,316][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:20,317][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:25,318][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:30,319][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:35,321][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:40,322][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:45,324][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:50,326][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:14:55,328][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:00,329][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:05,330][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:10,331][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:15,332][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:20,333][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:25,334][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:30,335][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:35,337][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:40,338][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:45,339][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:50,340][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:15:55,341][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:00,342][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:05,344][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:10,345][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:15,346][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:20,347][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:25,352][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:30,353][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:35,354][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:40,356][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:45,357][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:50,358][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:16:55,359][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:00,360][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:05,361][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:10,362][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:15,363][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:20,364][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:25,365][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:30,367][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:35,369][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:40,370][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:45,371][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:50,372][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:17:55,373][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:00,374][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:05,375][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:10,376][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:15,377][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:20,378][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:25,379][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:30,381][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:35,382][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:40,384][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:45,387][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:50,389][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:18:55,391][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:00,392][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:05,393][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:10,395][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:15,396][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:20,397][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:25,399][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:30,400][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:35,402][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:40,404][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:45,405][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:50,406][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:19:55,408][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:00,409][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:05,410][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:10,411][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:15,412][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:20,413][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:25,414][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:30,416][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:35,417][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:40,419][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:45,421][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:50,422][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:20:55,423][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:00,424][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:05,425][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:10,426][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:15,427][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:20,429][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:25,431][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:30,433][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:35,435][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:40,443][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:45,446][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:50,450][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:21:55,451][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:00,452][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:05,453][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:10,455][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:15,456][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:20,457][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:25,458][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:30,459][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:35,460][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:40,461][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:45,462][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:50,464][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:22:55,465][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:00,473][  INFO][PID:3139073] Periodic builder liveness probe: alive
[2025-07-26 03:23:00,474][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:05,475][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:10,476][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:15,605][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:20,992][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:25,994][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:31,145][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:36,162][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:41,196][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:46,339][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:51,341][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:23:56,343][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:01,345][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:06,346][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:11,348][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:16,349][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:21,352][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:26,355][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:31,357][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:36,361][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:41,366][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:46,368][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:51,372][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:24:56,373][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:01,379][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:06,383][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:11,384][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:16,385][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:21,390][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:26,392][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:31,393][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:36,394][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:41,396][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:46,397][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:51,399][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:25:56,400][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:01,401][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:06,404][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:11,408][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:16,410][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:21,415][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:26,417][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:31,418][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:36,419][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:41,421][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:46,422][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:51,423][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:26:56,425][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:01,426][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:06,638][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:11,816][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:16,818][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:21,820][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:26,821][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:31,823][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:36,825][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:41,826][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:46,827][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:51,828][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:27:56,830][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:01,832][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:06,833][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:11,834][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:16,835][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:21,838][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:26,839][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:31,840][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:36,841][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:41,842][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:46,843][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:51,845][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:28:56,846][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:01,847][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:06,848][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:11,849][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:16,850][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:21,851][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:26,852][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:31,853][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:36,854][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:41,855][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:46,856][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:51,857][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:29:56,858][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:01,859][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:06,861][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:11,862][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:16,865][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:21,868][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:26,870][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:31,873][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:36,876][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:41,878][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:46,880][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:51,881][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:30:56,882][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:01,883][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:06,885][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:11,886][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:16,888][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:21,889][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:26,890][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:31,891][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:36,892][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:41,893][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:46,895][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:51,896][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:31:56,898][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:01,899][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:06,901][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:11,902][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:16,903][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:21,905][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:26,906][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:31,907][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:36,908][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:41,909][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:46,911][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:51,912][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:32:56,913][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:01,920][  INFO][PID:3139073] Periodic builder liveness probe: alive
[2025-07-26 03:33:01,920][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:06,921][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:11,922][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:16,923][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:21,926][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:26,928][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:31,929][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:36,931][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:41,937][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:46,938][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:51,939][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:33:56,940][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:01,941][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:06,942][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:11,943][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:17,248][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:22,250][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:27,252][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:32,253][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:37,254][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:42,256][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:47,257][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:52,259][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:34:57,260][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:02,261][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:07,262][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:12,264][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:17,265][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:22,266][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:27,268][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:32,269][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:37,271][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:42,272][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:47,273][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:52,275][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:35:57,277][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:02,279][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:07,280][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:12,281][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:17,282][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:22,283][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:27,284][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:32,286][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:37,288][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:41,148][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:36:42,289][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:47,291][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:51,155][WARNING][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:36:52,292][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:36:57,328][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:01,156][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 2
[2025-07-26 03:37:01,157][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-26 03:37:02,330][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:07,331][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:12,336][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:17,338][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:22,339][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:27,341][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:32,342][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:37,346][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:42,348][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:47,352][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:52,358][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:37:57,361][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:01,212][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:38:02,363][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:07,365][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:11,219][WARNING][PID:3139073] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:38:12,366][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:17,368][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:21,220][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 3
[2025-07-26 03:38:21,222][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-26 03:38:22,349][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:38:22,370][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:27,372][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:32,350][WARNING][PID:3139073] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:38:32,375][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:37,377][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:42,351][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 4
[2025-07-26 03:38:42,353][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-26 03:38:42,378][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:47,380][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:52,381][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:38:57,383][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:02,384][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:07,385][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:12,387][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:17,388][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:22,394][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:27,396][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:32,398][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:37,399][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:42,402][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:47,403][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:52,404][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:39:57,405][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:02,407][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:07,408][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:12,410][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:17,411][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:22,412][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:27,413][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:32,413][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:37,415][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:42,415][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:45,364][ ERROR][PID:3139073] Re-try request for task on 'ResallocHost, ticket_id=4170303, hostname=140.211.168.2, name=copr_osuosl_p09_prod_05889623_20250726_025833, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: copr-rpmbuild-log shouldn't exit != 0
[2025-07-26 03:40:45,364][  INFO][PID:3139073] Releasing VM back to pool
[2025-07-26 03:40:45,376][  INFO][PID:3139073] Retry #1 (on other host)
[2025-07-26 03:40:45,377][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:45,378][  INFO][PID:3139073] VM allocation process starts
[2025-07-26 03:40:45,393][  INFO][PID:3139073] Trying to allocate VM: ResallocHost, ticket_id=4170848, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:40:50,394][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:40:55,408][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:00,409][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:05,410][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:10,411][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:15,412][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:20,417][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:25,418][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:30,420][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:35,422][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:40,423][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:45,424][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:50,674][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:41:55,675][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:00,677][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:05,678][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:10,679][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:13,445][  INFO][PID:3139073] Allocated host ResallocHost, ticket_id=4170848, hostname=140.211.168.171, name=copr_osuosl_p09_prod_05890004_20250726_033828, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:42:13,446][  INFO][PID:3139073] Allocating ssh connection to builder
[2025-07-26 03:42:13,446][  INFO][PID:3139073] Checking that builder machine is OK
[2025-07-26 03:42:14,881][  INFO][PID:3139073] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-26 03:42:15,944][  INFO][PID:3139073] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-26 03:42:15,944][  INFO][PID:3139073] Filling build.info file with builder info
[2025-07-26 03:42:15,955][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:15,956][  INFO][PID:3139073] Not re-notifying FE and msg buses for the new host.
[2025-07-26 03:42:15,957][  INFO][PID:3139073] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339915-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-26 03:42:17,274][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 1
[2025-07-26 03:42:17,276][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-07-26 03:42:22,275][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:27,276][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:32,277][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:37,278][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:42,279][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:47,280][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:52,282][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:42:57,283][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:02,291][  INFO][PID:3139073] Periodic builder liveness probe: alive
[2025-07-26 03:43:02,292][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:07,293][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:12,294][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:17,295][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:22,299][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:27,300][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:32,302][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:37,303][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:42,304][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:47,308][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:52,312][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:43:57,317][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:02,319][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:07,325][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:12,326][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:17,327][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:22,333][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:27,338][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:32,341][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:37,346][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:42,350][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:47,354][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:52,356][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:44:57,365][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:02,367][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:07,369][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:12,372][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:17,388][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:22,394][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:27,395][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:32,403][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:37,405][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:42,406][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:47,408][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:52,418][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:45:57,419][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:02,426][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:07,427][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:12,429][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:17,432][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:22,435][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:27,437][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:32,446][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:37,448][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:42,449][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:47,456][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:52,463][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:46:57,465][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:02,467][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:07,472][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:12,474][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:17,480][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:22,484][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:27,489][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:32,499][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:37,503][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:42,509][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:47,510][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:52,511][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:47:57,517][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:02,523][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:07,524][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:12,526][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:17,532][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:22,540][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:27,541][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:32,547][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:37,551][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:42,553][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:47,554][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:52,556][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:48:57,557][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:02,559][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:07,560][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:12,562][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:17,563][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:22,564][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:27,565][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:32,567][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:37,570][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:42,571][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:47,572][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:52,574][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:49:57,575][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:02,577][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:07,578][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:12,580][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:17,581][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:22,582][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:27,584][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:32,585][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:37,587][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:42,589][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:47,596][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:52,598][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:50:57,599][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:02,601][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:07,602][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:12,603][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:17,604][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:22,605][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:27,606][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:32,608][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:37,609][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:42,611][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:47,612][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:52,613][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:51:57,616][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:02,617][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:07,618][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:12,620][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:17,621][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:22,622][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:27,623][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:32,624][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:37,625][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:42,626][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:47,627][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:52,629][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:52:57,630][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:02,637][  INFO][PID:3139073] Periodic builder liveness probe: alive
[2025-07-26 03:53:02,637][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:07,638][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:12,639][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:17,640][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:22,641][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:27,642][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:32,644][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:37,645][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:42,646][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:47,647][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:52,648][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:53:57,653][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:02,655][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:07,656][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:12,657][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:17,658][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:22,659][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:27,660][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:32,927][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:37,929][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:42,936][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:47,938][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:52,939][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:54:57,940][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:03,018][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:08,025][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:13,026][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:18,028][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:23,029][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:28,030][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:33,032][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:38,033][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:43,034][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:48,035][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:53,036][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:55:58,037][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:03,039][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:08,040][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:13,041][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:18,042][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:23,043][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:28,044][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:33,045][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:38,047][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:43,048][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:48,049][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:53,050][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:56:58,051][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:03,052][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:08,053][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:13,054][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:18,056][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:23,057][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:28,058][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:33,059][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:38,059][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:43,061][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:48,062][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:53,063][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:57:58,064][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:03,065][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:08,066][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:13,068][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:18,069][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:23,070][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:28,071][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:33,073][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:38,074][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:43,075][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:48,076][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:53,077][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:58:58,078][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:03,079][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:08,080][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:13,081][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:18,082][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:23,082][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:28,084][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:33,085][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:38,086][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:43,087][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:48,088][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:53,089][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 03:59:58,090][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:03,091][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:08,092][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:13,093][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:18,094][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:23,095][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:28,097][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:33,098][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:38,100][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:43,101][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:48,102][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:53,103][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:00:58,104][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:03,105][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:08,106][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:13,107][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:18,108][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:23,109][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:28,111][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:33,112][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:38,113][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:43,114][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:48,115][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:53,117][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:01:58,118][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:03,119][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:08,120][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:13,121][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:18,122][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:23,123][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:28,124][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:33,125][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:38,126][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:43,127][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:48,128][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:53,130][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:02:58,130][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:03:03,136][  INFO][PID:3139073] Periodic builder liveness probe: dead
[2025-07-26 04:04:03,205][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-07-26 04:04:04,139][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 04:04:14,140][WARNING][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 04:04:24,141][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 2
[2025-07-26 04:04:24,142][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-07-26 04:05:13,274][ ERROR][PID:3139073] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-07-26 04:05:24,210][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 04:05:34,211][WARNING][PID:3139073] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 04:05:44,212][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 3
[2025-07-26 04:05:44,214][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-07-26 04:06:23,358][ ERROR][PID:3139073] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-07-26 04:06:44,285][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 04:06:54,291][WARNING][PID:3139073] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 04:07:04,301][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 4
[2025-07-26 04:07:04,304][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.171 copr-rpmbuild-log
[2025-07-26 04:07:33,440][ ERROR][PID:3139073] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.171 port 22: Connection timed out

[2025-07-26 04:07:43,441][ ERROR][PID:3139073] Can't ssh to cancel build.
[2025-07-26 04:08:04,403][ ERROR][PID:3139073] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 04:08:14,411][ ERROR][PID:3139073] Giving up for unstable SSH, failures: 1753502654.1406176, 1753502734.211874, 1753502814.2911766, 1753502894.4114172
[2025-07-26 04:08:14,414][ ERROR][PID:3139073] Re-try request for task on 'ResallocHost, ticket_id=4170848, hostname=140.211.168.171, name=copr_osuosl_p09_prod_05890004_20250726_033828, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-26 04:08:14,414][  INFO][PID:3139073] Releasing VM back to pool
[2025-07-26 04:08:14,442][  INFO][PID:3139073] Retry #2 (on other host)
[2025-07-26 04:08:14,445][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:08:14,448][  INFO][PID:3139073] VM allocation process starts
[2025-07-26 04:08:14,470][  INFO][PID:3139073] Trying to allocate VM: ResallocHost, ticket_id=4171160, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 04:08:17,531][  INFO][PID:3139073] Allocated host ResallocHost, ticket_id=4171160, hostname=140.211.168.83, name=copr_osuosl_p09_prod_05890132_20250726_040208, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 04:08:17,531][  INFO][PID:3139073] Allocating ssh connection to builder
[2025-07-26 04:08:17,532][  INFO][PID:3139073] Checking that builder machine is OK
[2025-07-26 04:08:19,282][  INFO][PID:3139073] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-26 04:08:20,336][  INFO][PID:3139073] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-26 04:08:20,337][  INFO][PID:3139073] Filling build.info file with builder info
[2025-07-26 04:08:20,348][  INFO][PID:3139073] Checking for cancel request
[2025-07-26 04:08:20,350][  INFO][PID:3139073] Not re-notifying FE and msg buses for the new host.
[2025-07-26 04:08:20,351][  INFO][PID:3139073] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339915-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-26 04:08:21,709][  INFO][PID:3139073] Downloading the builder-live.log file, attempt 1
[2025-07-26 04:08:21,712][  INFO][PID:3139073] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log
[2025-07-26 04:08:30,931][  INFO][PID:3139073] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.83' (ED25519) to the list of known hosts.

[2025-07-26 04:08:30,935][  INFO][PID:3139073] Downloading results from builder
[2025-07-26 04:08:30,935][  INFO][PID:3139073] rsyncing of mockbuilder@140.211.168.83:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5 started
[2025-07-26 04:08:30,936][  INFO][PID:3139073] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.83:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/build-09339915.rsync.log
[2025-07-26 04:08:32,523][  INFO][PID:3139073] rsyncing finished.
[2025-07-26 04:08:32,524][  INFO][PID:3139073] Releasing VM back to pool
[2025-07-26 04:08:32,544][  INFO][PID:3139073] Searching for 'success' file in resultdir
[2025-07-26 04:08:32,546][ ERROR][PID:3139073] Build failed: Backend process error: No success file => build failure
[2025-07-26 04:08:32,547][  INFO][PID:3139073] Finished build: id=9339915 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-rawhide-ppc64le 
[2025-07-26 04:08:32,559][ ERROR][PID:3139073] Backend process error: No success file => build failure
[2025-07-26 04:08:32,559][  INFO][PID:3139073] Worker failed build, took 12.209603786468506
[2025-07-26 04:08:32,560][  INFO][PID:3139073] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1753502912.5598357,
            "started_on": 1753502900.350232,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339915-fedora-rawhide-ppc64le",
            "build_id": 9339915,
            "package_name": "dnf5",
            "package_version": "5.2.15.0-20250726011825.22.g2463666a",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/dnf5",
            "git_hash": "f199806d11937a3a090cd1744bf0f14c7effdfed",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339915-dnf5",
            "built_packages": "",
            "id": 9339915,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 04:08:32,646][  INFO][PID:3139073] Sending fedora-messaging bus message in build.end
[2025-07-26 04:08:32,714][  INFO][PID:3139073] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/builder-live.log by gzip
[2025-07-26 04:08:32,719][  INFO][PID:3139073] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/builder-live.log' as PID 3530119
[2025-07-26 04:08:32,721][  INFO][PID:3139073] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/builder-live.log)
[2025-07-26 04:08:32,726][  INFO][PID:3139073] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/backend.log by gzip
[2025-07-26 04:08:32,727][  INFO][PID:3139073] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09339915-dnf5/backend.log' as PID 3530122