[2025-07-24 06:47:58,444][  INFO][PID:1966429] Marking build as starting
[2025-07-24 06:47:58,468][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:47:58,469][  INFO][PID:1966429] VM allocation process starts
[2025-07-24 06:47:58,519][  INFO][PID:1966429] Trying to allocate VM: ResallocHost, ticket_id=4087635, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-24 06:48:03,520][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:04,555][  INFO][PID:1966429] Allocated host ResallocHost, ticket_id=4087635, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05778862_20250724_064439, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-24 06:48:04,556][  INFO][PID:1966429] Allocating ssh connection to builder
[2025-07-24 06:48:04,556][  INFO][PID:1966429] Checking that builder machine is OK
[2025-07-24 06:48:05,860][  INFO][PID:1966429] Running remote command: copr-builder-ready epel-10-ppc64le
[2025-07-24 06:48:06,849][  INFO][PID:1966429] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-07-24 06:48:06,850][  INFO][PID:1966429] Filling build.info file with builder info
[2025-07-24 06:48:06,851][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:06,852][  INFO][PID:1966429] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "pifang",
            "project_name": "ltp",
            "project_dirname": "ltp",
            "submitter": "pifang",
            "ended_on": null,
            "started_on": 1753339686.8519373,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9317387-epel-10-ppc64le",
            "build_id": 9317387,
            "package_name": "ltp",
            "package_version": "20250530-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/pifang/ltp/ltp",
            "git_hash": "f9388ecd47aad97ae2c7d3e95deea5bbf3795d64",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "pifang/ltp--pifang",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/pifang/ltp/epel-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/pifang/ltp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/pifang/ltp",
            "result_dir": "09317387-ltp",
            "built_packages": "",
            "id": 9317387,
            "mockchain_macros": {
                "copr_username": "pifang",
                "copr_projectname": "ltp",
                "vendor": "Fedora Project COPR (pifang/ltp)"
            }
        }
    ]
}
[2025-07-24 06:48:06,871][  INFO][PID:1966429] Sending fedora-messaging bus message in build.start
[2025-07-24 06:48:07,594][  INFO][PID:1966429] Sending fedora-messaging bus message in chroot.start
[2025-07-24 06:48:07,627][  INFO][PID:1966429] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9317387-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2025-07-24 06:48:09,294][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 1
[2025-07-24 06:48:09,295][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-24 06:48:14,299][  INFO][PID:1966429] Periodic builder liveness probe: alive
[2025-07-24 06:48:14,300][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:19,301][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:24,302][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:29,303][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:34,305][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:39,306][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:44,307][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:49,308][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:54,309][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:48:59,311][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:04,312][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:09,313][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:14,314][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:19,316][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:24,317][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:29,321][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:34,328][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:39,330][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:44,331][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:49,332][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:54,333][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:49:59,334][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:04,335][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:09,338][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:14,342][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:19,344][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:24,345][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:29,347][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:34,348][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:39,349][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:44,351][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:49,352][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:54,355][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:50:59,356][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:04,358][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:09,359][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:14,360][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:19,362][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:24,364][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:29,365][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:33,139][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:51:34,367][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:39,368][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:43,140][WARNING][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 06:51:44,369][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:49,370][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:53,141][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 2
[2025-07-24 06:51:53,143][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-24 06:51:54,372][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:51:59,373][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:04,374][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:09,376][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:14,377][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:19,378][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:24,379][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:29,382][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:34,388][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:39,389][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:44,391][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:49,393][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:53,283][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:52:54,394][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:52:59,395][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:03,284][WARNING][PID:1966429] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 06:53:04,396][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:09,397][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:13,285][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 3
[2025-07-24 06:53:13,292][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-24 06:53:14,399][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:19,400][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:24,402][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:29,403][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:34,405][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:39,407][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:44,408][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:49,411][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:54,412][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:53:59,415][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:04,417][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:09,419][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:13,430][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:54:14,420][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:19,422][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:23,433][WARNING][PID:1966429] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 06:54:24,424][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:29,425][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:33,434][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 4
[2025-07-24 06:54:33,435][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-24 06:54:34,427][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:39,429][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:44,430][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:49,432][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:54,433][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:54:59,434][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:04,435][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:09,436][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:14,438][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:19,439][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:24,441][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:29,448][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:33,573][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:55:34,449][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:39,452][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:43,576][ ERROR][PID:1966429] Giving up for unstable SSH, failures: 1753339903.140571, 1753339983.2840269, 1753340063.4336731, 1753340143.576645
[2025-07-24 06:55:43,578][ ERROR][PID:1966429] Re-try request for task on 'ResallocHost, ticket_id=4087635, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05778862_20250724_064439, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-24 06:55:43,578][  INFO][PID:1966429] Releasing VM back to pool
[2025-07-24 06:55:43,589][  INFO][PID:1966429] Retry #1 (on other host)
[2025-07-24 06:55:43,590][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:43,590][  INFO][PID:1966429] VM allocation process starts
[2025-07-24 06:55:43,630][  INFO][PID:1966429] Trying to allocate VM: ResallocHost, ticket_id=4087775, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-24 06:55:48,632][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:53,633][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:55:58,635][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:03,636][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:08,638][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:13,639][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:18,640][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:23,641][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:28,642][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:33,643][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:38,644][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:43,645][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:48,646][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:53,647][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:56:58,648][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:03,649][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:08,650][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:13,652][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:18,653][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:23,654][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:28,655][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:33,656][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:38,658][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:43,659][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:48,660][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:53,661][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:57:58,662][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:03,664][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:08,665][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:13,666][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:18,667][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:23,668][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:28,669][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:33,670][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:38,671][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:43,673][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:48,674][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:53,675][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:58:58,675][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:03,677][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:08,678][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:13,679][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:18,682][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:23,683][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:28,685][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:33,686][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:38,687][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:43,688][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:48,689][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:53,690][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 06:59:58,691][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:03,692][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:08,693][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:13,695][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:18,696][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:23,698][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:28,699][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:33,700][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:38,701][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:43,702][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:48,705][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:53,706][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:00:58,707][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:01,753][  INFO][PID:1966429] Allocated host ResallocHost, ticket_id=4087775, hostname=140.211.168.2, name=copr_osuosl_p09_prod_05779074_20250724_065649, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-24 07:01:01,754][  INFO][PID:1966429] Allocating ssh connection to builder
[2025-07-24 07:01:01,754][  INFO][PID:1966429] Checking that builder machine is OK
[2025-07-24 07:01:03,245][  INFO][PID:1966429] Running remote command: copr-builder-ready epel-10-ppc64le
[2025-07-24 07:01:04,251][  INFO][PID:1966429] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-07-24 07:01:04,252][  INFO][PID:1966429] Filling build.info file with builder info
[2025-07-24 07:01:04,261][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:04,263][  INFO][PID:1966429] Not re-notifying FE and msg buses for the new host.
[2025-07-24 07:01:04,268][  INFO][PID:1966429] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9317387-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2025-07-24 07:01:05,562][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 1
[2025-07-24 07:01:05,563][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-24 07:01:10,571][  INFO][PID:1966429] Periodic builder liveness probe: alive
[2025-07-24 07:01:10,572][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:15,573][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:20,574][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:25,575][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:30,577][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:35,578][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:40,579][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:45,581][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:50,582][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:01:55,583][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:00,584][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:05,585][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:10,586][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:15,588][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:20,589][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:25,590][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:30,591][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:35,592][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:40,593][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:45,595][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:50,596][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:02:55,598][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:00,599][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:05,600][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:10,601][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:15,603][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:20,604][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:25,605][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:30,607][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:35,610][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:40,611][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:45,614][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:50,616][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:03:55,617][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:00,618][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:05,619][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:10,620][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:15,622][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:20,623][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:25,624][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:30,626][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:35,627][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:40,628][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:45,629][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:50,630][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:04:55,631][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:00,633][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:05,634][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:10,635][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:15,639][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:20,641][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:25,642][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:30,643][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:35,644][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:40,645][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:45,647][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:50,648][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:05:55,652][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:00,653][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:05,654][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:10,655][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:15,657][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:20,658][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:25,659][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:30,660][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:35,661][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:40,663][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:45,668][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:50,670][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:06:55,671][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:00,671][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:05,672][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:10,673][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:15,674][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:20,676][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:25,677][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:30,678][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:35,679][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:40,680][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:45,681][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:50,682][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:07:55,683][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:00,684][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:05,685][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:10,686][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:15,688][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:20,689][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:25,690][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:30,691][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:35,692][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:40,693][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:45,694][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:50,696][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:08:55,697][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:00,698][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:05,699][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:10,700][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:15,701][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:20,702][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:25,704][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:30,705][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:35,706][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:40,707][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:45,708][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:50,710][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:09:55,711][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:00,713][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:05,717][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:10,719][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:15,722][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:20,723][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:25,725][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:30,727][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:35,729][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:40,730][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:45,731][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:50,732][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:10:55,733][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:00,734][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:05,735][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:10,754][  INFO][PID:1966429] Periodic builder liveness probe: alive
[2025-07-24 07:11:10,755][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:15,756][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:20,760][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:25,761][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:30,762][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:35,764][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:40,765][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:45,767][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:50,768][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:11:55,770][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:00,771][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:05,772][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:10,773][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:15,778][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:20,783][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:25,784][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:30,786][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:35,787][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:40,788][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:45,789][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:50,790][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:12:55,791][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:00,794][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:05,795][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:10,796][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:15,797][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:20,798][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:25,799][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:30,801][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:35,803][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:40,804][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:45,805][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:50,807][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:13:55,808][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:00,809][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:05,810][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:10,811][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:15,812][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:20,814][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:25,815][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:30,816][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:35,817][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:40,818][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:45,819][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:50,820][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:14:55,821][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:00,822][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:05,823][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:10,824][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:15,825][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:20,826][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:25,828][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:30,829][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:35,830][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:40,831][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:45,832][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:50,833][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:15:55,834][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:00,836][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:05,837][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:10,838][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:15,839][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:20,839][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:25,841][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:30,842][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:35,843][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:40,844][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:45,845][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:50,846][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:16:55,847][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:00,848][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:05,850][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:10,851][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:15,852][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:20,853][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:25,854][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:30,856][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:35,857][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:40,858][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:45,859][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:50,863][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:17:55,866][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:00,866][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:05,867][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:10,868][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:15,869][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:20,870][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:25,871][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:30,873][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:35,874][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:40,875][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:45,876][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:50,877][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:18:55,878][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:00,879][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:05,881][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:10,882][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:15,882][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:20,884][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:25,885][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:30,886][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:35,887][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:40,888][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:45,889][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:50,890][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:19:55,891][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:00,892][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:05,893][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:10,895][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:15,897][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:20,898][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:25,899][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:30,900][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:35,901][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:40,902][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:45,903][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:50,908][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:20:55,910][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:00,912][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:05,913][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:10,920][  INFO][PID:1966429] Periodic builder liveness probe: alive
[2025-07-24 07:21:10,920][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:15,921][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:20,922][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:25,924][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:30,925][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:35,927][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:40,928][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:45,929][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:50,930][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:21:55,932][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:00,933][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:05,934][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:10,935][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:15,936][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:20,937][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:25,938][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:30,939][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:35,940][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:40,942][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:45,943][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:50,944][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:22:55,946][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:00,947][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:05,948][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:10,950][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:15,951][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:20,953][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:25,954][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:30,955][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:35,956][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:40,957][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:45,959][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:50,960][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:23:55,961][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:00,962][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:05,963][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:10,964][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:15,965][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:20,966][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:25,967][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:30,968][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:35,969][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:40,970][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:45,972][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:50,973][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:24:55,974][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:00,975][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:05,976][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:10,977][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:15,979][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:20,981][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:25,982][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:30,983][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:35,984][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:40,985][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:45,987][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:50,988][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:25:55,989][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:00,990][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:05,992][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:10,993][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:15,994][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:20,995][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:25,996][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:31,001][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:36,003][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:41,004][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:46,005][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:51,006][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:26:56,007][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:01,008][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:06,009][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:11,011][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:16,012][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:21,014][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:26,015][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:31,016][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:36,017][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:41,018][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:46,018][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:51,020][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:27:56,021][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:01,022][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:06,023][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:11,024][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:16,025][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:21,026][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:26,027][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:31,028][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:36,029][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:41,031][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:46,032][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:51,033][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:28:56,034][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:01,038][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:06,043][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:11,044][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:16,045][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:21,046][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:26,047][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:31,049][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:36,050][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:41,051][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:46,052][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:51,053][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:29:56,054][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:01,055][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:06,056][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:11,057][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:16,058][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:21,059][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:26,061][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:31,062][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:36,063][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:41,064][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:46,065][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:51,066][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:30:56,068][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:31:01,069][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:31:06,070][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:31:11,075][  INFO][PID:1966429] Periodic builder liveness probe: dead
[2025-07-24 07:31:44,140][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 07:31:54,140][WARNING][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 07:32:04,141][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 2
[2025-07-24 07:32:04,143][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-24 07:32:11,145][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-07-24 07:33:04,211][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 07:33:14,216][WARNING][PID:1966429] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 07:33:21,216][ ERROR][PID:1966429] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-07-24 07:33:24,218][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 3
[2025-07-24 07:33:24,221][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-24 07:34:24,290][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 07:34:31,288][ ERROR][PID:1966429] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-07-24 07:34:34,295][WARNING][PID:1966429] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 07:34:44,295][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 4
[2025-07-24 07:34:44,297][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.2 copr-rpmbuild-log
[2025-07-24 07:35:41,358][ ERROR][PID:1966429] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.2 port 22: Connection timed out

[2025-07-24 07:35:44,364][ ERROR][PID:1966429] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 07:35:51,359][ ERROR][PID:1966429] Can't ssh to cancel build.
[2025-07-24 07:35:54,368][ ERROR][PID:1966429] Giving up for unstable SSH, failures: 1753342314.1409254, 1753342394.2163024, 1753342474.2949884, 1753342554.3685622
[2025-07-24 07:35:54,369][ ERROR][PID:1966429] Re-try request for task on 'ResallocHost, ticket_id=4087775, hostname=140.211.168.2, name=copr_osuosl_p09_prod_05779074_20250724_065649, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-24 07:35:54,369][  INFO][PID:1966429] Releasing VM back to pool
[2025-07-24 07:35:54,378][  INFO][PID:1966429] Retry #2 (on other host)
[2025-07-24 07:35:54,379][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:35:54,379][  INFO][PID:1966429] VM allocation process starts
[2025-07-24 07:35:54,428][  INFO][PID:1966429] Trying to allocate VM: ResallocHost, ticket_id=4088249, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-24 07:35:59,430][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:36:04,430][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:36:09,431][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:36:12,478][  INFO][PID:1966429] Allocated host ResallocHost, ticket_id=4088249, hostname=140.211.168.104, name=copr_osuosl_p09_prod_05779644_20250724_073248, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-24 07:36:12,478][  INFO][PID:1966429] Allocating ssh connection to builder
[2025-07-24 07:36:12,479][  INFO][PID:1966429] Checking that builder machine is OK
[2025-07-24 07:36:13,858][  INFO][PID:1966429] Running remote command: copr-builder-ready epel-10-ppc64le
[2025-07-24 07:36:14,863][  INFO][PID:1966429] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-07-24 07:36:14,864][  INFO][PID:1966429] Filling build.info file with builder info
[2025-07-24 07:36:14,865][  INFO][PID:1966429] Checking for cancel request
[2025-07-24 07:36:14,865][  INFO][PID:1966429] Not re-notifying FE and msg buses for the new host.
[2025-07-24 07:36:14,866][  INFO][PID:1966429] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9317387-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2025-07-24 07:36:16,092][  INFO][PID:1966429] Downloading the builder-live.log file, attempt 1
[2025-07-24 07:36:16,093][  INFO][PID:1966429] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-07-24 07:36:25,225][  INFO][PID:1966429] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.104' (ED25519) to the list of known hosts.

[2025-07-24 07:36:25,225][  INFO][PID:1966429] Downloading results from builder
[2025-07-24 07:36:25,226][  INFO][PID:1966429] rsyncing of mockbuilder@140.211.168.104:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp started
[2025-07-24 07:36:25,226][  INFO][PID:1966429] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.104:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/ &> /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/build-09317387.rsync.log
[2025-07-24 07:36:26,792][  INFO][PID:1966429] rsyncing finished.
[2025-07-24 07:36:26,793][  INFO][PID:1966429] Releasing VM back to pool
[2025-07-24 07:36:26,805][  INFO][PID:1966429] Searching for 'success' file in resultdir
[2025-07-24 07:36:26,805][ ERROR][PID:1966429] Build failed: Backend process error: No success file => build failure
[2025-07-24 07:36:26,806][  INFO][PID:1966429] Finished build: id=9317387 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/pifang/ltp chroot=epel-10-ppc64le 
[2025-07-24 07:36:26,808][ ERROR][PID:1966429] Backend process error: No success file => build failure
[2025-07-24 07:36:26,808][  INFO][PID:1966429] Worker failed build, took 11.94312047958374
[2025-07-24 07:36:26,809][  INFO][PID:1966429] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "pifang",
            "project_name": "ltp",
            "project_dirname": "ltp",
            "submitter": "pifang",
            "ended_on": 1753342586.8088984,
            "started_on": 1753342574.865778,
            "submitted_on": null,
            "status": 0,
            "chroot": "epel-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9317387-epel-10-ppc64le",
            "build_id": 9317387,
            "package_name": "ltp",
            "package_version": "20250530-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/pifang/ltp/ltp",
            "git_hash": "f9388ecd47aad97ae2c7d3e95deea5bbf3795d64",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "pifang/ltp--pifang",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/pifang/ltp/epel-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/pifang/ltp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/pifang/ltp",
            "result_dir": "09317387-ltp",
            "built_packages": "",
            "id": 9317387,
            "mockchain_macros": {
                "copr_username": "pifang",
                "copr_projectname": "ltp",
                "vendor": "Fedora Project COPR (pifang/ltp)"
            }
        }
    ]
}
[2025-07-24 07:36:26,833][  INFO][PID:1966429] Sending fedora-messaging bus message in build.end
[2025-07-24 07:36:26,861][  INFO][PID:1966429] Compressing /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/builder-live.log by gzip
[2025-07-24 07:36:26,862][  INFO][PID:1966429] Running command 'gzip /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/builder-live.log' as PID 2240735
[2025-07-24 07:36:26,864][  INFO][PID:1966429] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/builder-live.log)
[2025-07-24 07:36:26,864][  INFO][PID:1966429] Compressing /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/backend.log by gzip
[2025-07-24 07:36:26,865][  INFO][PID:1966429] Running command 'gzip /var/lib/copr/public_html/results/pifang/ltp/epel-10-ppc64le/09317387-ltp/backend.log' as PID 2240737