[2025-07-10 15:11:42,625][  INFO][PID:3318955] Marking build as starting
[2025-07-10 15:11:42,813][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:11:42,822][  INFO][PID:3318955] VM allocation process starts
[2025-07-10 15:11:42,886][  INFO][PID:3318955] Trying to allocate VM: ResallocHost, ticket_id=3880747, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-10 15:11:47,903][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:11:52,907][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:11:55,143][  INFO][PID:3318955] Allocated host ResallocHost, ticket_id=3880747, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05255951_20250710_143546, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-10 15:11:55,144][  INFO][PID:3318955] Allocating ssh connection to builder
[2025-07-10 15:11:55,144][  INFO][PID:3318955] Checking that builder machine is OK
[2025-07-10 15:11:56,721][  INFO][PID:3318955] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-10 15:11:57,839][  INFO][PID:3318955] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-10 15:11:57,845][  INFO][PID:3318955] Filling build.info file with builder info
[2025-07-10 15:11:57,855][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:11:57,910][  INFO][PID:3318955] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/HuijingHei",
            "ended_on": null,
            "started_on": 1752160317.8801293,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9263219-fedora-eln-ppc64le",
            "build_id": 9263219,
            "package_name": "bootupd",
            "package_version": "0.2.28.12.gdc7461c-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/bootupd",
            "git_hash": "fceb1c87cedb205b3b8fd85bae5d871766c11148",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/HuijingHei",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "09263219-bootupd",
            "built_packages": "",
            "id": 9263219,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2025-07-10 15:11:58,001][  INFO][PID:3318955] Sending fedora-messaging bus message in build.start
[2025-07-10 15:12:01,442][  INFO][PID:3318955] Sending fedora-messaging bus message in chroot.start
[2025-07-10 15:12:01,541][  INFO][PID:3318955] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9263219-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-10 15:12:02,952][  INFO][PID:3318955] Downloading the builder-live.log file, attempt 1
[2025-07-10 15:12:02,957][  INFO][PID:3318955] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-10 15:12:07,991][  INFO][PID:3318955] Periodic builder liveness probe: alive
[2025-07-10 15:12:07,992][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:12,995][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:17,999][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:23,001][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:28,012][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:33,014][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:38,022][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:43,024][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:48,029][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:53,040][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:12:58,047][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:03,057][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:08,058][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:13,063][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:18,077][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:23,079][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:28,081][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:33,090][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:38,093][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:43,095][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:48,108][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:53,111][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:13:58,114][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:03,117][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:08,126][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:13,132][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:18,136][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:23,143][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:28,146][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:33,155][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:38,159][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:43,166][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:48,171][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:53,177][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:14:58,179][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:03,185][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:08,190][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:13,196][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:18,205][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:23,210][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:28,211][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:33,217][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:38,224][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:43,229][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:48,237][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:53,248][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:15:58,259][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:03,265][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:08,270][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:13,274][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:18,281][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:23,284][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:28,287][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:33,293][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:38,303][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:43,308][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:48,311][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:53,317][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:16:58,322][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:03,327][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:08,339][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:13,341][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:18,350][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:23,361][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:28,362][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:33,371][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:38,374][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:43,382][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:48,387][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:53,395][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:17:58,398][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:03,400][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:08,406][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:13,417][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:18,421][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:23,424][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:28,427][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:33,431][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:38,439][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:43,440][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:48,448][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:53,463][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:18:58,469][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:03,474][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:08,482][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:13,490][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:18,491][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:23,504][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:28,511][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:33,523][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:38,533][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:43,534][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:48,539][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:53,541][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:19:58,562][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:03,565][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:08,573][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:13,579][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:18,585][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:23,593][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:28,599][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:33,602][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:38,604][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:43,606][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:48,608][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:53,611][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:20:58,616][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:03,627][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:08,628][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:13,630][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:18,635][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:23,640][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:28,650][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:33,654][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:38,660][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:43,668][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:48,674][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:53,677][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:21:58,678][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:03,688][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:08,697][  INFO][PID:3318955] Periodic builder liveness probe: alive
[2025-07-10 15:22:08,698][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:13,701][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:18,704][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:23,707][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:28,713][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:33,714][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:38,717][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:43,720][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:48,726][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:53,727][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:22:58,731][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:03,733][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:08,734][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:13,738][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:18,739][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:23,742][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:28,746][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:33,749][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:38,751][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:43,752][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:48,753][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:53,756][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:23:58,758][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:03,760][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:08,762][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:13,763][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:18,765][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:23,766][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:28,767][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:33,769][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:38,773][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:43,775][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:48,777][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:53,779][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:24:58,782][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:03,786][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:08,788][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:13,794][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:18,801][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:23,806][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:28,807][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:33,809][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:38,812][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:43,813][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:48,815][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:53,822][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:25:58,824][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:03,826][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:08,828][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:13,830][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:18,831][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:23,833][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:28,834][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:33,835][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:38,836][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:43,837][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:48,838][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:53,840][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:26:58,841][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:03,842][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:08,843][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:13,844][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:18,845][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:23,847][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:28,848][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:33,849][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:38,850][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:43,851][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:48,852][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:53,853][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:27:58,855][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:03,855][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:08,857][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:13,858][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:18,859][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:23,861][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:28,862][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:33,863][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:38,864][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:43,865][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:48,866][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:53,867][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:28:58,868][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:03,869][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:08,870][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:13,871][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:18,872][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:23,873][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:28,875][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:33,880][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:38,881][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:43,882][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:48,883][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:53,884][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:29:58,885][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:03,886][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:08,888][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:13,889][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:18,890][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:23,891][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:28,892][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:33,893][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:38,894][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:43,895][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:48,896][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:53,897][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:30:58,899][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:03,900][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:08,901][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:13,902][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:18,903][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:23,905][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:28,906][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:33,907][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:38,908][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:43,909][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:48,910][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:53,912][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:31:57,140][ ERROR][PID:3318955] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 15:31:58,913][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:32:03,914][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:32:07,141][WARNING][PID:3318955] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 15:32:08,920][  INFO][PID:3318955] Periodic builder liveness probe: dead
[2025-07-10 15:32:17,141][  INFO][PID:3318955] Downloading the builder-live.log file, attempt 2
[2025-07-10 15:32:17,143][  INFO][PID:3318955] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-10 15:33:08,989][ ERROR][PID:3318955] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.35 port 22: Connection timed out

[2025-07-10 15:33:17,211][ ERROR][PID:3318955] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 15:33:27,223][WARNING][PID:3318955] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 15:33:37,224][  INFO][PID:3318955] Downloading the builder-live.log file, attempt 3
[2025-07-10 15:33:37,225][  INFO][PID:3318955] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-10 15:34:19,058][ ERROR][PID:3318955] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.35 port 22: Connection timed out

[2025-07-10 15:34:37,293][ ERROR][PID:3318955] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 15:34:47,297][WARNING][PID:3318955] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-10 15:34:57,298][  INFO][PID:3318955] Downloading the builder-live.log file, attempt 4
[2025-07-10 15:34:57,299][  INFO][PID:3318955] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-10 15:35:29,128][ ERROR][PID:3318955] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.35 port 22: Connection timed out

[2025-07-10 15:35:57,370][ ERROR][PID:3318955] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-10 15:36:07,375][ ERROR][PID:3318955] Giving up for unstable SSH, failures: 1752161527.1411808, 1752161607.223796, 1752161687.2979014, 1752161767.3754222
[2025-07-10 15:36:39,197][ ERROR][PID:3318955] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.35 port 22: Connection timed out

[2025-07-10 15:36:49,199][ ERROR][PID:3318955] Can't ssh to cancel build.
[2025-07-10 15:36:49,200][ ERROR][PID:3318955] Re-try request for task on 'ResallocHost, ticket_id=3880747, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05255951_20250710_143546, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-10 15:36:49,200][  INFO][PID:3318955] Releasing VM back to pool
[2025-07-10 15:36:49,228][  INFO][PID:3318955] Retry #1 (on other host)
[2025-07-10 15:36:49,229][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:36:49,231][  INFO][PID:3318955] VM allocation process starts
[2025-07-10 15:36:49,259][  INFO][PID:3318955] Trying to allocate VM: ResallocHost, ticket_id=3881121, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-10 15:36:54,266][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:36:59,268][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:37:01,349][  INFO][PID:3318955] Allocated host ResallocHost, ticket_id=3881121, hostname=2620:52:3:1:dead:beef:cafe:c289, name=copr_p09_01_prod_05258604_20250710_152143, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-10 15:37:01,349][  INFO][PID:3318955] Allocating ssh connection to builder
[2025-07-10 15:37:01,350][  INFO][PID:3318955] Checking that builder machine is OK
[2025-07-10 15:37:02,074][  INFO][PID:3318955] Running remote command: copr-builder-ready fedora-eln-ppc64le
[2025-07-10 15:37:02,498][  INFO][PID:3318955] Red Hat subscription not needed for fedora-eln-ppc64le
Builder is ready to be used

[2025-07-10 15:37:02,499][  INFO][PID:3318955] Filling build.info file with builder info
[2025-07-10 15:37:02,508][  INFO][PID:3318955] Checking for cancel request
[2025-07-10 15:37:02,509][  INFO][PID:3318955] Not re-notifying FE and msg buses for the new host.
[2025-07-10 15:37:02,510][  INFO][PID:3318955] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9263219-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached
[2025-07-10 15:37:03,193][  INFO][PID:3318955] Downloading the builder-live.log file, attempt 1
[2025-07-10 15:37:03,195][  INFO][PID:3318955] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c289 copr-rpmbuild-log
[2025-07-10 15:37:11,757][  INFO][PID:3318955] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c289' (ED25519) to the list of known hosts.

[2025-07-10 15:37:11,757][  INFO][PID:3318955] Downloading results from builder
[2025-07-10 15:37:11,758][  INFO][PID:3318955] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c289]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd started
[2025-07-10 15:37:11,759][  INFO][PID:3318955] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c289]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/ &> /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/build-09263219.rsync.log
[2025-07-10 15:37:12,217][  INFO][PID:3318955] rsyncing finished.
[2025-07-10 15:37:12,217][  INFO][PID:3318955] Releasing VM back to pool
[2025-07-10 15:37:12,234][  INFO][PID:3318955] Searching for 'success' file in resultdir
[2025-07-10 15:37:12,235][ ERROR][PID:3318955] Build failed: Backend process error: No success file => build failure
[2025-07-10 15:37:12,236][  INFO][PID:3318955] Finished build: id=9263219 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@CoreOS/continuous chroot=fedora-eln-ppc64le 
[2025-07-10 15:37:12,238][ ERROR][PID:3318955] Backend process error: No success file => build failure
[2025-07-10 15:37:12,238][  INFO][PID:3318955] Worker failed build, took 9.728942632675171
[2025-07-10 15:37:12,239][  INFO][PID:3318955] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@CoreOS",
            "project_name": "continuous",
            "project_dirname": "continuous",
            "submitter": "https://api.github.com/users/HuijingHei",
            "ended_on": 1752161832.2385492,
            "started_on": 1752161822.5096066,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-eln-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9263219-fedora-eln-ppc64le",
            "build_id": 9263219,
            "package_name": "bootupd",
            "package_version": "0.2.28.12.gdc7461c-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@CoreOS/continuous/bootupd",
            "git_hash": "fceb1c87cedb205b3b8fd85bae5d871766c11148",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@CoreOS/continuous--https://api.github.com/users/HuijingHei",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous/fedora-eln-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-eln-ppc64le/",
                    "id": "copr_rhcontainerbot_bootc",
                    "name": "Additional repo copr_rhcontainerbot_bootc"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@CoreOS/continuous",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@CoreOS/continuous",
            "result_dir": "09263219-bootupd",
            "built_packages": "",
            "id": 9263219,
            "mockchain_macros": {
                "copr_username": "@CoreOS",
                "copr_projectname": "continuous",
                "vendor": "Fedora Project COPR (@CoreOS/continuous)"
            }
        }
    ]
}
[2025-07-10 15:37:12,299][  INFO][PID:3318955] Sending fedora-messaging bus message in build.end
[2025-07-10 15:37:12,323][  INFO][PID:3318955] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/builder-live.log by gzip
[2025-07-10 15:37:12,324][  INFO][PID:3318955] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/builder-live.log' as PID 3500269
[2025-07-10 15:37:12,326][  INFO][PID:3318955] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/builder-live.log)
[2025-07-10 15:37:12,326][  INFO][PID:3318955] Compressing /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/backend.log by gzip
[2025-07-10 15:37:12,327][  INFO][PID:3318955] Running command 'gzip /var/lib/copr/public_html/results/@CoreOS/continuous/fedora-eln-ppc64le/09263219-bootupd/backend.log' as PID 3500271