[2025-07-23 15:31:35,657][  INFO][PID:3977345] Marking build as starting
[2025-07-23 15:31:35,896][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:31:35,899][  INFO][PID:3977345] VM allocation process starts
[2025-07-23 15:31:35,957][  INFO][PID:3977345] Trying to allocate VM: ResallocHost, ticket_id=4069268, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 15:31:40,963][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:31:42,066][  INFO][PID:3977345] Allocated host ResallocHost, ticket_id=4069268, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05762487_20250723_152505, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 15:31:42,067][  INFO][PID:3977345] Allocating ssh connection to builder
[2025-07-23 15:31:42,073][  INFO][PID:3977345] Checking that builder machine is OK
[2025-07-23 15:31:43,761][  INFO][PID:3977345] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-07-23 15:31:44,832][  INFO][PID:3977345] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-07-23 15:31:44,833][  INFO][PID:3977345] Filling build.info file with builder info
[2025-07-23 15:31:44,834][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:31:44,835][  INFO][PID:3977345] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1753284704.8353622,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9313430-centos-stream-9-ppc64le",
            "build_id": 9313430,
            "package_name": "osbuild-composer",
            "package_version": "146-1.20250723153042729596.main.5.gb488a2d82",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "07be0105a6eb4168d8f3aac04ac31e72b07c91ea",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "09313430-osbuild-composer",
            "built_packages": "",
            "id": 9313430,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2025-07-23 15:31:44,896][  INFO][PID:3977345] Sending fedora-messaging bus message in build.start
[2025-07-23 15:31:46,361][  INFO][PID:3977345] Sending fedora-messaging bus message in chroot.start
[2025-07-23 15:31:46,401][  INFO][PID:3977345] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313430-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-07-23 15:31:47,812][  INFO][PID:3977345] Downloading the builder-live.log file, attempt 1
[2025-07-23 15:31:47,818][  INFO][PID:3977345] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-23 15:31:52,862][  INFO][PID:3977345] Periodic builder liveness probe: alive
[2025-07-23 15:31:52,887][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:31:57,891][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:02,894][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:07,898][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:12,907][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:18,912][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:24,729][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:30,004][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:36,277][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:41,278][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:46,284][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:51,307][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:32:56,322][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:01,323][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:06,328][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:11,333][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:16,345][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:21,681][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:27,570][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:32,691][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:38,048][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:43,320][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:48,571][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:53,837][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:33:58,972][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:03,978][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:08,981][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:13,983][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:18,992][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:23,995][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:28,997][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:34,001][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:39,004][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:44,006][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:49,014][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:54,026][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:34:59,046][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:04,087][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:09,100][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:14,308][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:19,433][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:24,588][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:29,605][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:34,633][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:39,643][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:44,652][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:49,681][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:54,688][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:35:59,697][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:04,713][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:09,718][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:14,724][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:19,728][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:24,737][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:29,742][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:34,743][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:39,751][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:44,753][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:49,760][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:54,768][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:36:59,780][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:04,783][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:09,791][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:14,805][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:19,810][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:24,832][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:29,838][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:34,848][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:39,856][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:44,861][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:49,867][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:54,872][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:37:59,882][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:04,883][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:09,885][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:14,889][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:20,222][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:25,252][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:30,258][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:35,262][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:40,274][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:45,282][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:50,283][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:38:55,285][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:00,288][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:05,297][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:10,303][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:15,306][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:20,307][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:25,311][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:30,312][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:35,314][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:40,328][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:45,330][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:50,335][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:39:55,337][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:00,338][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:05,340][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:10,346][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:15,352][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:20,357][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:25,361][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:30,363][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:35,372][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:40,383][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:45,388][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:50,391][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:40:55,401][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:00,404][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:05,405][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:10,409][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:15,412][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:20,415][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:25,440][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:30,445][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:35,456][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:40,468][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:45,475][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:50,480][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:41:55,542][  INFO][PID:3977345] Periodic builder liveness probe: alive
[2025-07-23 15:41:55,692][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:00,703][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:05,785][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:10,792][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:15,809][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:20,816][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:25,825][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:30,833][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:35,953][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:40,961][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:45,994][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:51,009][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:42:56,030][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:01,039][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:06,050][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:11,060][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:16,064][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:21,072][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:26,075][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:31,088][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:36,094][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:41,106][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:46,109][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:51,118][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:43:56,122][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:01,125][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:06,136][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:11,142][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:16,152][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:21,158][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:26,167][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:31,170][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:36,178][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:41,180][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:46,182][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:51,195][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:44:56,196][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:01,201][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:06,202][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:11,204][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:16,206][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:21,218][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:26,219][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:31,225][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:36,232][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:41,242][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:46,245][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:51,249][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:45:56,256][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:01,271][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:06,278][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:11,285][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:16,294][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:21,299][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:26,303][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:31,308][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:36,329][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:41,332][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:46,338][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:51,343][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:46:56,348][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:01,350][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:06,370][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:11,379][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:16,386][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:21,392][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:26,402][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:31,409][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:36,412][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:41,415][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:46,427][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:51,438][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:47:56,450][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:01,454][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:06,459][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:11,463][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:16,800][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:21,802][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:26,807][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:32,775][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:37,779][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:42,785][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:47,824][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:52,913][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:48:58,348][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:04,022][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:09,773][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:14,781][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:19,785][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:24,787][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:29,788][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:35,045][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:40,215][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:45,542][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:50,545][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:49:55,549][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:00,551][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:05,553][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:10,592][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:15,609][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:20,624][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:25,633][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:30,639][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:37,320][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:43,342][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:49,177][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:50:55,337][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:01,560][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:06,954][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:13,122][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:19,299][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:24,307][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:29,747][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:34,880][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:39,896][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:44,963][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:49,972][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:51:54,978][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:00,007][  INFO][PID:3977345] Periodic builder liveness probe: alive
[2025-07-23 15:52:00,009][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:05,014][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:10,019][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:15,026][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:20,041][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:25,051][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:30,119][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:35,158][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:40,243][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:45,278][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:50,297][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:52:55,299][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:00,302][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:05,307][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:10,309][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:15,315][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:20,847][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:25,853][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:30,862][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:35,879][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:40,885][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:45,894][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:50,901][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:53:55,904][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:00,908][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:05,909][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:10,911][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:15,912][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:20,917][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:25,929][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:30,937][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:35,941][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:40,947][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:45,956][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:50,960][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:54:55,963][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:00,970][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:05,976][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:10,982][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:15,986][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:20,987][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:26,000][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:31,005][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:36,011][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:41,021][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:46,022][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:51,031][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:55:56,034][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:01,040][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:06,045][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:11,052][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:16,068][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:21,081][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:26,097][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:31,108][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:36,122][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:41,131][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:46,141][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:51,150][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:56:56,166][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:01,171][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:06,182][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:11,186][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:16,189][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:21,195][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:26,204][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:31,207][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:36,215][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:41,226][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:46,237][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:51,242][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:57:56,249][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:01,255][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:06,264][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:11,268][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:16,290][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:21,292][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:26,294][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:31,302][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:36,303][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:41,305][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:46,307][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:51,319][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:58:56,325][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:01,329][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:06,335][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:11,343][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:16,348][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:21,349][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:26,350][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:31,352][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:36,357][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:41,358][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:46,360][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:51,363][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 15:59:56,371][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:01,372][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:06,373][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:11,375][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:16,376][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:21,378][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:26,379][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:31,380][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:36,386][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:41,391][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:46,395][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:51,397][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:00:56,402][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:01,403][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:06,405][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:11,408][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:16,419][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:21,420][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:26,427][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:31,431][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:36,434][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:41,439][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:46,446][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:51,455][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:01:56,457][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:02:01,475][  INFO][PID:3977345] Periodic builder liveness probe: dead
[2025-07-23 16:02:31,145][ ERROR][PID:3977345] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 16:02:41,146][WARNING][PID:3977345] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 16:02:51,152][  INFO][PID:3977345] Downloading the builder-live.log file, attempt 2
[2025-07-23 16:02:51,158][  INFO][PID:3977345] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-23 16:03:01,613][ ERROR][PID:3977345] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.240 port 22: Connection timed out

[2025-07-23 16:03:51,246][ ERROR][PID:3977345] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 16:04:01,251][WARNING][PID:3977345] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 16:04:11,255][  INFO][PID:3977345] Downloading the builder-live.log file, attempt 3
[2025-07-23 16:04:11,263][  INFO][PID:3977345] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-23 16:04:11,750][ ERROR][PID:3977345] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.240 port 22: Connection timed out

[2025-07-23 16:05:11,345][ ERROR][PID:3977345] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 16:05:21,347][WARNING][PID:3977345] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 16:05:21,822][ ERROR][PID:3977345] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.240 port 22: Connection timed out

[2025-07-23 16:05:31,349][  INFO][PID:3977345] Downloading the builder-live.log file, attempt 4
[2025-07-23 16:05:31,354][  INFO][PID:3977345] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log
[2025-07-23 16:06:31,435][ ERROR][PID:3977345] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 16:06:31,904][ ERROR][PID:3977345] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.240 port 22: Connection timed out

[2025-07-23 16:06:41,442][ ERROR][PID:3977345] Giving up for unstable SSH, failures: 1753286561.1463473, 1753286641.251471, 1753286721.3472195, 1753286801.4417481
[2025-07-23 16:06:41,905][ ERROR][PID:3977345] Can't ssh to cancel build.
[2025-07-23 16:06:41,907][ ERROR][PID:3977345] Re-try request for task on 'ResallocHost, ticket_id=4069268, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05762487_20250723_152505, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-23 16:06:41,910][  INFO][PID:3977345] Releasing VM back to pool
[2025-07-23 16:06:41,968][  INFO][PID:3977345] Retry #1 (on other host)
[2025-07-23 16:06:41,989][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:06:41,993][  INFO][PID:3977345] VM allocation process starts
[2025-07-23 16:06:42,024][  INFO][PID:3977345] Trying to allocate VM: ResallocHost, ticket_id=4070429, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 16:06:47,029][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:06:52,032][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:06:54,116][  INFO][PID:3977345] Allocated host ResallocHost, ticket_id=4070429, hostname=140.211.168.107, name=copr_osuosl_p09_prod_05762679_20250723_153329, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 16:06:54,121][  INFO][PID:3977345] Allocating ssh connection to builder
[2025-07-23 16:06:54,122][  INFO][PID:3977345] Checking that builder machine is OK
[2025-07-23 16:06:55,749][  INFO][PID:3977345] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-07-23 16:06:56,917][  INFO][PID:3977345] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-07-23 16:06:56,918][  INFO][PID:3977345] Filling build.info file with builder info
[2025-07-23 16:06:56,923][  INFO][PID:3977345] Checking for cancel request
[2025-07-23 16:06:56,933][  INFO][PID:3977345] Not re-notifying FE and msg buses for the new host.
[2025-07-23 16:06:56,938][  INFO][PID:3977345] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313430-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-07-23 16:06:58,442][  INFO][PID:3977345] Downloading the builder-live.log file, attempt 1
[2025-07-23 16:06:58,457][  INFO][PID:3977345] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log
[2025-07-23 16:07:07,682][  INFO][PID:3977345] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.107' (ED25519) to the list of known hosts.

[2025-07-23 16:07:07,684][  INFO][PID:3977345] Downloading results from builder
[2025-07-23 16:07:07,685][  INFO][PID:3977345] rsyncing of mockbuilder@140.211.168.107:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer started
[2025-07-23 16:07:07,690][  INFO][PID:3977345] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.107:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/build-09313430.rsync.log
[2025-07-23 16:07:09,360][  INFO][PID:3977345] rsyncing finished.
[2025-07-23 16:07:09,361][  INFO][PID:3977345] Releasing VM back to pool
[2025-07-23 16:07:09,397][  INFO][PID:3977345] Searching for 'success' file in resultdir
[2025-07-23 16:07:09,399][ ERROR][PID:3977345] Build failed: Backend process error: No success file => build failure
[2025-07-23 16:07:09,401][  INFO][PID:3977345] Finished build: id=9313430 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/osbuild-composer chroot=centos-stream-9-ppc64le 
[2025-07-23 16:07:09,405][ ERROR][PID:3977345] Backend process error: No success file => build failure
[2025-07-23 16:07:09,407][  INFO][PID:3977345] Worker failed build, took 12.47395133972168
[2025-07-23 16:07:09,409][  INFO][PID:3977345] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@osbuild",
            "project_name": "osbuild-composer",
            "project_dirname": "osbuild-composer",
            "submitter": "packit",
            "ended_on": 1753286829.4077027,
            "started_on": 1753286816.9337513,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9313430-centos-stream-9-ppc64le",
            "build_id": 9313430,
            "package_name": "osbuild-composer",
            "package_version": "146-1.20250723153042729596.main.5.gb488a2d82",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer",
            "git_hash": "07be0105a6eb4168d8f3aac04ac31e72b07c91ea",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@osbuild/osbuild-composer--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer",
            "result_dir": "09313430-osbuild-composer",
            "built_packages": "",
            "id": 9313430,
            "mockchain_macros": {
                "copr_username": "@osbuild",
                "copr_projectname": "osbuild-composer",
                "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)"
            }
        }
    ]
}
[2025-07-23 16:07:09,469][  INFO][PID:3977345] Sending fedora-messaging bus message in build.end
[2025-07-23 16:07:09,516][  INFO][PID:3977345] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/builder-live.log by gzip
[2025-07-23 16:07:09,519][  INFO][PID:3977345] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/builder-live.log' as PID 141652
[2025-07-23 16:07:09,522][  INFO][PID:3977345] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/builder-live.log)
[2025-07-23 16:07:09,524][  INFO][PID:3977345] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/backend.log by gzip
[2025-07-23 16:07:09,526][  INFO][PID:3977345] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/09313430-osbuild-composer/backend.log' as PID 141655