[2025-09-09 16:11:00,179][  INFO][PID:3930610] Marking build as starting
[2025-09-09 16:11:00,234][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:00,239][  INFO][PID:3930610] VM allocation process starts
[2025-09-09 16:11:00,273][  INFO][PID:3930610] Trying to allocate VM: ResallocHost, ticket_id=4985079, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-09 16:11:05,279][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:06,325][  INFO][PID:3930610] Allocated host ResallocHost, ticket_id=4985079, hostname=140.211.168.80, name=copr_osuosl_p09_prod_06683988_20250909_160637, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-09 16:11:06,326][  INFO][PID:3930610] Allocating ssh connection to builder
[2025-09-09 16:11:06,327][  INFO][PID:3930610] Checking that builder machine is OK
[2025-09-09 16:11:07,736][  INFO][PID:3930610] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-09 16:11:08,738][  INFO][PID:3930610] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-09 16:11:08,738][  INFO][PID:3930610] Filling build.info file with builder info
[2025-09-09 16:11:08,739][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:08,740][  INFO][PID:3930610] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "solopasha",
            "project_name": "hyprland",
            "project_dirname": "hyprland",
            "submitter": "solopasha",
            "ended_on": null,
            "started_on": 1757434268.7405136,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9540411-fedora-rawhide-ppc64le",
            "build_id": 9540411,
            "package_name": "swww",
            "package_version": "0.11.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/solopasha/hyprland/swww",
            "git_hash": "050abb95779b056722ffc6021d824236dfbb8451",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "solopasha/hyprland--solopasha",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/solopasha/hyprland/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/solopasha/hyprland",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/solopasha/hyprland",
            "result_dir": "09540411-swww",
            "built_packages": "",
            "id": 9540411,
            "mockchain_macros": {
                "copr_username": "solopasha",
                "copr_projectname": "hyprland",
                "vendor": "Fedora Project COPR (solopasha/hyprland)"
            }
        }
    ]
}
[2025-09-09 16:11:08,774][  INFO][PID:3930610] Sending fedora-messaging bus message in build.start
[2025-09-09 16:11:09,516][  INFO][PID:3930610] Sending fedora-messaging bus message in chroot.start
[2025-09-09 16:11:09,542][  INFO][PID:3930610] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9540411-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-09 16:11:10,808][  INFO][PID:3930610] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.80' (ED25519) to the list of known hosts.


[2025-09-09 16:11:10,809][  INFO][PID:3930610] Downloading the builder-live.log file, attempt 1
[2025-09-09 16:11:10,811][  INFO][PID:3930610] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-09-09 16:11:15,819][  INFO][PID:3930610] Periodic builder liveness probe: alive
[2025-09-09 16:11:15,820][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:20,825][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:25,827][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:30,828][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:35,830][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:40,835][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:45,836][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:50,840][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:11:55,847][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:00,848][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:05,849][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:10,850][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:15,852][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:20,853][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:25,854][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:30,855][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:35,856][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:40,857][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:45,858][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:50,860][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:12:55,863][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:00,864][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:05,865][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:10,866][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:15,867][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:20,869][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:25,871][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:30,872][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:35,873][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:40,874][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:45,875][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:50,876][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:13:55,877][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:00,878][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:06,121][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:11,124][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:16,146][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:21,195][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:26,218][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:31,233][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:36,286][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:41,289][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:46,293][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:51,295][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:14:56,297][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:01,300][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:06,303][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:11,304][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:16,305][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:21,306][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:26,307][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:31,308][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:36,310][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:41,311][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:46,312][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:51,313][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:15:56,316][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:01,317][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:06,318][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:11,319][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:16,320][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:21,321][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:26,322][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:31,324][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:36,325][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:41,326][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:46,327][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:51,328][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:16:56,329][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:01,330][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:06,331][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:11,332][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:16,333][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:21,334][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:26,335][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:31,336][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:36,337][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:41,339][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:46,340][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:17:51,341][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:01,742][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:06,743][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:11,744][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:16,745][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:21,746][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:26,748][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:31,749][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:36,750][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:18:41,751][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:06,926][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:11,927][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:16,928][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:21,930][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:26,931][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:31,932][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:36,933][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:41,934][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:46,935][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:51,936][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:19:56,937][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:01,938][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:06,939][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:11,940][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:16,941][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:21,942][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:26,943][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:31,945][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:36,946][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:41,947][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:52,766][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:20:57,768][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:02,770][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:07,772][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:12,773][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:17,778][  INFO][PID:3930610] Periodic builder liveness probe: alive
[2025-09-09 16:21:17,779][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:22,780][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:27,781][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:32,782][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:37,783][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:42,784][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:47,784][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:52,786][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:21:57,787][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:02,788][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:07,789][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:12,790][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:17,791][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:22,792][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:27,793][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:32,794][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:37,795][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:42,796][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:47,797][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:52,798][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:22:57,799][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:02,800][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:07,844][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:12,895][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:17,974][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:22,990][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:28,019][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:33,117][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:38,145][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:43,226][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:48,272][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:53,356][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:23:58,429][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:03,462][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:08,635][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:21,577][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:26,580][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:31,581][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:36,582][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:41,584][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:46,586][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:51,587][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:24:56,588][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:01,593][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:06,595][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:11,598][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:16,599][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:21,600][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:26,601][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:31,602][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:36,604][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:41,605][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:46,606][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:51,608][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:25:56,609][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:01,610][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:06,611][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:11,612][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:16,615][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:21,617][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:26,621][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:31,624][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:36,625][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:41,626][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:46,627][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:51,628][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:26:56,629][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:01,630][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:09,334][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:14,336][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:19,337][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:29,951][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:34,952][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:39,954][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:44,955][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:49,957][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:54,958][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:27:59,959][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:04,961][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:09,962][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:14,964][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:19,965][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:24,966][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:29,967][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:34,968][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:39,969][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:44,970][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:49,971][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:54,974][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:28:59,976][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:04,977][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:09,979][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:14,984][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:19,996][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:25,002][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:30,008][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:35,017][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:40,018][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:45,021][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:50,022][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:29:55,024][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:00,028][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:05,030][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:10,031][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:15,033][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:20,034][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:25,035][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:30,036][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:35,037][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:40,038][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:45,040][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:50,041][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:30:55,043][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:31:00,045][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:31:05,046][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:31:10,047][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:31:15,049][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:31:20,057][  INFO][PID:3930610] Periodic builder liveness probe: dead
[2025-09-09 16:31:20,057][  INFO][PID:3930610] calling cancel callback, and waiting
[2025-09-09 16:32:20,130][ ERROR][PID:3930610] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.80 port 22: Connection timed out

[2025-09-09 16:32:39,139][ ERROR][PID:3930610] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-09 16:32:49,140][WARNING][PID:3930610] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-09 16:32:59,142][  INFO][PID:3930610] Downloading the builder-live.log file, attempt 2
[2025-09-09 16:32:59,153][  INFO][PID:3930610] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-09-09 16:33:30,201][ ERROR][PID:3930610] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.80 port 22: Connection timed out

[2025-09-09 16:33:59,226][ ERROR][PID:3930610] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-09 16:34:09,228][WARNING][PID:3930610] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-09 16:34:19,229][  INFO][PID:3930610] Downloading the builder-live.log file, attempt 3
[2025-09-09 16:34:19,230][  INFO][PID:3930610] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-09-09 16:34:40,273][ ERROR][PID:3930610] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.80 port 22: Connection timed out

[2025-09-09 16:35:19,299][ ERROR][PID:3930610] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-09 16:35:29,300][WARNING][PID:3930610] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-09 16:35:39,301][  INFO][PID:3930610] Downloading the builder-live.log file, attempt 4
[2025-09-09 16:35:39,302][  INFO][PID:3930610] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-09-09 16:35:50,343][ ERROR][PID:3930610] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.80 port 22: Connection timed out

[2025-09-09 16:36:00,345][ ERROR][PID:3930610] Can't ssh to cancel build.
[2025-09-09 16:36:39,371][ ERROR][PID:3930610] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-09 16:36:49,376][ ERROR][PID:3930610] Giving up for unstable SSH, failures: 1757435569.1399286, 1757435649.2284193, 1757435729.3005302, 1757435809.3764915
[2025-09-09 16:36:49,377][ ERROR][PID:3930610] Re-try request for task on 'ResallocHost, ticket_id=4985079, hostname=140.211.168.80, name=copr_osuosl_p09_prod_06683988_20250909_160637, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-09 16:36:49,378][  INFO][PID:3930610] Releasing VM back to pool
[2025-09-09 16:36:49,393][  INFO][PID:3930610] Retry #1 (on other host)
[2025-09-09 16:36:49,394][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:36:49,395][  INFO][PID:3930610] VM allocation process starts
[2025-09-09 16:36:49,410][  INFO][PID:3930610] Trying to allocate VM: ResallocHost, ticket_id=4985386, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-09 16:36:54,411][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:36:55,436][  INFO][PID:3930610] Allocated host ResallocHost, ticket_id=4985386, hostname=2620:52:3:1:dead:beef:cafe:c291, name=copr_p09_01_prod_06684273_20250909_162803, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-09 16:36:55,436][  INFO][PID:3930610] Allocating ssh connection to builder
[2025-09-09 16:36:55,437][  INFO][PID:3930610] Checking that builder machine is OK
[2025-09-09 16:36:56,211][  INFO][PID:3930610] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-09 16:36:56,625][  INFO][PID:3930610] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-09 16:36:56,626][  INFO][PID:3930610] Filling build.info file with builder info
[2025-09-09 16:36:56,628][  INFO][PID:3930610] Checking for cancel request
[2025-09-09 16:36:56,629][  INFO][PID:3930610] Not re-notifying FE and msg buses for the new host.
[2025-09-09 16:36:56,629][  INFO][PID:3930610] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9540411-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-09 16:36:57,323][  INFO][PID:3930610] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c291' (ED25519) to the list of known hosts.


[2025-09-09 16:36:57,324][  INFO][PID:3930610] Downloading the builder-live.log file, attempt 1
[2025-09-09 16:36:57,325][  INFO][PID:3930610] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c291 copr-rpmbuild-log
[2025-09-09 16:37:02,324][  INFO][PID:3930610] calling cancel callback, and waiting
[2025-09-09 16:37:05,887][  INFO][PID:3930610] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c291' (ED25519) to the list of known hosts.

[2025-09-09 16:37:05,888][  INFO][PID:3930610] Downloading results from builder
[2025-09-09 16:37:05,889][  INFO][PID:3930610] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c291]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww started
[2025-09-09 16:37:05,890][  INFO][PID:3930610] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c291]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/ &> /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/build-09540411.rsync.log
[2025-09-09 16:37:06,369][  INFO][PID:3930610] rsyncing finished.
[2025-09-09 16:37:06,370][  INFO][PID:3930610] Releasing VM back to pool
[2025-09-09 16:37:06,385][  INFO][PID:3930610] Searching for 'success' file in resultdir
[2025-09-09 16:37:06,386][ ERROR][PID:3930610] Build failed: Backend process error: No success file => build failure
[2025-09-09 16:37:06,386][  INFO][PID:3930610] Finished build: id=9540411 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/solopasha/hyprland chroot=fedora-rawhide-ppc64le 
[2025-09-09 16:37:06,388][ ERROR][PID:3930610] Backend process error: No success file => build failure
[2025-09-09 16:37:06,389][  INFO][PID:3930610] Worker failed build, took 9.759954690933228
[2025-09-09 16:37:06,390][  INFO][PID:3930610] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "solopasha",
            "project_name": "hyprland",
            "project_dirname": "hyprland",
            "submitter": "solopasha",
            "ended_on": 1757435826.3893604,
            "started_on": 1757435816.6294057,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9540411-fedora-rawhide-ppc64le",
            "build_id": 9540411,
            "package_name": "swww",
            "package_version": "0.11.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/solopasha/hyprland/swww",
            "git_hash": "050abb95779b056722ffc6021d824236dfbb8451",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "solopasha/hyprland--solopasha",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/solopasha/hyprland/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/solopasha/hyprland",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/solopasha/hyprland",
            "result_dir": "09540411-swww",
            "built_packages": "",
            "id": 9540411,
            "mockchain_macros": {
                "copr_username": "solopasha",
                "copr_projectname": "hyprland",
                "vendor": "Fedora Project COPR (solopasha/hyprland)"
            }
        }
    ]
}
[2025-09-09 16:37:06,455][  INFO][PID:3930610] Sending fedora-messaging bus message in build.end
[2025-09-09 16:37:06,479][  INFO][PID:3930610] Compressing /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/builder-live.log by gzip
[2025-09-09 16:37:06,481][  INFO][PID:3930610] Running command 'gzip /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/builder-live.log' as PID 4098221
[2025-09-09 16:37:06,482][  INFO][PID:3930610] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/builder-live.log)
[2025-09-09 16:37:06,483][  INFO][PID:3930610] Compressing /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/backend.log by gzip
[2025-09-09 16:37:06,484][  INFO][PID:3930610] Running command 'gzip /var/lib/copr/public_html/results/solopasha/hyprland/fedora-rawhide-ppc64le/09540411-swww/backend.log' as PID 4098222