[2025-07-22 14:50:47,565][  INFO][PID:1275678] Marking build as starting
[2025-07-22 14:50:47,613][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:50:47,615][  INFO][PID:1275678] VM allocation process starts
[2025-07-22 14:50:47,638][  INFO][PID:1275678] Trying to allocate VM: ResallocHost, ticket_id=4027651, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 14:50:52,640][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:50:57,642][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:02,643][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:07,644][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:12,645][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:17,646][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:22,647][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:27,649][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:32,651][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:37,652][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:42,653][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:47,654][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:52,655][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:51:57,657][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:02,658][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:07,659][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:12,660][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:17,661][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:22,663][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:27,665][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:32,666][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:37,667][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:42,668][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:47,669][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:52,670][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:52:57,671][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:02,673][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:07,674][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:12,675][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:17,676][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:22,678][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:27,679][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:32,680][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:37,681][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:42,682][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:47,684][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:52,685][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:53:57,686][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:02,687][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:07,688][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:12,690][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:17,691][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:22,692][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:27,695][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:32,697][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:37,698][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:42,700][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:47,703][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:52,704][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:54:57,705][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:02,706][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:07,707][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:12,708][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:17,709][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:22,710][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:27,712][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:32,713][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:37,714][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:42,715][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:47,716][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:52,717][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:55:57,718][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:02,720][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:07,721][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:12,722][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:17,723][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:22,724][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:27,726][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:32,727][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:37,728][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:42,729][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:47,730][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:52,731][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:56:57,732][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:02,733][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:05,822][  INFO][PID:1275678] Allocated host ResallocHost, ticket_id=4027651, hostname=140.211.168.243, name=copr_osuosl_p09_prod_05727763_20250722_145329, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 14:57:05,823][  INFO][PID:1275678] Allocating ssh connection to builder
[2025-07-22 14:57:05,824][  INFO][PID:1275678] Checking that builder machine is OK
[2025-07-22 14:57:07,163][  INFO][PID:1275678] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-07-22 14:57:08,212][  INFO][PID:1275678] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-07-22 14:57:08,213][  INFO][PID:1275678] Filling build.info file with builder info
[2025-07-22 14:57:08,214][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:08,215][  INFO][PID:1275678] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "alexsaezm",
            "project_name": "golang-rawhide",
            "project_dirname": "golang-rawhide",
            "submitter": "https://src.fedoraproject.org/user/alexsaezm",
            "ended_on": null,
            "started_on": 1753196228.2152588,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9297736-fedora-41-ppc64le",
            "build_id": 9297736,
            "package_name": "golang",
            "package_version": "1.25~rc2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/alexsaezm/golang-rawhide/golang",
            "git_hash": "77cc41ee93edc77d7324484f1aef49fb8112d54b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "alexsaezm/golang-rawhide--https://src.fedoraproject.org/user/alexsaezm",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/alexsaezm/golang-rawhide",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide",
            "result_dir": "09297736-golang",
            "built_packages": "",
            "id": 9297736,
            "mockchain_macros": {
                "copr_username": "alexsaezm",
                "copr_projectname": "golang-rawhide",
                "vendor": "Fedora Project COPR (alexsaezm/golang-rawhide)"
            }
        }
    ]
}
[2025-07-22 14:57:08,252][  INFO][PID:1275678] Sending fedora-messaging bus message in build.start
[2025-07-22 14:57:09,010][  INFO][PID:1275678] Sending fedora-messaging bus message in chroot.start
[2025-07-22 14:57:09,037][  INFO][PID:1275678] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9297736-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-07-22 14:57:10,372][  INFO][PID:1275678] Downloading the builder-live.log file, attempt 1
[2025-07-22 14:57:10,373][  INFO][PID:1275678] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-22 14:57:15,381][  INFO][PID:1275678] Periodic builder liveness probe: alive
[2025-07-22 14:57:15,381][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:20,382][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:25,384][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:30,385][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:35,386][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:40,388][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:45,392][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:50,394][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:57:55,395][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:00,396][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:05,397][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:10,399][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:15,400][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:20,401][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:25,402][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:30,403][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:35,404][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:40,406][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:45,407][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:50,409][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:58:55,410][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:00,411][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:05,412][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:10,414][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:15,415][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:20,416][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:25,417][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:30,418][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:35,419][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:40,420][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:45,421][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:50,423][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 14:59:55,424][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:00,425][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:05,426][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:10,427][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:15,428][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:20,430][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:25,431][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:30,433][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:35,434][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:40,435][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:45,436][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:50,437][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:55,438][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:00:58,139][ ERROR][PID:1275678] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:01:00,439][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:05,441][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:08,139][WARNING][PID:1275678] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 15:01:10,442][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:15,443][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:18,140][  INFO][PID:1275678] Downloading the builder-live.log file, attempt 2
[2025-07-22 15:01:18,142][  INFO][PID:1275678] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-22 15:01:20,444][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:25,445][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:30,446][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:35,447][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:40,450][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:45,453][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:50,455][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:01:55,456][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:00,457][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:05,458][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:10,459][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:15,461][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:18,283][ ERROR][PID:1275678] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:02:20,462][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:25,466][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:28,287][WARNING][PID:1275678] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 15:02:30,468][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:35,469][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:38,289][  INFO][PID:1275678] Downloading the builder-live.log file, attempt 3
[2025-07-22 15:02:38,290][  INFO][PID:1275678] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-22 15:02:40,470][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:45,471][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:50,473][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:02:55,474][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:00,476][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:05,477][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:10,480][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:15,481][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:20,482][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:25,483][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:30,487][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:35,488][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:38,430][ ERROR][PID:1275678] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:03:40,489][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:45,491][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:48,431][WARNING][PID:1275678] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 15:03:50,492][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:55,494][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:03:58,431][  INFO][PID:1275678] Downloading the builder-live.log file, attempt 4
[2025-07-22 15:03:58,433][  INFO][PID:1275678] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-22 15:04:00,495][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:05,496][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:10,497][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:15,501][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:20,511][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:25,512][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:30,513][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:35,515][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:40,516][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:45,517][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:50,518][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:55,520][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:04:58,573][ ERROR][PID:1275678] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:05:00,522][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:05,526][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:08,578][ ERROR][PID:1275678] Giving up for unstable SSH, failures: 1753196468.1398478, 1753196548.2875888, 1753196628.4309616, 1753196708.5781453
[2025-07-22 15:05:08,580][ ERROR][PID:1275678] Re-try request for task on 'ResallocHost, ticket_id=4027651, hostname=140.211.168.243, name=copr_osuosl_p09_prod_05727763_20250722_145329, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-22 15:05:08,581][  INFO][PID:1275678] Releasing VM back to pool
[2025-07-22 15:05:08,611][  INFO][PID:1275678] Retry #1 (on other host)
[2025-07-22 15:05:08,613][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:08,619][  INFO][PID:1275678] VM allocation process starts
[2025-07-22 15:05:08,643][  INFO][PID:1275678] Trying to allocate VM: ResallocHost, ticket_id=4027846, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 15:05:13,650][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:18,651][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:23,652][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:28,653][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:33,654][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:36,713][  INFO][PID:1275678] Allocated host ResallocHost, ticket_id=4027846, hostname=140.211.168.248, name=copr_osuosl_p09_prod_05727958_20250722_145938, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 15:05:36,714][  INFO][PID:1275678] Allocating ssh connection to builder
[2025-07-22 15:05:36,714][  INFO][PID:1275678] Checking that builder machine is OK
[2025-07-22 15:05:37,689][  INFO][PID:1275678] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-07-22 15:05:38,744][  INFO][PID:1275678] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-07-22 15:05:38,745][  INFO][PID:1275678] Filling build.info file with builder info
[2025-07-22 15:05:38,748][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:38,749][  INFO][PID:1275678] Not re-notifying FE and msg buses for the new host.
[2025-07-22 15:05:38,749][  INFO][PID:1275678] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9297736-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-07-22 15:05:40,006][  INFO][PID:1275678] Downloading the builder-live.log file, attempt 1
[2025-07-22 15:05:40,008][  INFO][PID:1275678] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.248 copr-rpmbuild-log
[2025-07-22 15:05:45,007][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:50,008][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:05:55,009][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:00,011][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:05,014][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:10,017][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:15,019][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:20,021][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:25,027][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:30,029][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:35,032][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:40,034][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:45,039][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:50,046][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:06:55,047][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:00,050][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:05,052][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:10,066][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:15,079][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:20,112][  INFO][PID:1275678] Periodic builder liveness probe: alive
[2025-07-22 15:07:20,116][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:25,118][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:30,124][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:35,128][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:40,132][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:45,141][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:50,144][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:07:55,148][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:00,156][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:05,159][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:10,161][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:15,171][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:20,175][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:25,178][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:30,185][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:35,193][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:40,199][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:45,203][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:50,206][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:08:55,214][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:09:00,216][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:09:05,220][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:09:10,229][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:09:15,231][  INFO][PID:1275678] Checking for cancel request
[2025-07-22 15:09:17,993][  INFO][PID:1275678] Downloading results from builder
[2025-07-22 15:09:17,994][  INFO][PID:1275678] rsyncing of mockbuilder@140.211.168.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang started
[2025-07-22 15:09:17,997][  INFO][PID:1275678] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/ &> /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/build-09297736.rsync.log
[2025-07-22 15:09:20,068][  INFO][PID:1275678] rsyncing finished.
[2025-07-22 15:09:20,069][  INFO][PID:1275678] Releasing VM back to pool
[2025-07-22 15:09:20,112][  INFO][PID:1275678] Searching for 'success' file in resultdir
[2025-07-22 15:09:20,120][ ERROR][PID:1275678] Build failed: Backend process error: No success file => build failure
[2025-07-22 15:09:20,123][  INFO][PID:1275678] Finished build: id=9297736 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/alexsaezm/golang-rawhide chroot=fedora-41-ppc64le 
[2025-07-22 15:09:20,141][ ERROR][PID:1275678] Backend process error: No success file => build failure
[2025-07-22 15:09:20,142][  INFO][PID:1275678] Worker failed build, took 221.3938193321228
[2025-07-22 15:09:20,145][  INFO][PID:1275678] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "alexsaezm",
            "project_name": "golang-rawhide",
            "project_dirname": "golang-rawhide",
            "submitter": "https://src.fedoraproject.org/user/alexsaezm",
            "ended_on": 1753196960.1428714,
            "started_on": 1753196738.749052,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9297736-fedora-41-ppc64le",
            "build_id": 9297736,
            "package_name": "golang",
            "package_version": "1.25~rc2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/alexsaezm/golang-rawhide/golang",
            "git_hash": "77cc41ee93edc77d7324484f1aef49fb8112d54b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "alexsaezm/golang-rawhide--https://src.fedoraproject.org/user/alexsaezm",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/alexsaezm/golang-rawhide",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide",
            "result_dir": "09297736-golang",
            "built_packages": "",
            "id": 9297736,
            "mockchain_macros": {
                "copr_username": "alexsaezm",
                "copr_projectname": "golang-rawhide",
                "vendor": "Fedora Project COPR (alexsaezm/golang-rawhide)"
            }
        }
    ]
}
[2025-07-22 15:09:20,227][  INFO][PID:1275678] Sending fedora-messaging bus message in build.end
[2025-07-22 15:09:20,312][  INFO][PID:1275678] Compressing /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/builder-live.log by gzip
[2025-07-22 15:09:20,317][  INFO][PID:1275678] Running command 'gzip /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/builder-live.log' as PID 1410738
[2025-07-22 15:09:20,326][  INFO][PID:1275678] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/builder-live.log)
[2025-07-22 15:09:20,330][  INFO][PID:1275678] Compressing /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/backend.log by gzip
[2025-07-22 15:09:20,334][  INFO][PID:1275678] Running command 'gzip /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-41-ppc64le/09297736-golang/backend.log' as PID 1410741