[2026-01-17 19:18:53,992][  INFO][PID:556684] Marking build as starting
[2026-01-17 19:18:54,191][  INFO][PID:556684] Checking that /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/repodata/repomd.xml exists
[2026-01-17 19:18:54,235][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:18:54,237][  INFO][PID:556684] VM allocation process starts
[2026-01-17 19:18:54,266][  INFO][PID:556684] Trying to allocate VM: ResallocHost, ticket_id=893937, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2026-01-17 19:18:57,316][  INFO][PID:556684] Allocated host ResallocHost, ticket_id=893937, hostname=2620:52:6:1161:dead:beef:cafe:c156, name=vmhost_p09_03_prod_01342068_20260117_191127, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2026-01-17 19:18:57,317][  INFO][PID:556684] Allocating ssh connection to builder
[2026-01-17 19:18:57,317][  INFO][PID:556684] Checking that builder machine is OK
[2026-01-17 19:18:58,298][  INFO][PID:556684] Running remote command: copr-builder-ready epel-10-ppc64le
[2026-01-17 19:18:58,847][  INFO][PID:556684] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-01-17 19:18:58,850][  INFO][PID:556684] Filling build.info file with builder info
[2026-01-17 19:18:58,852][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:18:58,854][  INFO][PID:556684] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "johnsauter",
            "project_name": "sound_effects_player",
            "project_dirname": "sound_effects_player",
            "submitter": "johnsauter",
            "ended_on": null,
            "started_on": 1768677538.8543167,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10031497-epel-10-ppc64le",
            "build_id": 10031497,
            "package_name": "sound_effects_player",
            "package_version": "0.132-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/johnsauter/sound_effects_player/sound_effects_player",
            "git_hash": "82415cee3edacb471b3924c14cdbd7c377b129a8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "johnsauter/sound_effects_player--johnsauter",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/johnsauter/sound_effects_player/epel-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/johnsauter/libtime/epel-10-ppc64le/",
                    "id": "copr_johnsauter_libtime",
                    "name": "Additional repo copr_johnsauter_libtime"
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/johnsauter/sound_effects_player",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/johnsauter/sound_effects_player",
            "result_dir": "10031497-sound_effects_player",
            "built_packages": "",
            "id": 10031497,
            "mockchain_macros": {
                "copr_username": "johnsauter",
                "copr_projectname": "sound_effects_player",
                "vendor": "Fedora Project COPR (johnsauter/sound_effects_player)"
            }
        }
    ]
}
[2026-01-17 19:18:59,097][  INFO][PID:556684] Sending fedora-messaging bus message in build.start
[2026-01-17 19:18:59,909][  INFO][PID:556684] Sending fedora-messaging bus message in chroot.start
[2026-01-17 19:18:59,957][  INFO][PID:556684] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10031497-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2026-01-17 19:19:00,900][  INFO][PID:556684] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c156' (ED25519) to the list of known hosts.


[2026-01-17 19:19:00,901][  INFO][PID:556684] Downloading the builder-live.log file, attempt 1
[2026-01-17 19:19:00,903][  INFO][PID:556684] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c156 copr-rpmbuild-log
[2026-01-17 19:19:05,923][  INFO][PID:556684] Periodic builder liveness probe: alive
[2026-01-17 19:19:05,924][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:10,925][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:15,934][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:20,938][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:25,940][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:30,942][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:35,943][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:40,944][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:45,946][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:50,948][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:19:55,951][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:00,953][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:05,955][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:10,960][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:15,961][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:20,963][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:25,971][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:30,972][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:35,981][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:40,984][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:45,993][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:50,999][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:20:56,001][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:01,006][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:06,009][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:11,011][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:16,013][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:21,016][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:26,018][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:31,021][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:36,024][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:41,029][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:44,372][ ERROR][PID:556684] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-17 19:21:46,031][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:51,034][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:21:54,375][WARNING][PID:556684] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-17 19:21:56,038][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:01,047][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:04,377][  INFO][PID:556684] Downloading the builder-live.log file, attempt 2
[2026-01-17 19:22:04,381][  INFO][PID:556684] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c156 copr-rpmbuild-log
[2026-01-17 19:22:06,049][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:11,050][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:16,053][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:21,055][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:26,056][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:31,060][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:36,061][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:41,062][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:46,064][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:51,065][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:22:56,066][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:01,067][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:04,463][ ERROR][PID:556684] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-17 19:23:06,068][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:11,071][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:14,479][WARNING][PID:556684] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-17 19:23:16,072][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:21,074][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:24,481][  INFO][PID:556684] Downloading the builder-live.log file, attempt 3
[2026-01-17 19:23:24,482][  INFO][PID:556684] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c156 copr-rpmbuild-log
[2026-01-17 19:23:26,082][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:31,085][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:36,087][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:41,087][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:46,088][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:51,089][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:23:56,091][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:01,092][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:06,092][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:11,093][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:16,097][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:21,098][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:24,551][ ERROR][PID:556684] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-17 19:24:26,099][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:31,100][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:34,555][WARNING][PID:556684] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-17 19:24:36,101][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:41,102][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:44,556][  INFO][PID:556684] Downloading the builder-live.log file, attempt 4
[2026-01-17 19:24:44,558][  INFO][PID:556684] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c156 copr-rpmbuild-log
[2026-01-17 19:24:46,104][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:51,104][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:24:56,105][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:01,106][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:06,107][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:11,108][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:16,109][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:21,110][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:26,111][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:31,112][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:36,113][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:41,114][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:44,625][ ERROR][PID:556684] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-17 19:25:46,116][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:51,117][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:54,647][ ERROR][PID:556684] Giving up for unstable SSH, failures: 1768677714.375335, 1768677794.4797735, 1768677874.5557778, 1768677954.6475904
[2026-01-17 19:25:54,648][ ERROR][PID:556684] Re-try request for task on 'ResallocHost, ticket_id=893937, hostname=2620:52:6:1161:dead:beef:cafe:c156, name=vmhost_p09_03_prod_01342068_20260117_191127, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-01-17 19:25:54,649][  INFO][PID:556684] Releasing VM back to pool
[2026-01-17 19:25:54,657][  INFO][PID:556684] Retry #1 (on other host)
[2026-01-17 19:25:54,657][  INFO][PID:556684] Checking that /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/repodata/repomd.xml exists
[2026-01-17 19:25:54,658][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:54,659][  INFO][PID:556684] VM allocation process starts
[2026-01-17 19:25:54,704][  INFO][PID:556684] Trying to allocate VM: ResallocHost, ticket_id=894063, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2026-01-17 19:25:57,759][  INFO][PID:556684] Allocated host ResallocHost, ticket_id=894063, hostname=2620:52:6:1161:dead:beef:cafe:c111, name=vmhost_p09_02_prod_01342220_20260117_191838, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2026-01-17 19:25:57,760][  INFO][PID:556684] Allocating ssh connection to builder
[2026-01-17 19:25:57,760][  INFO][PID:556684] Checking that builder machine is OK
[2026-01-17 19:25:58,682][  INFO][PID:556684] Running remote command: copr-builder-ready epel-10-ppc64le
[2026-01-17 19:25:59,164][  INFO][PID:556684] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-01-17 19:25:59,164][  INFO][PID:556684] Filling build.info file with builder info
[2026-01-17 19:25:59,168][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:25:59,169][  INFO][PID:556684] Not re-notifying FE and msg buses for the new host.
[2026-01-17 19:25:59,169][  INFO][PID:556684] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10031497-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2026-01-17 19:26:00,086][  INFO][PID:556684] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c111' (ED25519) to the list of known hosts.


[2026-01-17 19:26:00,087][  INFO][PID:556684] Downloading the builder-live.log file, attempt 1
[2026-01-17 19:26:00,088][  INFO][PID:556684] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c111 copr-rpmbuild-log
[2026-01-17 19:26:05,087][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:10,088][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:15,089][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:20,090][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:25,091][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:30,092][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:35,093][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:40,094][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:45,095][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:50,096][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:26:55,097][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:00,098][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:05,099][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:10,100][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:15,101][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:20,102][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:25,103][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:30,104][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:35,105][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:40,106][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:45,107][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:50,108][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:27:55,109][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:00,110][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:05,111][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:10,112][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:15,113][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:20,114][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:25,115][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:30,116][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:35,117][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:40,118][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:45,119][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:50,120][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:28:55,122][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:00,123][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:05,124][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:10,132][  INFO][PID:556684] Periodic builder liveness probe: alive
[2026-01-17 19:29:10,133][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:15,134][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:20,135][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:25,135][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:30,137][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:35,139][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:40,140][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:45,141][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:50,142][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:29:55,145][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:00,146][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:05,147][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:10,148][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:15,156][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:20,158][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:25,159][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:30,160][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:35,167][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:40,171][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:45,174][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:50,176][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:30:55,177][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:00,178][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:05,181][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:10,183][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:15,185][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:20,189][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:25,191][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:30,198][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:35,202][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:31:36,998][  INFO][PID:556684] Downloading results from builder
[2026-01-17 19:31:36,999][  INFO][PID:556684] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c111]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player started
[2026-01-17 19:31:37,008][  INFO][PID:556684] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c111]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/ &> /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/build-10031497.rsync.log
[2026-01-17 19:32:37,132][  INFO][PID:556684] rsyncing finished.
[2026-01-17 19:32:37,135][ ERROR][PID:556684] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-17 19:32:37,135][ ERROR][PID:556684] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-17 19:32:47,140][  INFO][PID:556684] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c111]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player started
[2026-01-17 19:32:47,145][  INFO][PID:556684] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c111]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/ &> /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/build-10031497.rsync.log
[2026-01-17 19:33:47,243][  INFO][PID:556684] rsyncing finished.
[2026-01-17 19:33:47,243][ ERROR][PID:556684] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-17 19:33:47,244][ ERROR][PID:556684] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-17 19:33:57,244][  INFO][PID:556684] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c111]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player started
[2026-01-17 19:33:57,246][  INFO][PID:556684] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c111]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/ &> /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/build-10031497.rsync.log
[2026-01-17 19:34:57,342][  INFO][PID:556684] rsyncing finished.
[2026-01-17 19:34:57,356][ ERROR][PID:556684] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-17 19:34:57,357][ ERROR][PID:556684] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-17 19:35:07,358][ ERROR][PID:556684] Re-try request for task on 'ResallocHost, ticket_id=894063, hostname=2620:52:6:1161:dead:beef:cafe:c111, name=vmhost_p09_02_prod_01342220_20260117_191838, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 3 SSH attempts
[2026-01-17 19:35:07,366][  INFO][PID:556684] Releasing VM back to pool
[2026-01-17 19:35:07,384][  INFO][PID:556684] Retry #2 (on other host)
[2026-01-17 19:35:07,386][  INFO][PID:556684] Checking that /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/repodata/repomd.xml exists
[2026-01-17 19:35:07,387][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:07,390][  INFO][PID:556684] VM allocation process starts
[2026-01-17 19:35:07,409][  INFO][PID:556684] Trying to allocate VM: ResallocHost, ticket_id=894273, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2026-01-17 19:35:12,414][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:17,415][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:22,416][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:27,417][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:32,418][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:37,420][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:42,421][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:47,422][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:52,426][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:35:57,427][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:02,429][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:07,429][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:12,430][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:17,431][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:22,432][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:27,433][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:32,435][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:37,437][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:42,439][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:47,440][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:52,441][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:36:57,443][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:02,444][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:07,445][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:12,446][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:17,447][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:22,448][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:27,449][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:32,450][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:37,451][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:42,452][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:47,453][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:52,454][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:37:57,456][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:02,457][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:07,460][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:12,462][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:17,463][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:22,464][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:27,465][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:32,466][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:37,467][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:42,468][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:47,469][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:52,470][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:38:57,471][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:02,472][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:07,473][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:12,474][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:17,476][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:22,477][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:25,516][  INFO][PID:556684] Allocated host ResallocHost, ticket_id=894273, hostname=140.211.168.112, name=copr_osuosl_p09_prod_01342479_20260117_193337, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2026-01-17 19:39:25,516][  INFO][PID:556684] Allocating ssh connection to builder
[2026-01-17 19:39:25,517][  INFO][PID:556684] Checking that builder machine is OK
[2026-01-17 19:39:27,159][  INFO][PID:556684] Running remote command: copr-builder-ready epel-10-ppc64le
[2026-01-17 19:39:28,194][  INFO][PID:556684] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-01-17 19:39:28,194][  INFO][PID:556684] Filling build.info file with builder info
[2026-01-17 19:39:28,228][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:28,229][  INFO][PID:556684] Not re-notifying FE and msg buses for the new host.
[2026-01-17 19:39:28,230][  INFO][PID:556684] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10031497-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2026-01-17 19:39:29,967][  INFO][PID:556684] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.112' (ED25519) to the list of known hosts.


[2026-01-17 19:39:29,968][  INFO][PID:556684] Downloading the builder-live.log file, attempt 1
[2026-01-17 19:39:29,977][  INFO][PID:556684] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.112 copr-rpmbuild-log
[2026-01-17 19:39:34,973][  INFO][PID:556684] Periodic builder liveness probe: alive
[2026-01-17 19:39:34,973][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:39,974][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:44,975][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:49,978][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:54,979][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:39:59,980][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:05,000][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:10,001][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:15,002][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:20,004][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:25,011][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:30,013][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:35,014][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:40,015][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:45,018][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:50,020][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:40:55,021][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:41:00,022][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:41:05,023][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:41:10,024][  INFO][PID:556684] Checking for cancel request
[2026-01-17 19:41:14,157][  INFO][PID:556684] Downloading results from builder
[2026-01-17 19:41:14,158][  INFO][PID:556684] rsyncing of mockbuilder@140.211.168.112:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player started
[2026-01-17 19:41:14,166][  INFO][PID:556684] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.112:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/ &> /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/build-10031497.rsync.log
[2026-01-17 19:41:18,356][  INFO][PID:556684] rsyncing finished.
[2026-01-17 19:41:18,357][  INFO][PID:556684] Releasing VM back to pool
[2026-01-17 19:41:18,423][  INFO][PID:556684] Searching for 'success' file in resultdir
[2026-01-17 19:41:18,424][ ERROR][PID:556684] Build failed: Backend process error: No success file => build failure
[2026-01-17 19:41:18,424][  INFO][PID:556684] Finished build: id=10031497 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/johnsauter/sound_effects_player chroot=epel-10-ppc64le 
[2026-01-17 19:41:18,427][ ERROR][PID:556684] Backend process error: No success file => build failure
[2026-01-17 19:41:18,428][  INFO][PID:556684] Worker failed build, took 110.19863152503967
[2026-01-17 19:41:18,428][  INFO][PID:556684] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "johnsauter",
            "project_name": "sound_effects_player",
            "project_dirname": "sound_effects_player",
            "submitter": "johnsauter",
            "ended_on": 1768678878.428393,
            "started_on": 1768678768.2297614,
            "submitted_on": null,
            "status": 0,
            "chroot": "epel-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10031497-epel-10-ppc64le",
            "build_id": 10031497,
            "package_name": "sound_effects_player",
            "package_version": "0.132-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/johnsauter/sound_effects_player/sound_effects_player",
            "git_hash": "82415cee3edacb471b3924c14cdbd7c377b129a8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "johnsauter/sound_effects_player--johnsauter",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/johnsauter/sound_effects_player/epel-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/johnsauter/libtime/epel-10-ppc64le/",
                    "id": "copr_johnsauter_libtime",
                    "name": "Additional repo copr_johnsauter_libtime"
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/johnsauter/sound_effects_player",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/johnsauter/sound_effects_player",
            "result_dir": "10031497-sound_effects_player",
            "built_packages": "",
            "id": 10031497,
            "mockchain_macros": {
                "copr_username": "johnsauter",
                "copr_projectname": "sound_effects_player",
                "vendor": "Fedora Project COPR (johnsauter/sound_effects_player)"
            }
        }
    ]
}
[2026-01-17 19:41:18,837][  INFO][PID:556684] Sending fedora-messaging bus message in build.end
[2026-01-17 19:41:18,874][  INFO][PID:556684] Compressing /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/builder-live.log by gzip
[2026-01-17 19:41:18,876][  INFO][PID:556684] Running command 'gzip /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/builder-live.log' as PID 708878
[2026-01-17 19:41:18,898][  INFO][PID:556684] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/builder-live.log)
[2026-01-17 19:41:18,900][  INFO][PID:556684] Compressing /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/backend.log by gzip
[2026-01-17 19:41:18,904][  INFO][PID:556684] Running command 'gzip /var/lib/copr/public_html/results/johnsauter/sound_effects_player/epel-10-ppc64le/10031497-sound_effects_player/backend.log' as PID 708880