[2026-01-13 11:33:57,482][  INFO][PID:2131954] Marking build as starting
[2026-01-13 11:33:57,589][  INFO][PID:2131954] Checking that /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-01-13 11:33:57,590][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:33:57,591][  INFO][PID:2131954] VM allocation process starts
[2026-01-13 11:33:57,623][  INFO][PID:2131954] Trying to allocate VM: ResallocHost, ticket_id=791419, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:34:02,627][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:07,629][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:12,731][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:17,732][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:22,743][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:27,754][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:32,774][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:37,868][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:42,871][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:47,985][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:53,007][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:34:58,015][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:03,017][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:08,052][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:13,065][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:18,072][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:23,080][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:28,082][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:33,084][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:38,164][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:43,176][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:48,178][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:53,220][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:35:58,221][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:03,223][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:08,224][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:13,261][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:18,266][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:23,270][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:28,272][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:33,302][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:38,304][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:43,306][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:48,307][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:53,309][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:36:58,351][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:03,352][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:08,362][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:13,364][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:18,380][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:23,387][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:28,389][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:33,391][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:38,416][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:43,523][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:48,562][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:53,564][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:37:58,844][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:03,941][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:08,951][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:13,953][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:15,826][  INFO][PID:2131954] Allocated host ResallocHost, ticket_id=791419, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01176725_20260113_113237, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:38:15,827][  INFO][PID:2131954] Allocating ssh connection to builder
[2026-01-13 11:38:15,828][  INFO][PID:2131954] Checking that builder machine is OK
[2026-01-13 11:38:16,725][  INFO][PID:2131954] Running remote command: copr-builder-ready fedora-42-ppc64le
[2026-01-13 11:38:17,242][  INFO][PID:2131954] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2026-01-13 11:38:17,246][  INFO][PID:2131954] Filling build.info file with builder info
[2026-01-13 11:38:17,389][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:17,393][  INFO][PID:2131954] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@mock",
            "project_name": "mock-stable",
            "project_dirname": "mock-stable",
            "submitter": "https://api.github.com/users/nikromen",
            "ended_on": null,
            "started_on": 1768304297.392938,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10003620-fedora-42-ppc64le",
            "build_id": 10003620,
            "package_name": "mock-core-configs",
            "package_version": "43.4-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@mock/mock-stable/mock-core-configs",
            "git_hash": "d7f3096de1e6b2e10ad1807b065e88cedfb61269",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@mock/mock-stable--https://api.github.com/users/nikromen",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@mock/mock-stable/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "bootstrap": "on",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@mock/mock-stable",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@mock/mock-stable",
            "result_dir": "10003620-mock-core-configs",
            "built_packages": "",
            "id": 10003620,
            "mockchain_macros": {
                "copr_username": "@mock",
                "copr_projectname": "mock-stable",
                "vendor": "Fedora Project COPR (@mock/mock-stable)"
            }
        }
    ]
}
[2026-01-13 11:38:17,532][  INFO][PID:2131954] Sending fedora-messaging bus message in build.start
[2026-01-13 11:38:18,325][  INFO][PID:2131954] Sending fedora-messaging bus message in chroot.start
[2026-01-13 11:38:18,378][  INFO][PID:2131954] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10003620-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2026-01-13 11:38:19,345][  INFO][PID:2131954] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18f' (ED25519) to the list of known hosts.


[2026-01-13 11:38:19,353][  INFO][PID:2131954] Downloading the builder-live.log file, attempt 1
[2026-01-13 11:38:19,366][  INFO][PID:2131954] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18f copr-rpmbuild-log
[2026-01-13 11:38:24,390][  INFO][PID:2131954] Periodic builder liveness probe: alive
[2026-01-13 11:38:24,392][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:29,393][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:34,410][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:39,422][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:44,445][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:49,505][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:54,508][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:38:59,601][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:04,751][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:10,649][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:15,815][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:20,981][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:26,360][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:31,631][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:36,845][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:42,131][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:47,468][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:53,068][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:39:58,369][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:04,640][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:10,087][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:15,552][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:21,191][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:26,195][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:31,196][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:36,199][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:41,210][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:46,241][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:52,170][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:40:58,325][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:03,464][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:08,716][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:14,052][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:19,204][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:24,223][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:29,299][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:34,317][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:39,329][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:44,338][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:49,350][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:54,364][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:41:59,374][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:04,394][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:09,399][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:14,406][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:19,411][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:24,416][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:29,421][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:34,429][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:39,430][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:44,438][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:49,441][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:54,524][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:42:59,539][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:04,566][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:09,664][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:14,665][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:19,671][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:24,674][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:29,676][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:34,678][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:39,679][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:44,681][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:49,683][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:54,687][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:43:56,267][  INFO][PID:2131954] Downloading results from builder
[2026-01-13 11:43:56,268][  INFO][PID:2131954] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs started
[2026-01-13 11:43:56,269][  INFO][PID:2131954] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/ &> /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/build-10003620.rsync.log
[2026-01-13 11:44:56,361][  INFO][PID:2131954] rsyncing finished.
[2026-01-13 11:44:56,380][ ERROR][PID:2131954] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-13 11:44:56,381][ ERROR][PID:2131954] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-13 11:45:06,381][  INFO][PID:2131954] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs started
[2026-01-13 11:45:06,382][  INFO][PID:2131954] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/ &> /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/build-10003620.rsync.log
[2026-01-13 11:46:06,462][  INFO][PID:2131954] rsyncing finished.
[2026-01-13 11:46:06,484][ ERROR][PID:2131954] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-13 11:46:06,485][ ERROR][PID:2131954] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-13 11:46:16,486][  INFO][PID:2131954] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs started
[2026-01-13 11:46:16,487][  INFO][PID:2131954] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/ &> /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/build-10003620.rsync.log
[2026-01-13 11:47:16,633][  INFO][PID:2131954] rsyncing finished.
[2026-01-13 11:47:16,637][ ERROR][PID:2131954] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-13 11:47:16,639][ ERROR][PID:2131954] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-13 11:47:26,640][ ERROR][PID:2131954] Re-try request for task on 'ResallocHost, ticket_id=791419, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01176725_20260113_113237, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts
[2026-01-13 11:47:26,641][  INFO][PID:2131954] Releasing VM back to pool
[2026-01-13 11:47:26,684][  INFO][PID:2131954] Retry #1 (on other host)
[2026-01-13 11:47:26,685][  INFO][PID:2131954] Checking that /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-01-13 11:47:26,686][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:47:26,687][  INFO][PID:2131954] VM allocation process starts
[2026-01-13 11:47:26,725][  INFO][PID:2131954] Trying to allocate VM: ResallocHost, ticket_id=791757, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:47:31,729][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:47:32,807][  INFO][PID:2131954] Allocated host ResallocHost, ticket_id=791757, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01176725_20260113_113237, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:47:32,808][  INFO][PID:2131954] Allocating ssh connection to builder
[2026-01-13 11:47:32,809][  INFO][PID:2131954] Checking that builder machine is OK
[2026-01-13 11:48:32,896][ ERROR][PID:2131954] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18f port 22: Connection timed out

[2026-01-13 11:48:42,928][ ERROR][PID:2131954] Re-try request for task on 'ResallocHost, ticket_id=791757, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01176725_20260113_113237, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-13 11:48:42,934][  INFO][PID:2131954] Releasing VM back to pool
[2026-01-13 11:48:43,002][  INFO][PID:2131954] Retry #2 (on other host)
[2026-01-13 11:48:43,003][  INFO][PID:2131954] Checking that /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-01-13 11:48:43,003][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:48:43,004][  INFO][PID:2131954] VM allocation process starts
[2026-01-13 11:48:43,037][  INFO][PID:2131954] Trying to allocate VM: ResallocHost, ticket_id=791775, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:48:48,053][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:48:53,055][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:48:58,064][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:49:01,224][  INFO][PID:2131954] Allocated host ResallocHost, ticket_id=791775, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01176725_20260113_113237, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:49:01,228][  INFO][PID:2131954] Allocating ssh connection to builder
[2026-01-13 11:49:01,228][  INFO][PID:2131954] Checking that builder machine is OK
[2026-01-13 11:50:01,343][ ERROR][PID:2131954] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18f port 22: Connection timed out

[2026-01-13 11:50:11,381][ ERROR][PID:2131954] Re-try request for task on 'ResallocHost, ticket_id=791775, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_01176725_20260113_113237, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-13 11:50:11,382][  INFO][PID:2131954] Releasing VM back to pool
[2026-01-13 11:50:11,416][  INFO][PID:2131954] Retry #3 (on other host)
[2026-01-13 11:50:11,421][  INFO][PID:2131954] Checking that /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-01-13 11:50:11,423][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:11,424][  INFO][PID:2131954] VM allocation process starts
[2026-01-13 11:50:11,473][  INFO][PID:2131954] Trying to allocate VM: ResallocHost, ticket_id=791779, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:50:16,476][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:21,480][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:26,491][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:31,492][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:36,493][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:41,495][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:46,498][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:51,499][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:50:56,500][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:01,502][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:06,551][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:11,554][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:16,555][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:19,642][  INFO][PID:2131954] Allocated host ResallocHost, ticket_id=791779, hostname=2620:52:6:1161:dead:beef:cafe:c152, name=vmhost_p09_03_prod_01176619_20260113_112731, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 11:51:19,643][  INFO][PID:2131954] Allocating ssh connection to builder
[2026-01-13 11:51:19,643][  INFO][PID:2131954] Checking that builder machine is OK
[2026-01-13 11:51:20,143][  INFO][PID:2131954] Running remote command: copr-builder-ready fedora-42-ppc64le
[2026-01-13 11:51:20,698][  INFO][PID:2131954] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2026-01-13 11:51:20,699][  INFO][PID:2131954] Filling build.info file with builder info
[2026-01-13 11:51:20,703][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:20,704][  INFO][PID:2131954] Not re-notifying FE and msg buses for the new host.
[2026-01-13 11:51:20,705][  INFO][PID:2131954] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10003620-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2026-01-13 11:51:21,488][  INFO][PID:2131954] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c152' (ED25519) to the list of known hosts.


[2026-01-13 11:51:21,490][  INFO][PID:2131954] Downloading the builder-live.log file, attempt 1
[2026-01-13 11:51:21,521][  INFO][PID:2131954] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c152 copr-rpmbuild-log
[2026-01-13 11:51:26,498][  INFO][PID:2131954] Periodic builder liveness probe: alive
[2026-01-13 11:51:26,498][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:31,499][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:36,503][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:41,567][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:46,672][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:51,716][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:51:56,743][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:01,776][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:06,789][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:11,790][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:16,795][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:21,796][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:26,893][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:31,898][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:36,903][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:41,957][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:46,958][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:51,959][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:52:56,960][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:01,961][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:06,962][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:11,963][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:16,964][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:21,965][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:26,966][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:31,967][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:36,969][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:42,018][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:47,020][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:52,021][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:53:57,022][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:02,024][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:07,132][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:12,134][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:17,161][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:22,162][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:27,163][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:32,163][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:37,164][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:42,165][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:47,590][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:52,592][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:54:57,593][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:02,594][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:07,595][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:12,596][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:17,598][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:22,599][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:27,600][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:32,602][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:37,603][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:42,605][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:47,606][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:52,608][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:55:57,609][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:02,610][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:07,611][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:12,612][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:17,613][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:22,614][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:27,616][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:32,617][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:37,876][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:42,879][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:47,881][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:52,885][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:56:57,887][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:02,888][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:07,890][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:12,891][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:17,894][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:22,896][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:27,897][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:32,898][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:37,903][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:42,903][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:47,904][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:52,908][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:57:57,910][  INFO][PID:2131954] Checking for cancel request
[2026-01-13 11:58:01,804][  INFO][PID:2131954] Downloading results from builder
[2026-01-13 11:58:01,805][  INFO][PID:2131954] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c152]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs started
[2026-01-13 11:58:01,806][  INFO][PID:2131954] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c152]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/ &> /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/build-10003620.rsync.log
[2026-01-13 11:58:02,737][  INFO][PID:2131954] rsyncing finished.
[2026-01-13 11:58:02,737][  INFO][PID:2131954] Releasing VM back to pool
[2026-01-13 11:58:02,748][  INFO][PID:2131954] Searching for 'success' file in resultdir
[2026-01-13 11:58:02,748][  INFO][PID:2131954] Going to sign pkgs from source: 10003620-fedora-42-ppc64le in chroot: /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le
[2026-01-13 11:58:02,749][  INFO][PID:2131954] Calling '/bin/sign -u @mock#mock-stable@copr.fedorahosted.org -p' (attempt #1)
[2026-01-13 11:58:03,022][  INFO][PID:2131954] Calling '/bin/sign -4 -h sha256 -u @mock#mock-stable@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/mock-core-configs-43.4-1.fc42.src.rpm' (attempt #1)
[2026-01-13 11:58:03,647][  INFO][PID:2131954] signed rpm: /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/mock-core-configs-43.4-1.fc42.src.rpm
[2026-01-13 11:58:03,647][  INFO][PID:2131954] Calling '/bin/sign -4 -h sha256 -u @mock#mock-stable@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/mock-core-configs-43.4-1.fc42.noarch.rpm' (attempt #1)
[2026-01-13 11:58:04,308][  INFO][PID:2131954] signed rpm: /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/mock-core-configs-43.4-1.fc42.noarch.rpm
[2026-01-13 11:58:04,309][  INFO][PID:2131954] Sign done
[2026-01-13 11:58:04,309][  INFO][PID:2131954] Incremental createrepo run, adding 10003620-mock-core-configs into https://download.copr.fedorainfracloud.org/results/@mock/mock-stable/fedora-42-ppc64le, (auto-create-repo=True)
[2026-01-13 11:58:04,310][  INFO][PID:2131954] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le --add 10003620-mock-core-configs --no-appstream-metadata' as PID 2339810
[2026-01-13 11:58:05,587][  INFO][PID:2131954] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le --add 10003620-mock-core-configs --no-appstream-metadata)
[2026-01-13 11:58:05,588][  INFO][PID:2131954] Getting build details
[2026-01-13 11:58:05,588][  INFO][PID:2131954] Listing built binary packages in /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs
[2026-01-13 11:58:05,589][  INFO][PID:2131954] Built packages:
['mock-core-configs 43.4']
[2026-01-13 11:58:05,589][  INFO][PID:2131954] build details: {'built_packages': 'mock-core-configs 43.4'}
[2026-01-13 11:58:05,589][  INFO][PID:2131954] Retrieving pubkey
[2026-01-13 11:58:05,590][  INFO][PID:2131954] Calling '/bin/sign -u @mock#mock-stable@copr.fedorahosted.org -p' (attempt #1)
[2026-01-13 11:58:05,876][  INFO][PID:2131954] Added pubkey for user @mock project mock-stable into: /var/lib/copr/public_html/results/@mock/mock-stable/pubkey.gpg
[2026-01-13 11:58:05,876][  INFO][PID:2131954] Finished build: id=10003620 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@mock/mock-stable chroot=fedora-42-ppc64le 
[2026-01-13 11:58:05,878][  INFO][PID:2131954] Worker succeeded build, took 405.17359375953674
[2026-01-13 11:58:05,878][  INFO][PID:2131954] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@mock",
            "project_name": "mock-stable",
            "project_dirname": "mock-stable",
            "submitter": "https://api.github.com/users/nikromen",
            "ended_on": 1768305485.8781526,
            "started_on": 1768305080.7045588,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10003620-fedora-42-ppc64le",
            "build_id": 10003620,
            "package_name": "mock-core-configs",
            "package_version": "43.4-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@mock/mock-stable/mock-core-configs",
            "git_hash": "d7f3096de1e6b2e10ad1807b065e88cedfb61269",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@mock/mock-stable--https://api.github.com/users/nikromen",
            "results": {
                "packages": [
                    {
                        "name": "mock-core-configs",
                        "epoch": null,
                        "version": "43.4",
                        "release": "1.fc42",
                        "arch": "src"
                    },
                    {
                        "name": "mock-core-configs",
                        "epoch": null,
                        "version": "43.4",
                        "release": "1.fc42",
                        "arch": "noarch"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@mock/mock-stable/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "bootstrap": "on",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@mock/mock-stable",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@mock/mock-stable",
            "result_dir": "10003620-mock-core-configs",
            "built_packages": "mock-core-configs 43.4",
            "id": 10003620,
            "mockchain_macros": {
                "copr_username": "@mock",
                "copr_projectname": "mock-stable",
                "vendor": "Fedora Project COPR (@mock/mock-stable)"
            }
        }
    ]
}
[2026-01-13 11:58:05,938][  INFO][PID:2131954] Sending fedora-messaging bus message in build.end
[2026-01-13 11:58:05,966][  INFO][PID:2131954] Compressing /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/builder-live.log by gzip
[2026-01-13 11:58:05,967][  INFO][PID:2131954] Running command 'gzip /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/builder-live.log' as PID 2339881
[2026-01-13 11:58:06,020][  INFO][PID:2131954] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/builder-live.log)
[2026-01-13 11:58:06,021][  INFO][PID:2131954] Compressing /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/backend.log by gzip
[2026-01-13 11:58:06,022][  INFO][PID:2131954] Running command 'gzip /var/lib/copr/public_html/results/@mock/mock-stable/fedora-42-ppc64le/10003620-mock-core-configs/backend.log' as PID 2339882