[2026-01-03 11:55:03,305][  INFO][PID:2056235] Marking build as starting
[2026-01-03 11:55:03,484][  INFO][PID:2056235] Checking that /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-01-03 11:55:03,496][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:03,497][  INFO][PID:2056235] VM allocation process starts
[2026-01-03 11:55:03,509][  INFO][PID:2056235] Trying to allocate VM: ResallocHost, ticket_id=639437, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-03 11:55:06,522][  INFO][PID:2056235] Allocated host ResallocHost, ticket_id=639437, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00903187_20260103_113713, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-03 11:55:06,523][  INFO][PID:2056235] Allocating ssh connection to builder
[2026-01-03 11:55:06,523][  INFO][PID:2056235] Checking that builder machine is OK
[2026-01-03 11:55:07,491][  INFO][PID:2056235] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-01-03 11:55:07,999][  INFO][PID:2056235] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-01-03 11:55:07,999][  INFO][PID:2056235] Filling build.info file with builder info
[2026-01-03 11:55:08,000][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:08,001][  INFO][PID:2056235] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "topazus",
            "project_name": "test",
            "project_dirname": "test",
            "submitter": "topazus",
            "ended_on": null,
            "started_on": 1767441308.0010087,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9971783-fedora-rawhide-ppc64le",
            "build_id": 9971783,
            "package_name": "et",
            "package_version": "6.2.11-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test/et",
            "git_hash": "14449eef1c7d3dd01dfb94c3fd078d07fdcb82a1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "topazus/test--topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-rawhide-ppc64le/",
                    "id": "copr_topazus_test",
                    "name": "Additional repo copr_topazus_test"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/topazus/test",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test",
            "result_dir": "09971783-et",
            "built_packages": "",
            "id": 9971783,
            "mockchain_macros": {
                "copr_username": "topazus",
                "copr_projectname": "test",
                "vendor": "Fedora Project COPR (topazus/test)"
            }
        }
    ]
}
[2026-01-03 11:55:08,095][  INFO][PID:2056235] Sending fedora-messaging bus message in build.start
[2026-01-03 11:55:08,633][  INFO][PID:2056235] Sending fedora-messaging bus message in chroot.start
[2026-01-03 11:55:08,662][  INFO][PID:2056235] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9971783-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-01-03 11:55:09,583][  INFO][PID:2056235] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c188' (ED25519) to the list of known hosts.


[2026-01-03 11:55:09,583][  INFO][PID:2056235] Downloading the builder-live.log file, attempt 1
[2026-01-03 11:55:09,585][  INFO][PID:2056235] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log
[2026-01-03 11:55:14,589][  INFO][PID:2056235] Periodic builder liveness probe: alive
[2026-01-03 11:55:14,590][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:19,590][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:24,591][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:29,592][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:34,594][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:39,595][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:44,596][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:49,597][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:54,598][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:55:59,599][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:04,600][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:09,613][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:09,652][ ERROR][PID:2056235] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-03 11:56:14,614][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:19,615][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:19,653][WARNING][PID:2056235] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-03 11:56:24,616][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:29,629][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:29,654][  INFO][PID:2056235] Downloading the builder-live.log file, attempt 2
[2026-01-03 11:56:29,655][  INFO][PID:2056235] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log
[2026-01-03 11:56:34,630][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:39,631][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:44,632][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:49,633][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:54,634][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:56:59,635][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:04,636][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:09,637][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:14,638][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:19,677][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:24,678][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:29,679][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:29,722][ ERROR][PID:2056235] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-03 11:57:34,680][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:39,681][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:39,738][WARNING][PID:2056235] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-03 11:57:44,682][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:49,683][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:49,739][  INFO][PID:2056235] Downloading the builder-live.log file, attempt 3
[2026-01-03 11:57:49,740][  INFO][PID:2056235] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log
[2026-01-03 11:57:54,684][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:57:59,685][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:04,686][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:09,686][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:14,687][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:19,688][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:24,689][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:29,774][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:34,775][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:39,776][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:44,777][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:49,778][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:49,806][ ERROR][PID:2056235] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-03 11:58:54,779][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:59,780][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:58:59,816][WARNING][PID:2056235] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-03 11:59:04,781][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:09,781][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:09,817][  INFO][PID:2056235] Downloading the builder-live.log file, attempt 4
[2026-01-03 11:59:09,818][  INFO][PID:2056235] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c188 copr-rpmbuild-log
[2026-01-03 11:59:14,782][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:19,783][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:24,784][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:29,785][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:34,786][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:39,794][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:44,795][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:49,796][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:54,797][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 11:59:59,798][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:04,799][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:09,800][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:09,885][ ERROR][PID:2056235] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-03 12:00:14,801][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:19,802][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:19,904][ ERROR][PID:2056235] Giving up for unstable SSH, failures: 1767441379.6532435, 1767441459.738298, 1767441539.8169427, 1767441619.904819
[2026-01-03 12:00:19,905][ ERROR][PID:2056235] Re-try request for task on 'ResallocHost, ticket_id=639437, hostname=2620:52:6:1161:dead:beef:cafe:c188, name=vmhost_p09_04_prod_00903187_20260103_113713, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-01-03 12:00:19,906][  INFO][PID:2056235] Releasing VM back to pool
[2026-01-03 12:00:19,914][  INFO][PID:2056235] Retry #1 (on other host)
[2026-01-03 12:00:19,915][  INFO][PID:2056235] Checking that /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-01-03 12:00:19,915][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:19,915][  INFO][PID:2056235] VM allocation process starts
[2026-01-03 12:00:19,957][  INFO][PID:2056235] Trying to allocate VM: ResallocHost, ticket_id=639462, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-03 12:00:22,997][  INFO][PID:2056235] Allocated host ResallocHost, ticket_id=639462, hostname=2620:52:6:1161:dead:beef:cafe:c14b, name=vmhost_p09_03_prod_00903274_20260103_114251, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-03 12:00:22,998][  INFO][PID:2056235] Allocating ssh connection to builder
[2026-01-03 12:00:22,998][  INFO][PID:2056235] Checking that builder machine is OK
[2026-01-03 12:00:23,978][  INFO][PID:2056235] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-01-03 12:00:24,486][  INFO][PID:2056235] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-01-03 12:00:24,486][  INFO][PID:2056235] Filling build.info file with builder info
[2026-01-03 12:00:24,495][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:24,496][  INFO][PID:2056235] Not re-notifying FE and msg buses for the new host.
[2026-01-03 12:00:24,497][  INFO][PID:2056235] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9971783-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-01-03 12:00:25,418][  INFO][PID:2056235] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14b' (ED25519) to the list of known hosts.


[2026-01-03 12:00:25,419][  INFO][PID:2056235] Downloading the builder-live.log file, attempt 1
[2026-01-03 12:00:25,420][  INFO][PID:2056235] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log
[2026-01-03 12:00:30,419][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:35,421][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:40,422][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:45,423][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:50,424][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:00:55,425][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:00,426][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:05,427][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:10,428][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:15,429][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:20,430][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:25,431][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:30,432][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:35,433][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:40,435][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:45,435][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:50,452][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:01:55,453][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:00,454][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:05,479][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:10,480][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:15,481][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:20,481][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:25,482][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:30,501][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:35,517][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:40,518][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:45,519][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:50,520][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:02:55,521][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:00,522][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:05,523][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:10,558][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:15,559][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:20,560][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:25,560][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:30,561][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:35,562][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:40,563][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:45,564][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:50,565][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:03:55,567][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:00,569][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:05,570][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:10,571][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:15,572][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:20,591][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:25,591][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:30,592][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:35,593][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:40,594][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:45,595][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:50,608][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:04:55,649][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:00,650][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:05,651][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:10,652][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:15,663][  INFO][PID:2056235] Periodic builder liveness probe: alive
[2026-01-03 12:05:15,663][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:20,664][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:25,665][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:30,667][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:35,668][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:40,668][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:45,669][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:50,671][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:05:55,671][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:00,673][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:05,683][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:10,958][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:15,959][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:20,975][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:25,977][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:30,982][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:35,984][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:40,985][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:45,987][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:50,988][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:06:55,992][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:01,093][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:06,152][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:11,160][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:16,166][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:21,171][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:26,179][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:31,221][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:36,308][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:41,464][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:46,479][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:51,482][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:07:56,487][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:01,490][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:06,492][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:11,494][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:16,497][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:21,504][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:26,514][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:31,517][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:36,526][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:41,533][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:46,546][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:51,548][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:08:56,554][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:01,559][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:06,566][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:11,585][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:16,588][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:21,593][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:26,601][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:31,604][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:36,606][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:41,608][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:46,609][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:51,612][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:09:56,614][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:01,659][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:06,661][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:11,663][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:16,664][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:21,665][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:26,666][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:31,731][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:37,454][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:42,456][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:47,457][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:52,458][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:10:57,459][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:02,460][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:07,502][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:12,504][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:17,733][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:22,736][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:27,737][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:32,738][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:37,739][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:42,740][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:47,750][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:52,792][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:11:57,795][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:02,797][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:07,798][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:12,798][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:17,799][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:23,040][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:28,085][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:33,309][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:38,425][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:43,427][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:48,428][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:53,429][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:12:58,431][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:13:03,432][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:13:08,433][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:13:13,450][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:13:18,653][  INFO][PID:2056235] Checking for cancel request
[2026-01-03 12:13:19,532][  INFO][PID:2056235] Downloading results from builder
[2026-01-03 12:13:19,532][  INFO][PID:2056235] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et started
[2026-01-03 12:13:19,533][  INFO][PID:2056235] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/ &> /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/build-09971783.rsync.log
[2026-01-03 12:13:20,758][  INFO][PID:2056235] rsyncing finished.
[2026-01-03 12:13:20,759][  INFO][PID:2056235] Releasing VM back to pool
[2026-01-03 12:13:20,770][  INFO][PID:2056235] Searching for 'success' file in resultdir
[2026-01-03 12:13:20,770][ ERROR][PID:2056235] Build failed: Backend process error: No success file => build failure
[2026-01-03 12:13:20,771][  INFO][PID:2056235] Finished build: id=9971783 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/topazus/test chroot=fedora-rawhide-ppc64le 
[2026-01-03 12:13:20,773][ ERROR][PID:2056235] Backend process error: No success file => build failure
[2026-01-03 12:13:20,773][  INFO][PID:2056235] Worker failed build, took 776.277346611023
[2026-01-03 12:13:20,774][  INFO][PID:2056235] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "topazus",
            "project_name": "test",
            "project_dirname": "test",
            "submitter": "topazus",
            "ended_on": 1767442400.77389,
            "started_on": 1767441624.4965434,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9971783-fedora-rawhide-ppc64le",
            "build_id": 9971783,
            "package_name": "et",
            "package_version": "6.2.11-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test/et",
            "git_hash": "14449eef1c7d3dd01dfb94c3fd078d07fdcb82a1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "topazus/test--topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-rawhide-ppc64le/",
                    "id": "copr_topazus_test",
                    "name": "Additional repo copr_topazus_test"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/topazus/test",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test",
            "result_dir": "09971783-et",
            "built_packages": "",
            "id": 9971783,
            "mockchain_macros": {
                "copr_username": "topazus",
                "copr_projectname": "test",
                "vendor": "Fedora Project COPR (topazus/test)"
            }
        }
    ]
}
[2026-01-03 12:13:20,838][  INFO][PID:2056235] Sending fedora-messaging bus message in build.end
[2026-01-03 12:13:20,867][  INFO][PID:2056235] Compressing /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/builder-live.log by gzip
[2026-01-03 12:13:20,868][  INFO][PID:2056235] Running command 'gzip /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/builder-live.log' as PID 2144601
[2026-01-03 12:13:20,928][  INFO][PID:2056235] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/builder-live.log)
[2026-01-03 12:13:20,929][  INFO][PID:2056235] Compressing /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/backend.log by gzip
[2026-01-03 12:13:20,930][  INFO][PID:2056235] Running command 'gzip /var/lib/copr/public_html/results/topazus/test/fedora-rawhide-ppc64le/09971783-et/backend.log' as PID 2144605