[2025-04-26 02:19:31,249][  INFO][PID:4047470] Marking build as starting
[2025-04-26 02:19:31,315][  INFO][PID:4047470] Trying to allocate VM: ResallocHost, ticket_id=2670591, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 02:39:49,596][  INFO][PID:4047470] Allocated host ResallocHost, ticket_id=2670591, hostname=140.211.168.61, name=copr_osuosl_p09_prod_03368916_20250426_023437, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 02:39:49,597][  INFO][PID:4047470] Allocating ssh connection to builder
[2025-04-26 02:39:49,598][  INFO][PID:4047470] Checking that builder machine is OK
[2025-04-26 02:39:50,862][  INFO][PID:4047470] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-04-26 02:39:51,803][  INFO][PID:4047470] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-04-26 02:39:51,804][  INFO][PID:4047470] Filling build.info file with builder info
[2025-04-26 02:39:51,805][  INFO][PID:4047470] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250426",
            "project_dirname": "llvm-snapshots-big-merge-20250426",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1745635191.8056612,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "8968529-fedora-rawhide-ppc64le",
            "build_id": 8968529,
            "package_name": "llvm",
            "package_version": "20.1.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/llvm",
            "git_hash": "b24fd61c855c154657114a384b5327482f358beb",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250426--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426",
            "result_dir": "08968529-llvm",
            "built_packages": "",
            "id": 8968529,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250426",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250426)"
            }
        }
    ]
}
[2025-04-26 02:39:51,826][  INFO][PID:4047470] Sending fedora-messaging bus message in build.start
[2025-04-26 02:39:52,361][  INFO][PID:4047470] Sending fedora-messaging bus message in chroot.start
[2025-04-26 02:39:52,377][  INFO][PID:4047470] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8968529-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-04-26 02:39:53,665][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 1
[2025-04-26 02:39:53,667][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log
[2025-04-26 02:39:58,674][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 02:49:58,760][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 02:56:45,145][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 02:56:55,178][WARNING][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 02:57:05,179][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 2
[2025-04-26 02:57:05,181][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log
[2025-04-26 02:58:05,250][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 02:58:15,263][WARNING][PID:4047470] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 02:58:25,266][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 3
[2025-04-26 02:58:25,268][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log
[2025-04-26 02:59:25,336][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 02:59:35,343][WARNING][PID:4047470] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 02:59:45,344][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 4
[2025-04-26 02:59:45,346][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log
[2025-04-26 02:59:58,866][  INFO][PID:4047470] Periodic builder liveness probe: dead
[2025-04-26 03:00:45,414][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 03:00:55,426][ ERROR][PID:4047470] Giving up for unstable SSH, failures: 1745636215.178177, 1745636295.2636592, 1745636375.3432624, 1745636455.4267442
[2025-04-26 03:00:58,937][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.61 port 22: Connection timed out

[2025-04-26 03:02:09,007][ ERROR][PID:4047470] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.61 port 22: Connection timed out

[2025-04-26 03:03:19,076][ ERROR][PID:4047470] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.61 port 22: Connection timed out

[2025-04-26 03:04:29,145][ ERROR][PID:4047470] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.61 port 22: Connection timed out

[2025-04-26 03:04:39,149][ ERROR][PID:4047470] Can't ssh to cancel build.
[2025-04-26 03:04:39,150][ ERROR][PID:4047470] Re-try request for task on 'ResallocHost, ticket_id=2670591, hostname=140.211.168.61, name=copr_osuosl_p09_prod_03368916_20250426_023437, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-04-26 03:04:39,150][  INFO][PID:4047470] Releasing VM back to pool
[2025-04-26 03:04:39,169][  INFO][PID:4047470] Retry #1 (on other host)
[2025-04-26 03:04:39,205][  INFO][PID:4047470] Trying to allocate VM: ResallocHost, ticket_id=2670787, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 03:31:57,590][  INFO][PID:4047470] Allocated host ResallocHost, ticket_id=2670787, hostname=140.211.168.156, name=copr_osuosl_p09_prod_03370059_20250426_032646, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 03:31:57,591][  INFO][PID:4047470] Allocating ssh connection to builder
[2025-04-26 03:31:57,592][  INFO][PID:4047470] Checking that builder machine is OK
[2025-04-26 03:31:58,948][  INFO][PID:4047470] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-04-26 03:31:59,951][  INFO][PID:4047470] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-04-26 03:31:59,952][  INFO][PID:4047470] Filling build.info file with builder info
[2025-04-26 03:31:59,956][  INFO][PID:4047470] Not re-notifying FE and msg buses for the new host.
[2025-04-26 03:31:59,957][  INFO][PID:4047470] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8968529-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-04-26 03:32:01,320][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 1
[2025-04-26 03:32:01,322][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 03:32:06,329][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 03:42:06,436][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 03:48:22,139][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 03:48:32,141][WARNING][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 03:48:42,142][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 2
[2025-04-26 03:48:42,143][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 03:48:46,347][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 03:48:56,348][WARNING][PID:4047470] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 03:49:06,349][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 3
[2025-04-26 03:49:06,351][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 03:49:07,240][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 03:49:17,245][WARNING][PID:4047470] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 03:49:27,245][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 4
[2025-04-26 03:49:27,247][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 03:49:28,141][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 03:49:38,143][ ERROR][PID:4047470] Giving up for unstable SSH, failures: 1745639312.1409218, 1745639336.3489318, 1745639357.2449431, 1745639378.1429782
[2025-04-26 03:49:38,144][ ERROR][PID:4047470] Re-try request for task on 'ResallocHost, ticket_id=2670787, hostname=140.211.168.156, name=copr_osuosl_p09_prod_03370059_20250426_032646, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-04-26 03:49:38,144][  INFO][PID:4047470] Releasing VM back to pool
[2025-04-26 03:49:38,154][  INFO][PID:4047470] Retry #2 (on other host)
[2025-04-26 03:49:38,198][  INFO][PID:4047470] Trying to allocate VM: ResallocHost, ticket_id=2670950, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 03:52:56,296][  INFO][PID:4047470] Allocated host ResallocHost, ticket_id=2670950, hostname=140.211.168.156, name=copr_osuosl_p09_prod_03370477_20250426_034758, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 03:52:56,302][  INFO][PID:4047470] Allocating ssh connection to builder
[2025-04-26 03:52:56,303][  INFO][PID:4047470] Checking that builder machine is OK
[2025-04-26 03:52:57,532][  INFO][PID:4047470] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-04-26 03:52:58,483][  INFO][PID:4047470] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-04-26 03:52:58,484][  INFO][PID:4047470] Filling build.info file with builder info
[2025-04-26 03:52:58,491][  INFO][PID:4047470] Not re-notifying FE and msg buses for the new host.
[2025-04-26 03:52:58,492][  INFO][PID:4047470] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8968529-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-04-26 03:52:59,772][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 1
[2025-04-26 03:52:59,773][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 03:53:04,777][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 04:03:04,871][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 04:06:05,139][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:06:15,140][WARNING][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 04:06:25,142][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 2
[2025-04-26 04:06:25,146][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 04:07:25,215][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:07:35,216][WARNING][PID:4047470] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 04:07:45,218][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 3
[2025-04-26 04:07:45,220][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 04:08:45,290][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:08:55,299][WARNING][PID:4047470] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 04:09:05,303][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 4
[2025-04-26 04:09:05,309][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log
[2025-04-26 04:10:05,400][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:10:15,405][ ERROR][PID:4047470] Giving up for unstable SSH, failures: 1745640375.1402311, 1745640455.2168658, 1745640535.299865, 1745640615.4047518
[2025-04-26 04:10:15,406][ ERROR][PID:4047470] Re-try request for task on 'ResallocHost, ticket_id=2670950, hostname=140.211.168.156, name=copr_osuosl_p09_prod_03370477_20250426_034758, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-04-26 04:10:15,406][  INFO][PID:4047470] Releasing VM back to pool
[2025-04-26 04:10:15,466][  INFO][PID:4047470] Retry #3 (on other host)
[2025-04-26 04:10:15,532][  INFO][PID:4047470] Trying to allocate VM: ResallocHost, ticket_id=2671102, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 04:10:18,624][  INFO][PID:4047470] Allocated host ResallocHost, ticket_id=2671102, hostname=140.211.168.104, name=copr_osuosl_p09_prod_03370654_20250426_035739, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-26 04:10:18,625][  INFO][PID:4047470] Allocating ssh connection to builder
[2025-04-26 04:10:18,626][  INFO][PID:4047470] Checking that builder machine is OK
[2025-04-26 04:10:20,042][  INFO][PID:4047470] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-04-26 04:10:21,257][  INFO][PID:4047470] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-04-26 04:10:21,258][  INFO][PID:4047470] Filling build.info file with builder info
[2025-04-26 04:10:21,264][  INFO][PID:4047470] Not re-notifying FE and msg buses for the new host.
[2025-04-26 04:10:21,270][  INFO][PID:4047470] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8968529-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-04-26 04:10:22,700][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 1
[2025-04-26 04:10:22,708][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-04-26 04:13:07,785][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 04:23:07,884][  INFO][PID:4047470] Periodic builder liveness probe: alive
[2025-04-26 04:28:40,140][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:28:50,141][WARNING][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 04:29:00,142][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 2
[2025-04-26 04:29:00,143][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-04-26 04:30:00,211][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:30:10,212][WARNING][PID:4047470] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 04:30:20,213][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 3
[2025-04-26 04:30:20,214][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-04-26 04:31:20,281][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:31:30,284][WARNING][PID:4047470] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-04-26 04:31:40,285][  INFO][PID:4047470] Downloading the builder-live.log file, attempt 4
[2025-04-26 04:31:40,286][  INFO][PID:4047470] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-04-26 04:32:40,353][ ERROR][PID:4047470] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-04-26 04:32:50,354][ ERROR][PID:4047470] Giving up for unstable SSH, failures: 1745641730.1409585, 1745641810.2123063, 1745641890.2840426, 1745641970.354504
[2025-04-26 04:32:50,355][ ERROR][PID:4047470] Re-try request for task on 'ResallocHost, ticket_id=2671102, hostname=140.211.168.104, name=copr_osuosl_p09_prod_03370654_20250426_035739, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-04-26 04:32:50,356][  INFO][PID:4047470] Releasing VM back to pool
[2025-04-26 04:32:50,366][ ERROR][PID:4047470] Backend process error: Three host tried without success: {'140.211.168.61', '140.211.168.156', '140.211.168.104'}
[2025-04-26 04:32:50,366][WARNING][PID:4047470] Switching not-finished job state to 'failed'
[2025-04-26 04:32:50,367][  INFO][PID:4047470] Worker failed build, took 1349.1019341945648
[2025-04-26 04:32:50,367][  INFO][PID:4047470] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250426",
            "project_dirname": "llvm-snapshots-big-merge-20250426",
            "submitter": "kkleine",
            "ended_on": 1745641970.3667603,
            "started_on": 1745640621.264826,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "8968529-fedora-rawhide-ppc64le",
            "build_id": 8968529,
            "package_name": "llvm",
            "package_version": "20.1.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/llvm",
            "git_hash": "b24fd61c855c154657114a384b5327482f358beb",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250426--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426",
            "result_dir": "08968529-llvm",
            "built_packages": "",
            "id": 8968529,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250426",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250426)"
            }
        }
    ]
}
[2025-04-26 04:32:50,396][  INFO][PID:4047470] Sending fedora-messaging bus message in build.end
[2025-04-26 04:32:50,416][  INFO][PID:4047470] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/08968529-llvm/builder-live.log by gzip
[2025-04-26 04:32:50,418][  INFO][PID:4047470] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/08968529-llvm/builder-live.log' as PID 585886
[2025-04-26 04:32:50,420][  INFO][PID:4047470] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/08968529-llvm/builder-live.log)
[2025-04-26 04:32:50,421][  INFO][PID:4047470] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/08968529-llvm/backend.log by gzip
[2025-04-26 04:32:50,422][  INFO][PID:4047470] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250426/fedora-rawhide-ppc64le/08968529-llvm/backend.log' as PID 585887