[2025-06-08 02:42:01,720][  INFO][PID:398428] Marking build as starting
[2025-06-08 02:42:01,763][  INFO][PID:398428] Trying to allocate VM: ResallocHost, ticket_id=3407219, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-06-08 02:42:04,784][  INFO][PID:398428] Allocated host ResallocHost, ticket_id=3407219, hostname=2620:52:3:1:dead:beef:cafe:c24e, name=copr_hv_ppc64le_02_prod_04669927_20250608_012832, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-06-08 02:42:04,786][  INFO][PID:398428] Allocating ssh connection to builder
[2025-06-08 02:42:04,787][  INFO][PID:398428] Checking that builder machine is OK
[2025-06-08 02:42:05,567][  INFO][PID:398428] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-06-08 02:42:05,999][  INFO][PID:398428] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-06-08 02:42:06,001][  INFO][PID:398428] Filling build.info file with builder info
[2025-06-08 02:42:06,004][  INFO][PID:398428] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250608",
            "project_dirname": "llvm-snapshots-big-merge-20250608",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1749350526.0042658,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9143900-fedora-42-ppc64le",
            "build_id": 9143900,
            "package_name": "llvm",
            "package_version": "20.1.6-7",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/llvm",
            "git_hash": "4c8b9985e93776cfa3ecfd89af6642e9fc45e6e1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250608--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/fedora-42-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_test_suite",
                    "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite"
                }
            ],
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608",
            "result_dir": "09143900-llvm",
            "built_packages": "",
            "id": 9143900,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250608",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250608)"
            }
        }
    ]
}
[2025-06-08 02:42:06,027][  INFO][PID:398428] Sending fedora-messaging bus message in build.start
[2025-06-08 02:42:08,779][  INFO][PID:398428] Sending fedora-messaging bus message in chroot.start
[2025-06-08 02:42:08,994][  INFO][PID:398428] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9143900-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-06-08 02:42:11,739][  INFO][PID:398428] Downloading the builder-live.log file, attempt 1
[2025-06-08 02:42:11,741][  INFO][PID:398428] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24e copr-rpmbuild-log
[2025-06-08 02:42:16,747][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 02:52:16,951][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 03:02:17,119][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 03:12:17,302][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 03:22:17,609][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 03:32:17,856][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 03:42:18,085][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 03:52:18,296][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 04:02:18,526][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 04:12:19,157][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 04:22:19,686][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 04:32:19,996][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 04:42:20,209][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 04:52:20,454][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 05:02:20,637][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 05:12:20,906][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 05:22:21,197][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 05:32:21,372][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 05:42:21,559][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 05:52:21,756][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 06:02:21,951][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 06:12:22,114][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 06:22:22,264][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 06:32:22,411][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 06:42:22,612][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 06:52:22,773][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 07:02:22,922][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 07:12:23,082][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 07:22:23,246][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 07:32:23,411][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 07:42:23,568][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 07:52:23,734][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 08:02:23,897][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 08:12:24,128][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 08:22:24,275][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 08:32:24,427][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 08:42:24,584][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 08:52:24,744][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 09:02:24,908][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 09:12:25,120][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 09:22:25,382][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 09:32:25,574][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 09:42:25,734][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 09:52:25,903][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 10:02:26,054][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 10:12:26,228][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 10:22:26,386][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 10:32:26,547][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 10:42:26,715][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 10:52:26,898][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 11:02:27,069][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 11:12:27,280][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 11:22:27,444][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 11:32:27,605][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 11:42:27,768][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 11:52:27,934][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 12:02:28,102][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 12:12:28,280][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 12:22:28,442][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 12:32:28,612][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 12:42:29,041][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 12:52:29,303][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 13:02:29,538][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 13:12:29,896][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 13:22:30,093][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 13:32:30,276][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 13:42:30,474][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 13:52:30,645][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 14:02:30,844][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 14:12:30,999][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 14:22:31,195][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 14:32:31,388][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 14:42:31,536][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 14:52:31,720][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 15:02:31,959][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 15:12:32,180][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 15:22:32,415][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 15:32:32,597][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 15:42:32,777][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 15:52:32,928][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 16:02:33,100][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 16:12:33,392][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 16:22:33,599][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 16:32:33,755][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 16:42:33,933][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 16:52:34,128][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 17:02:34,307][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 17:12:34,613][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 17:22:34,793][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 17:32:34,999][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 17:42:35,244][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 17:52:35,486][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 18:02:35,732][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 18:12:36,146][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 18:22:36,314][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 18:32:36,522][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 18:42:36,699][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 18:52:36,889][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:02:37,055][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:12:37,269][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:22:37,553][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:32:37,727][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:42:37,918][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:52:38,101][  INFO][PID:398428] Periodic builder liveness probe: alive
[2025-06-08 19:55:12,407][  INFO][PID:398428] Downloading results from builder
[2025-06-08 19:55:12,451][  INFO][PID:398428] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm started
[2025-06-08 19:55:12,489][  INFO][PID:398428] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/build-09143900.rsync.log
[2025-06-08 19:55:17,053][  INFO][PID:398428] rsyncing finished.
[2025-06-08 19:55:17,063][  INFO][PID:398428] Releasing VM back to pool
[2025-06-08 19:55:17,111][  INFO][PID:398428] Searching for 'success' file in resultdir
[2025-06-08 19:55:17,122][ ERROR][PID:398428] Build failed: Backend process error: No success file => build failure
[2025-06-08 19:55:17,287][  INFO][PID:398428] Finished build: id=9143900 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608 chroot=fedora-42-ppc64le 
[2025-06-08 19:55:17,377][ ERROR][PID:398428] Backend process error: No success file => build failure
[2025-06-08 19:55:17,381][  INFO][PID:398428] Worker failed build, took 61991.37732577324
[2025-06-08 19:55:17,400][  INFO][PID:398428] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250608",
            "project_dirname": "llvm-snapshots-big-merge-20250608",
            "submitter": "kkleine",
            "ended_on": 1749412517.3815916,
            "started_on": 1749350526.0042658,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9143900-fedora-42-ppc64le",
            "build_id": 9143900,
            "package_name": "llvm",
            "package_version": "20.1.6-7",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/llvm",
            "git_hash": "4c8b9985e93776cfa3ecfd89af6642e9fc45e6e1",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250608--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-test-suite/fedora-42-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_test_suite",
                    "name": "Additional repo copr_fedora_llvm_team_llvm_test_suite"
                }
            ],
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608",
            "result_dir": "09143900-llvm",
            "built_packages": "",
            "id": 9143900,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250608",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250608)"
            }
        }
    ]
}
[2025-06-08 19:55:18,193][  INFO][PID:398428] Sending fedora-messaging bus message in build.end
[2025-06-08 19:55:18,848][  INFO][PID:398428] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/builder-live.log by gzip
[2025-06-08 19:55:18,891][  INFO][PID:398428] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/builder-live.log' as PID 37852
[2025-06-08 19:55:19,611][  INFO][PID:398428] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/builder-live.log)
[2025-06-08 19:55:19,630][  INFO][PID:398428] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/backend.log by gzip
[2025-06-08 19:55:19,633][  INFO][PID:398428] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250608/fedora-42-ppc64le/09143900-llvm/backend.log' as PID 37907