[2025-04-20 02:29:01,862][  INFO][PID:360802] Marking build as starting
[2025-04-20 02:29:01,950][  INFO][PID:360802] Trying to allocate VM: ResallocHost, ticket_id=2518755, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-20 02:29:08,036][  INFO][PID:360802] Allocated host ResallocHost, ticket_id=2518755, hostname=2620:52:3:1:dead:beef:cafe:c208, name=copr_hv_ppc64le_01_prod_03206082_20250419_213456, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-04-20 02:29:08,037][  INFO][PID:360802] Allocating ssh connection to builder
[2025-04-20 02:29:08,037][  INFO][PID:360802] Checking that builder machine is OK
[2025-04-20 02:29:08,830][  INFO][PID:360802] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-04-20 02:29:09,268][  INFO][PID:360802] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-04-20 02:29:09,269][  INFO][PID:360802] Filling build.info file with builder info
[2025-04-20 02:29:09,270][  INFO][PID:360802] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250420",
            "project_dirname": "llvm-snapshots-big-merge-20250420",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1745116149.2703063,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "8944822-fedora-rawhide-ppc64le",
            "build_id": 8944822,
            "package_name": "llvm",
            "package_version": "20.1.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/llvm",
            "git_hash": "2f4828a87a031510c386857c9d4f37ff49d771ef",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250420--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420",
            "result_dir": "08944822-llvm",
            "built_packages": "",
            "id": 8944822,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250420",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250420)"
            }
        }
    ]
}
[2025-04-20 02:29:09,317][  INFO][PID:360802] Sending fedora-messaging bus message in build.start
[2025-04-20 02:29:10,411][  INFO][PID:360802] Sending fedora-messaging bus message in chroot.start
[2025-04-20 02:29:10,433][  INFO][PID:360802] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8944822-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-04-20 02:29:11,130][  INFO][PID:360802] Downloading the builder-live.log file, attempt 1
[2025-04-20 02:29:11,132][  INFO][PID:360802] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c208 copr-rpmbuild-log
[2025-04-20 02:29:16,143][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 02:39:16,253][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 02:49:16,359][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 02:59:16,474][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 03:09:16,567][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 03:19:16,681][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 03:29:16,901][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 03:39:17,085][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 03:49:17,290][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 03:59:17,462][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 04:09:17,673][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 04:19:18,164][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 04:29:18,401][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 04:39:18,524][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 04:49:18,646][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 04:59:18,762][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 05:09:18,891][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 05:19:19,080][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 05:29:19,166][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 05:39:19,268][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 05:49:19,417][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 05:59:19,538][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 06:09:19,668][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 06:19:19,800][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 06:29:19,923][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 06:39:20,028][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 06:49:20,120][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 06:59:20,196][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 07:09:20,357][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 07:19:20,550][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 07:29:20,671][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 07:39:20,781][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 07:49:20,873][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 07:59:20,988][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 08:09:21,132][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 08:19:21,277][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 08:29:21,383][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 08:39:21,472][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 08:49:21,559][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 08:59:21,673][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 09:09:21,779][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 09:19:21,875][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 09:29:21,965][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 09:39:22,059][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 09:49:22,160][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 09:59:22,259][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 10:09:22,435][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 10:19:22,617][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 10:29:22,760][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 10:39:22,860][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 10:49:22,951][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 10:59:23,045][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 11:09:23,144][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 11:19:23,239][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 11:29:23,320][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 11:39:23,420][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 11:49:23,512][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 11:59:23,651][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 12:09:23,750][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 12:19:23,867][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 12:29:23,953][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 12:39:24,053][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 12:49:24,151][  INFO][PID:360802] Periodic builder liveness probe: alive
[2025-04-20 12:49:36,824][  INFO][PID:360802] Downloading results from builder
[2025-04-20 12:49:36,857][  INFO][PID:360802] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c208]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm started
[2025-04-20 12:49:36,895][  INFO][PID:360802] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c208]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/build-08944822.rsync.log
[2025-04-20 12:49:39,514][  INFO][PID:360802] rsyncing finished.
[2025-04-20 12:49:39,516][  INFO][PID:360802] Releasing VM back to pool
[2025-04-20 12:49:39,537][  INFO][PID:360802] Searching for 'success' file in resultdir
[2025-04-20 12:49:39,545][ ERROR][PID:360802] Build failed: Backend process error: No success file => build failure
[2025-04-20 12:49:39,657][  INFO][PID:360802] Finished build: id=8944822 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420 chroot=fedora-rawhide-ppc64le 
[2025-04-20 12:49:39,776][ ERROR][PID:360802] Backend process error: No success file => build failure
[2025-04-20 12:49:39,780][  INFO][PID:360802] Worker failed build, took 37230.50777220726
[2025-04-20 12:49:39,796][  INFO][PID:360802] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250420",
            "project_dirname": "llvm-snapshots-big-merge-20250420",
            "submitter": "kkleine",
            "ended_on": 1745153379.7780786,
            "started_on": 1745116149.2703063,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "8944822-fedora-rawhide-ppc64le",
            "build_id": 8944822,
            "package_name": "llvm",
            "package_version": "20.1.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/llvm",
            "git_hash": "2f4828a87a031510c386857c9d4f37ff49d771ef",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250420--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420",
            "result_dir": "08944822-llvm",
            "built_packages": "",
            "id": 8944822,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250420",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250420)"
            }
        }
    ]
}
[2025-04-20 12:49:40,462][  INFO][PID:360802] Sending fedora-messaging bus message in build.end
[2025-04-20 12:49:40,849][  INFO][PID:360802] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/builder-live.log by gzip
[2025-04-20 12:49:40,884][  INFO][PID:360802] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/builder-live.log' as PID 3924116
[2025-04-20 12:49:41,268][  INFO][PID:360802] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/builder-live.log)
[2025-04-20 12:49:41,279][  INFO][PID:360802] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/backend.log by gzip
[2025-04-20 12:49:41,282][  INFO][PID:360802] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250420/fedora-rawhide-ppc64le/08944822-llvm/backend.log' as PID 3924140