[2025-05-01 22:39:22,410][  INFO][PID:3415172] Marking build as starting
[2025-05-01 22:39:22,458][  INFO][PID:3415172] Trying to allocate VM: ResallocHost, ticket_id=2765706, requested_tags=['copr_builder', 'arch_aarch64']
[2025-05-01 22:39:25,506][  INFO][PID:3415172] Allocated host ResallocHost, ticket_id=2765706, hostname=52.91.60.153, name=aws_aarch64_normalreserved_prod_03603836_20250501_223303, requested_tags=['copr_builder', 'arch_aarch64']
[2025-05-01 22:39:25,507][  INFO][PID:3415172] Allocating ssh connection to builder
[2025-05-01 22:39:25,508][  INFO][PID:3415172] Checking that builder machine is OK
[2025-05-01 22:39:25,896][  INFO][PID:3415172] Running remote command: copr-builder-ready fedora-41-aarch64
[2025-05-01 22:39:26,130][  INFO][PID:3415172] Red Hat subscription not needed for fedora-41-aarch64
Builder is ready to be used

[2025-05-01 22:39:26,135][  INFO][PID:3415172] Filling build.info file with builder info
[2025-05-01 22:39:26,138][  INFO][PID:3415172] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 90000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250501",
            "project_dirname": "llvm-snapshots-big-merge-20250501",
            "submitter": "tstellar",
            "ended_on": null,
            "started_on": 1746139166.1381125,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-aarch64",
            "arch": "aarch64",
            "buildroot_pkgs": [],
            "task_id": "8988197-fedora-41-aarch64",
            "build_id": 8988197,
            "package_name": "llvm",
            "package_version": "20.1.3-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/llvm",
            "git_hash": "b88adff137f249ed4155f3277807146ce8ab57a8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250501--90ddc929-3b67-4ded-896e-bec29ed75bb6",
            "results": null,
            "appstream": false,
            "allow_user_ssh": true,
            "ssh_public_keys": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFSZUe+GJKAWcqXkmjv0SHW3sufjABeBiAPM4bmQL7Ur tstellar@tstellar-thinkpadp1gen4i.remote.csb\r\n",
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_aarch64"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501",
            "result_dir": "08988197-llvm",
            "built_packages": "",
            "id": 8988197,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250501",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250501)"
            }
        }
    ]
}
[2025-05-01 22:39:26,203][  INFO][PID:3415172] Sending fedora-messaging bus message in build.start
[2025-05-01 22:39:26,737][  INFO][PID:3415172] Sending fedora-messaging bus message in chroot.start
[2025-05-01 22:39:26,753][  INFO][PID:3415172] Allocating root ssh connection to builder
[2025-05-01 22:39:27,178][  INFO][PID:3415172] The expiration time was set to 2025-05-01 23:39
[2025-05-01 22:39:27,378][  INFO][PID:3415172] Deployed user SSH key for @fedora-llvm-team
[2025-05-01 22:39:27,379][  INFO][PID:3415172] The owner of this build can connect using:
[2025-05-01 22:39:27,381][  INFO][PID:3415172] ssh root@52.91.60.153
[2025-05-01 22:39:27,382][  INFO][PID:3415172] Unless you connect to the builder and prolong its expiration, it will be shut-down in 2025-05-01 23:39
[2025-05-01 22:39:27,383][  INFO][PID:3415172] After connecting, run `copr-builder help' for complete instructions
[2025-05-01 22:39:27,385][  INFO][PID:3415172] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8988197-fedora-41-aarch64 --chroot fedora-41-aarch64 --detached
[2025-05-01 22:39:27,825][  INFO][PID:3415172] Downloading the builder-live.log file, attempt 1
[2025-05-01 22:39:27,828][  INFO][PID:3415172] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.60.153 copr-rpmbuild-log
[2025-05-01 22:39:32,833][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 22:49:32,977][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 22:59:33,127][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 23:09:33,326][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 23:19:33,508][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 23:29:33,659][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 23:39:33,809][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 23:49:33,950][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-01 23:59:34,097][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 00:09:34,246][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 00:19:34,418][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 00:29:34,573][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 00:39:34,724][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 00:49:34,878][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 00:59:35,037][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 01:09:35,219][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 01:19:35,558][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 01:29:35,809][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 01:39:36,000][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 01:49:36,220][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 01:59:36,448][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 02:09:36,676][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 02:19:36,969][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 02:29:37,193][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 02:39:37,362][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 02:49:37,537][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 02:59:37,689][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 03:09:37,940][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 03:19:38,187][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 03:29:38,351][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 03:39:38,522][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 03:49:39,066][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 03:59:39,263][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 04:09:39,511][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 04:19:39,850][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 04:29:40,139][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 04:39:40,319][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 04:49:40,484][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 04:59:40,661][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 05:09:40,885][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 05:19:41,071][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 05:29:41,265][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 05:39:41,487][  INFO][PID:3415172] Periodic builder liveness probe: alive
[2025-05-02 05:42:13,970][  INFO][PID:3415172] Keeping builder alive for user SSH
[2025-05-02 05:42:14,770][WARNING][PID:3415172] VM expired, it will be shut-down soon
[2025-05-02 05:42:14,780][  INFO][PID:3415172] The expiration was 2025-05-01 23:39 and it is now 2025-05-02 05:42
[2025-05-02 05:42:14,817][  INFO][PID:3415172] Builder allowed user SSH, not downloading the results for safety reasons.
[2025-05-02 05:42:14,831][  INFO][PID:3415172] Downloading results from builder
[2025-05-02 05:42:14,869][  INFO][PID:3415172] rsyncing of mockbuilder@52.91.60.153:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm started
[2025-05-02 05:42:14,896][  INFO][PID:3415172] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' --filter '+ success' --filter '+ *.spec' --filter '- *' mockbuilder@52.91.60.153:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/build-08988197.rsync.log
[2025-05-02 05:42:15,200][  INFO][PID:3415172] rsyncing finished.
[2025-05-02 05:42:15,204][  INFO][PID:3415172] Releasing VM back to pool
[2025-05-02 05:42:15,253][  INFO][PID:3415172] Searching for 'success' file in resultdir
[2025-05-02 05:42:15,260][ ERROR][PID:3415172] Build failed: Backend process error: No success file => build failure
[2025-05-02 05:42:15,277][  INFO][PID:3415172] Finished build: id=8988197 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501 chroot=fedora-41-aarch64 
[2025-05-02 05:42:15,396][ ERROR][PID:3415172] Backend process error: No success file => build failure
[2025-05-02 05:42:15,399][  INFO][PID:3415172] Worker failed build, took 25369.26154088974
[2025-05-02 05:42:15,418][  INFO][PID:3415172] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 90000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20250501",
            "project_dirname": "llvm-snapshots-big-merge-20250501",
            "submitter": "tstellar",
            "ended_on": 1746164535.3996534,
            "started_on": 1746139166.1381125,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-aarch64",
            "arch": "aarch64",
            "buildroot_pkgs": [],
            "task_id": "8988197-fedora-41-aarch64",
            "build_id": 8988197,
            "package_name": "llvm",
            "package_version": "20.1.3-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/llvm",
            "git_hash": "b88adff137f249ed4155f3277807146ce8ab57a8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20250501--90ddc929-3b67-4ded-896e-bec29ed75bb6",
            "results": null,
            "appstream": false,
            "allow_user_ssh": true,
            "ssh_public_keys": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFSZUe+GJKAWcqXkmjv0SHW3sufjABeBiAPM4bmQL7Ur tstellar@tstellar-thinkpadp1gen4i.remote.csb\r\n",
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_aarch64"
            ],
            "with_opts": [
                "snapshot_build"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501",
            "result_dir": "08988197-llvm",
            "built_packages": "",
            "id": 8988197,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20250501",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20250501)"
            }
        }
    ]
}
[2025-05-02 05:42:16,122][  INFO][PID:3415172] Sending fedora-messaging bus message in build.end
[2025-05-02 05:42:16,530][  INFO][PID:3415172] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/builder-live.log by gzip
[2025-05-02 05:42:16,550][  INFO][PID:3415172] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/builder-live.log' as PID 1049004
[2025-05-02 05:42:17,238][  INFO][PID:3415172] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/builder-live.log)
[2025-05-02 05:42:17,250][  INFO][PID:3415172] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/backend.log by gzip
[2025-05-02 05:42:17,253][  INFO][PID:3415172] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250501/fedora-41-aarch64/08988197-llvm/backend.log' as PID 1049102