[2024-09-05 18:39:29,505][  INFO][PID:3026103] Marking build as starting
[2024-09-05 18:39:29,569][  INFO][PID:3026103] Trying to allocate VM
[2024-09-05 18:39:32,598][  INFO][PID:3026103] Allocated host ResallocHost, ticket_id=4750830, hostname=3.94.250.100
[2024-09-05 18:39:32,599][  INFO][PID:3026103] Allocating ssh connection to builder
[2024-09-05 18:39:32,602][  INFO][PID:3026103] Checking that builder machine is OK
[2024-09-05 18:40:32,673][ ERROR][PID:3026103] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 3.94.250.100 port 22: Connection timed out

[2024-09-05 18:40:42,674][ ERROR][PID:3026103] Re-try request for task on 'ResallocHost, ticket_id=4750830, hostname=3.94.250.100': Unable to finish after 1 SSH attempts
[2024-09-05 18:40:42,675][  INFO][PID:3026103] Releasing VM back to pool
[2024-09-05 18:40:42,686][  INFO][PID:3026103] Retry #1 (on other host)
[2024-09-05 18:40:42,687][  INFO][PID:3026103] Trying to allocate VM
[2024-09-05 18:40:45,712][  INFO][PID:3026103] Allocated host ResallocHost, ticket_id=4750842, hostname=2620:52:3:1:dead:beef:cafe:c19a
[2024-09-05 18:40:45,713][  INFO][PID:3026103] Allocating ssh connection to builder
[2024-09-05 18:40:45,713][  INFO][PID:3026103] Checking that builder machine is OK
[2024-09-05 18:40:46,365][  INFO][PID:3026103] Filling build.info file with builder info
[2024-09-05 18:40:46,366][  INFO][PID:3026103] Not re-notifying FE and msg buses for the new host.
[2024-09-05 18:40:46,366][  INFO][PID:3026103] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/7987381 --detached
[2024-09-05 18:40:46,965][  INFO][PID:3026103] Downloading the builder-live.log file, attempt 1
[2024-09-05 18:40:46,967][  INFO][PID:3026103] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c19a copr-rpmbuild-log
[2024-09-05 18:40:51,978][  INFO][PID:3026103] Status: False
[2024-09-05 18:50:52,130][  INFO][PID:3026103] Status: False
[2024-09-05 19:00:52,278][  INFO][PID:3026103] Status: False
[2024-09-05 19:10:52,448][  INFO][PID:3026103] Status: False
[2024-09-05 19:20:52,623][  INFO][PID:3026103] Status: False
[2024-09-05 19:30:52,704][  INFO][PID:3026103] Status: False
[2024-09-05 19:40:48,256][  INFO][PID:3026103] Downloading results from builder
[2024-09-05 19:40:48,257][  INFO][PID:3026103] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c19a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381 started
[2024-09-05 19:40:48,258][  INFO][PID:3026103] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c19a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/ &> /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/build-07987381.rsync.log
[2024-09-05 19:40:48,674][  INFO][PID:3026103] rsyncing finished.
[2024-09-05 19:40:48,675][  INFO][PID:3026103] Releasing VM back to pool
[2024-09-05 19:40:48,683][  INFO][PID:3026103] Searching for 'success' file in resultdir
[2024-09-05 19:40:48,685][ ERROR][PID:3026103] Build failed: Backend process error: No success file => build failure
[2024-09-05 19:40:48,686][  INFO][PID:3026103] Finished build: id=7987381 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/secureblue/hardened-chromium chroot=srpm-builds 
[2024-09-05 19:40:48,688][ ERROR][PID:3026103] Backend process error: No success file => build failure
[2024-09-05 19:40:48,689][  INFO][PID:3026103] Worker failed build, took 3602.3233971595764
[2024-09-05 19:40:48,690][  INFO][PID:3026103] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "secureblue",
            "project_name": "hardened-chromium",
            "project_dirname": "hardened-chromium",
            "submitter": "secureblue",
            "ended_on": 1725565248.6897333,
            "started_on": 1725561646.366336,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": "x86_64",
            "buildroot_pkgs": null,
            "task_id": "7987381",
            "build_id": 7987381,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 9,
            "source_json": "{\"script\": \"#! /bin/bash -x\\n\\n# Download this repo with its submodule https://github.com/secureblue/hardened-chromium.git inside the COPR build system\\ngit clone --depth 1 --recurse-submodules https://github.com/secureblue/hardened-chromium.git\\ncd hardened-chromium\\n\\ncd patches/\\npatches=(*.patch)\\nfor ((i=0; i<${#patches[@]}; i++)); do\\n\\tcp ${patches[i]} ../chromium/hardened-chromium-$((i+2000)).patch\\ndone\\ncd ..\\ncd vanadium_patches/\\npatches=(*.patch)\\nfor ((i=0; i<${#patches[@]}; i++)); do\\n\\tcp ${patches[i]} ../chromium/vanadium-$((i+3000)).patch\\ndone\\ncd ..\\n\\nversion=\\\"128.0.6613.119\\\"\\n\\ncd chromium\\npython3 chromium-latest.py --version $version --stable --ffmpegclean --ffmpegarm --cleansources\\nrm chromium-${version}.tar.xz\\nrm -rf ./chromium-${version}\\ncd ..\\n\\n# Move all the source files into the parent directory for the COPR build system to find them\\nmv ./chromium/* ../\\n\", \"chroot\": \"fedora-41-x86_64\", \"builddeps\": \"git python3\", \"resultdir\": \"\", \"repos\": \"\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "secureblue/hardened-chromium--secureblue",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "background": false,
            "repos": [],
            "destdir": "/var/lib/copr/public_html/results/secureblue/hardened-chromium",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/secureblue/hardened-chromium",
            "result_dir": "07987381",
            "built_packages": "",
            "tags": [
                "arch_x86_64"
            ],
            "id": 7987381,
            "mockchain_macros": {
                "copr_username": "secureblue",
                "copr_projectname": "hardened-chromium",
                "vendor": "Fedora Project COPR (secureblue/hardened-chromium)"
            }
        }
    ]
}
[2024-09-05 19:40:48,758][  INFO][PID:3026103] Sending fedora-messaging bus message in build.end
[2024-09-05 19:40:49,405][  INFO][PID:3026103] Compressing /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/builder-live.log by gzip
[2024-09-05 19:40:49,407][  INFO][PID:3026103] Running command 'gzip /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/builder-live.log' as PID 3428187
[2024-09-05 19:40:49,422][  INFO][PID:3026103] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/builder-live.log)
[2024-09-05 19:40:49,423][  INFO][PID:3026103] Compressing /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/backend.log by gzip
[2024-09-05 19:40:49,424][  INFO][PID:3026103] Running command 'gzip /var/lib/copr/public_html/results/secureblue/hardened-chromium/srpm-builds/07987381/backend.log' as PID 3428189