[2025-01-24 21:06:02,820][  INFO][PID:843367] Marking build as starting
[2025-01-24 21:06:02,849][  INFO][PID:843367] Trying to allocate VM
[2025-01-24 21:06:05,880][  INFO][PID:843367] Allocated host ResallocHost, ticket_id=917986, hostname=2620:52:3:1:dead:beef:cafe:c156, name=copr_hv_x86_64_02_prod_00822793_20250124_210139
[2025-01-24 21:06:05,881][  INFO][PID:843367] Allocating ssh connection to builder
[2025-01-24 21:06:05,882][  INFO][PID:843367] Checking that builder machine is OK
[2025-01-24 21:06:06,425][  INFO][PID:843367] Running remote command: copr-builder-ready srpm-builds
[2025-01-24 21:06:06,740][  INFO][PID:843367] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-01-24 21:06:06,741][  INFO][PID:843367] Filling build.info file with builder info
[2025-01-24 21:06:06,743][  INFO][PID:843367] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@copr",
            "project_name": "PyPI",
            "project_dirname": "PyPI",
            "submitter": "ksurma",
            "ended_on": null,
            "started_on": 1737752766.7428787,
            "submitted_on": null,
            "status": 3,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "8568447",
            "build_id": 8568447,
            "package_name": "python-inference-gym",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 5,
            "source_json": "{\"pypi_package_name\": \"inference-gym\", \"pypi_package_version\": \"0.0.5\", \"spec_generator\": \"pyp2spec\", \"spec_template\": \"\", \"python_versions\": []}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@copr/PyPI--ksurma",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "background": true,
            "repos": [],
            "destdir": "/var/lib/copr/public_html/results/@copr/PyPI",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI",
            "result_dir": "08568447",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 8568447,
            "mockchain_macros": {
                "copr_username": "@copr",
                "copr_projectname": "PyPI",
                "vendor": "Fedora Project COPR (@copr/PyPI)"
            }
        }
    ]
}
[2025-01-24 21:06:06,764][  INFO][PID:843367] Sending fedora-messaging bus message in build.start
[2025-01-24 21:06:07,482][  INFO][PID:843367] Sending fedora-messaging bus message in chroot.start
[2025-01-24 21:06:07,535][  INFO][PID:843367] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/8568447 --detached
[2025-01-24 21:06:08,176][  INFO][PID:843367] Downloading the builder-live.log file, attempt 1
[2025-01-24 21:06:08,188][  INFO][PID:843367] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c156 copr-rpmbuild-log
[2025-01-24 21:06:13,197][  INFO][PID:843367] Periodic builder liveness probe: alive
[2025-01-24 21:08:08,813][ ERROR][PID:843367] Re-try request for task on 'ResallocHost, ticket_id=917986, hostname=2620:52:3:1:dead:beef:cafe:c156, name=copr_hv_x86_64_02_prod_00822793_20250124_210139': SSH problems when downloading live log: copr-rpmbuild-log shouldn't exit != 0
[2025-01-24 21:08:08,813][  INFO][PID:843367] Releasing VM back to pool
[2025-01-24 21:08:08,829][  INFO][PID:843367] Retry #1 (on other host)
[2025-01-24 21:08:08,830][  INFO][PID:843367] Trying to allocate VM
[2025-01-24 21:08:11,928][  INFO][PID:843367] Allocated host ResallocHost, ticket_id=918076, hostname=2620:52:3:1:dead:beef:cafe:c253, name=copr_hv_ppc64le_02_prod_00821953_20250124_194614
[2025-01-24 21:08:11,930][  INFO][PID:843367] Allocating ssh connection to builder
[2025-01-24 21:08:11,931][  INFO][PID:843367] Checking that builder machine is OK
[2025-01-24 21:08:12,767][  INFO][PID:843367] Running remote command: copr-builder-ready srpm-builds
[2025-01-24 21:08:13,182][  INFO][PID:843367] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-01-24 21:08:13,182][  INFO][PID:843367] Filling build.info file with builder info
[2025-01-24 21:08:13,187][  INFO][PID:843367] Not re-notifying FE and msg buses for the new host.
[2025-01-24 21:08:13,188][  INFO][PID:843367] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/8568447 --detached
[2025-01-24 21:08:13,897][  INFO][PID:843367] Downloading the builder-live.log file, attempt 1
[2025-01-24 21:08:13,899][  INFO][PID:843367] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c253 copr-rpmbuild-log
[2025-01-24 21:08:15,777][  INFO][PID:843367] Downloading results from builder
[2025-01-24 21:08:15,777][  INFO][PID:843367] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c253]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447 started
[2025-01-24 21:08:15,778][  INFO][PID:843367] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c253]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/ &> /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/build-08568447.rsync.log
[2025-01-24 21:08:16,274][  INFO][PID:843367] rsyncing finished.
[2025-01-24 21:08:16,278][  INFO][PID:843367] Releasing VM back to pool
[2025-01-24 21:08:16,300][  INFO][PID:843367] Searching for 'success' file in resultdir
[2025-01-24 21:08:16,300][ ERROR][PID:843367] Build failed: Backend process error: No success file => build failure
[2025-01-24 21:08:16,302][  INFO][PID:843367] Finished build: id=8568447 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/@copr/PyPI chroot=srpm-builds 
[2025-01-24 21:08:16,304][ ERROR][PID:843367] Backend process error: No success file => build failure
[2025-01-24 21:08:16,305][  INFO][PID:843367] Worker failed build, took 3.1184520721435547
[2025-01-24 21:08:16,306][  INFO][PID:843367] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@copr",
            "project_name": "PyPI",
            "project_dirname": "PyPI",
            "submitter": "ksurma",
            "ended_on": 1737752896.305628,
            "started_on": 1737752893.187176,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "8568447",
            "build_id": 8568447,
            "package_name": "python-inference-gym",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 5,
            "source_json": "{\"pypi_package_name\": \"inference-gym\", \"pypi_package_version\": \"0.0.5\", \"spec_generator\": \"pyp2spec\", \"spec_template\": \"\", \"python_versions\": []}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@copr/PyPI--ksurma",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "background": true,
            "repos": [],
            "destdir": "/var/lib/copr/public_html/results/@copr/PyPI",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI",
            "result_dir": "08568447",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 8568447,
            "mockchain_macros": {
                "copr_username": "@copr",
                "copr_projectname": "PyPI",
                "vendor": "Fedora Project COPR (@copr/PyPI)"
            }
        }
    ]
}
[2025-01-24 21:08:16,339][  INFO][PID:843367] Sending fedora-messaging bus message in build.end
[2025-01-24 21:08:16,366][  INFO][PID:843367] Compressing /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/builder-live.log by gzip
[2025-01-24 21:08:16,368][  INFO][PID:843367] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/builder-live.log' as PID 861850
[2025-01-24 21:08:16,370][  INFO][PID:843367] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/builder-live.log)
[2025-01-24 21:08:16,371][  INFO][PID:843367] Compressing /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/backend.log by gzip
[2025-01-24 21:08:16,373][  INFO][PID:843367] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/srpm-builds/08568447/backend.log' as PID 861851