[2026-02-24 03:15:54,624][ INFO][PID:502849] Marking build as starting [2026-02-24 03:15:54,712][ INFO][PID:502849] Checking that /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/repodata/repomd.xml exists [2026-02-24 03:15:54,713][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:15:54,713][ INFO][PID:502849] VM allocation process starts [2026-02-24 03:15:54,723][ INFO][PID:502849] Trying to allocate VM: ResallocHost, ticket_id=1573729, requested_tags=['copr_builder', 'arch_s390x'] [2026-02-24 03:15:57,777][ INFO][PID:502849] Allocated host ResallocHost, ticket_id=1573729, hostname=13.122.90.7, name=copr_ic_s390x_eu_es_3_prod_02578338_20260224_024647, requested_tags=['copr_builder', 'arch_s390x'] [2026-02-24 03:15:57,806][ INFO][PID:502849] Allocating ssh connection to builder [2026-02-24 03:15:57,807][ INFO][PID:502849] Checking that builder machine is OK [2026-02-24 03:15:59,102][ INFO][PID:502849] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-02-24 03:16:00,292][ INFO][PID:502849] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-02-24 03:16:00,293][ INFO][PID:502849] Filling build.info file with builder info [2026-02-24 03:16:00,293][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:00,294][ INFO][PID:502849] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "starfish", "project_name": "dlib", "project_dirname": "dlib", "submitter": "starfish", "ended_on": null, "started_on": 1771902960.2944562, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10162308-fedora-rawhide-s390x", "build_id": 10162308, "package_name": "dlib", "package_version": "20.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/starfish/dlib/dlib", "git_hash": "d13dd379e0a899e536717b326fbc49f1a5713818", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "starfish/dlib--starfish", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/starfish/dlib/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 98 } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": 98, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/starfish/dlib", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/starfish/dlib", "result_dir": "10162308-dlib", "built_packages": "", "id": 10162308, "mockchain_macros": { "copr_username": "starfish", "copr_projectname": "dlib", "vendor": "Fedora Project COPR (starfish/dlib)" } } ] } [2026-02-24 03:16:00,349][ INFO][PID:502849] Sending fedora-messaging bus message in build.start [2026-02-24 03:16:00,848][ INFO][PID:502849] Sending fedora-messaging bus message in chroot.start [2026-02-24 03:16:00,872][ INFO][PID:502849] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10162308-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-02-24 03:16:02,247][ INFO][PID:502849] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.122.90.7' (ED25519) to the list of known hosts. [2026-02-24 03:16:02,248][ INFO][PID:502849] Downloading the builder-live.log file, attempt 1 [2026-02-24 03:16:02,523][ INFO][PID:502849] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.122.90.7 copr-rpmbuild-log [2026-02-24 03:16:07,252][ INFO][PID:502849] Periodic builder liveness probe: alive [2026-02-24 03:16:07,380][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:12,381][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:17,382][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:22,429][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:27,431][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:32,432][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:37,434][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:42,436][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:47,437][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:52,490][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:16:57,492][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:03,112][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:08,158][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:13,159][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:18,160][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:23,162][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:28,187][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:33,188][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:38,189][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:43,190][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:48,241][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:53,348][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:17:58,362][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:03,461][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:09,181][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:14,186][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:19,525][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:24,539][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:29,547][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:34,551][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:39,557][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:44,827][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:49,830][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:54,832][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:18:59,879][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:05,296][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:10,305][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:15,432][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:20,437][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:25,443][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:30,445][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:35,649][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:40,691][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:45,824][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:50,838][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:19:55,840][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:00,867][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:05,910][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:11,144][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:16,145][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:21,147][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:26,148][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:31,149][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:36,150][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:41,150][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:46,151][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:51,152][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:20:56,153][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:01,154][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:06,155][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:11,156][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:16,157][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:21,158][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:26,159][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:31,159][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:36,160][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:41,161][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:46,162][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:51,163][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:21:56,164][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:01,165][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:06,166][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:11,170][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:16,700][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:21,701][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:26,702][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:31,703][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:36,704][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:41,705][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:46,706][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:51,707][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:22:56,708][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:01,710][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:06,717][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:12,261][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:17,269][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:22,271][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:27,274][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:32,275][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:37,443][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:42,757][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:47,758][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:52,759][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:23:57,760][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:02,859][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:07,860][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:12,861][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:17,862][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:22,864][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:27,865][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:32,866][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:37,867][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:42,868][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:47,870][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:52,871][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:24:57,872][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:02,873][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:07,874][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:12,874][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:17,875][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:22,876][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:27,877][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:32,878][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:37,879][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:42,880][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:47,881][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:52,928][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:25:57,930][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:03,085][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:08,090][ INFO][PID:502849] Periodic builder liveness probe: alive [2026-02-24 03:26:08,596][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:13,597][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:18,598][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:23,599][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:28,600][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:33,601][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:38,602][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:43,603][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:48,605][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:53,606][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:26:59,434][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:27:04,607][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:27:09,608][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:27:14,610][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:27:19,610][ INFO][PID:502849] Checking for cancel request [2026-02-24 03:27:22,527][ INFO][PID:502849] Downloading results from builder [2026-02-24 03:27:22,528][ INFO][PID:502849] rsyncing of mockbuilder@13.122.90.7:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib started [2026-02-24 03:27:22,529][ INFO][PID:502849] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.122.90.7:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/ &> /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/build-10162308.rsync.log [2026-02-24 03:27:27,314][ INFO][PID:502849] rsyncing finished. [2026-02-24 03:27:27,314][ INFO][PID:502849] Releasing VM back to pool [2026-02-24 03:27:27,380][ INFO][PID:502849] Searching for 'success' file in resultdir [2026-02-24 03:27:27,381][ ERROR][PID:502849] Build failed: Backend process error: No success file => build failure [2026-02-24 03:27:27,381][ INFO][PID:502849] Finished build: id=10162308 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/starfish/dlib chroot=fedora-rawhide-s390x [2026-02-24 03:27:27,383][ ERROR][PID:502849] Backend process error: No success file => build failure [2026-02-24 03:27:27,383][ INFO][PID:502849] Worker failed build, took 687.0893342494965 [2026-02-24 03:27:27,384][ INFO][PID:502849] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "starfish", "project_name": "dlib", "project_dirname": "dlib", "submitter": "starfish", "ended_on": 1771903647.3837905, "started_on": 1771902960.2944562, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10162308-fedora-rawhide-s390x", "build_id": 10162308, "package_name": "dlib", "package_version": "20.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/starfish/dlib/dlib", "git_hash": "d13dd379e0a899e536717b326fbc49f1a5713818", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "starfish/dlib--starfish", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/starfish/dlib/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 98 } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": 98, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/starfish/dlib", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/starfish/dlib", "result_dir": "10162308-dlib", "built_packages": "", "id": 10162308, "mockchain_macros": { "copr_username": "starfish", "copr_projectname": "dlib", "vendor": "Fedora Project COPR (starfish/dlib)" } } ] } [2026-02-24 03:27:27,433][ INFO][PID:502849] Sending fedora-messaging bus message in build.end [2026-02-24 03:27:27,461][ INFO][PID:502849] Compressing /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/builder-live.log by gzip [2026-02-24 03:27:27,462][ INFO][PID:502849] Running command 'gzip /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/builder-live.log' as PID 533145 [2026-02-24 03:27:27,706][ INFO][PID:502849] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/builder-live.log) [2026-02-24 03:27:27,707][ INFO][PID:502849] Compressing /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/backend.log by gzip [2026-02-24 03:27:27,708][ INFO][PID:502849] Running command 'gzip /var/lib/copr/public_html/results/starfish/dlib/fedora-rawhide-s390x/10162308-dlib/backend.log' as PID 533180