[2025-12-28 05:15:17,342][ INFO][PID:810523] Marking build as starting [2025-12-28 05:15:17,418][ INFO][PID:810523] Checking that /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-28 05:15:17,422][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:17,427][ INFO][PID:810523] VM allocation process starts [2025-12-28 05:15:17,451][ INFO][PID:810523] Trying to allocate VM: ResallocHost, ticket_id=541620, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-28 05:15:20,475][ INFO][PID:810523] Allocated host ResallocHost, ticket_id=541620, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_00796379_20251228_044520, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-28 05:15:20,475][ INFO][PID:810523] Allocating ssh connection to builder [2025-12-28 05:15:20,476][ INFO][PID:810523] Checking that builder machine is OK [2025-12-28 05:15:21,482][ INFO][PID:810523] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-28 05:15:22,134][ INFO][PID:810523] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-28 05:15:22,135][ INFO][PID:810523] Filling build.info file with builder info [2025-12-28 05:15:22,136][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:22,139][ INFO][PID:810523] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "topazus", "project_name": "test-review", "project_dirname": "test-review", "submitter": "topazus", "ended_on": null, "started_on": 1766898922.139755, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9954257-fedora-41-ppc64le", "build_id": 9954257, "package_name": "python-uncertainties", "package_version": "3.2.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test-review/python-uncertainties", "git_hash": "fe8960b14610f5956677ab36fceee1e00d49fd1e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "topazus/test-review--topazus", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-41-ppc64le/", "id": "copr_topazus_test_review", "name": "Additional repo copr_topazus_test_review" } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/topazus/test-review", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test-review", "result_dir": "09954257-python-uncertainties", "built_packages": "", "id": 9954257, "mockchain_macros": { "copr_username": "topazus", "copr_projectname": "test-review", "vendor": "Fedora Project COPR (topazus/test-review)" } } ] } [2025-12-28 05:15:22,307][ INFO][PID:810523] Sending fedora-messaging bus message in build.start [2025-12-28 05:15:23,283][ INFO][PID:810523] Sending fedora-messaging bus message in chroot.start [2025-12-28 05:15:23,331][ INFO][PID:810523] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9954257-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-28 05:15:24,329][ INFO][PID:810523] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c149' (ED25519) to the list of known hosts. [2025-12-28 05:15:24,331][ INFO][PID:810523] Downloading the builder-live.log file, attempt 1 [2025-12-28 05:15:24,333][ INFO][PID:810523] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-12-28 05:15:29,377][ INFO][PID:810523] Periodic builder liveness probe: alive [2025-12-28 05:15:29,379][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:34,380][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:39,381][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:44,383][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:49,383][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:54,384][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:15:59,386][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:04,387][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:09,388][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:14,389][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:19,390][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:24,391][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:29,414][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:34,416][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:39,418][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:44,420][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:49,421][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:54,422][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:16:59,423][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:04,424][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:09,472][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:14,473][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:19,474][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:24,475][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:29,476][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:34,477][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:39,480][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:44,482][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:49,484][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:54,485][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:17:59,486][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:04,487][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:09,488][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:14,489][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:19,490][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:24,491][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:29,492][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:34,493][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:39,495][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:44,497][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:49,498][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:54,498][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:18:59,499][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:04,501][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:09,502][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:14,502][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:19,504][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:24,504][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:29,505][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:34,506][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:39,507][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:44,508][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:49,509][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:54,510][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:19:59,511][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:04,512][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:09,513][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:14,514][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:19,515][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:24,516][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:29,517][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:34,518][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:39,518][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:44,519][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:49,520][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:54,521][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:20:59,522][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:04,523][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:09,524][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:14,525][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:19,525][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:24,526][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:29,527][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:34,528][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:39,529][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:44,530][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:49,531][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:54,532][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:21:59,533][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:04,533][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:09,534][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:14,535][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:19,536][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:24,537][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:29,538][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:34,539][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:39,540][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:44,541][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:49,542][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:54,543][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:22:59,544][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:04,545][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:09,546][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:14,547][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:19,548][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:24,549][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:29,549][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:34,550][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:39,551][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:44,552][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:49,553][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:54,554][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:23:59,555][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:04,556][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:09,557][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:14,558][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:19,559][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:24,560][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:29,561][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:34,562][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:39,563][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:44,564][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:49,565][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:54,566][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:24:59,567][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:04,568][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:09,569][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:14,570][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:19,570][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:24,571][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:29,577][ INFO][PID:810523] Periodic builder liveness probe: alive [2025-12-28 05:25:29,578][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:34,579][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:39,580][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:44,581][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:49,582][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:54,583][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:25:59,584][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:04,585][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:09,586][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:14,586][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:19,587][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:24,588][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:29,589][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:34,590][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:39,591][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:44,592][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:49,593][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:54,594][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:26:59,595][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:04,596][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:09,597][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:14,598][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:19,599][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:24,600][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:29,601][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:34,735][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:39,736][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:44,737][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:49,737][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:54,738][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:27:59,739][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:28:04,740][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:28:09,741][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:28:14,742][ INFO][PID:810523] Checking for cancel request [2025-12-28 05:28:14,873][ INFO][PID:810523] Downloading results from builder [2025-12-28 05:28:14,874][ INFO][PID:810523] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties started [2025-12-28 05:28:14,875][ INFO][PID:810523] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/ &> /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/build-09954257.rsync.log [2025-12-28 05:28:15,558][ INFO][PID:810523] rsyncing finished. [2025-12-28 05:28:15,558][ INFO][PID:810523] Releasing VM back to pool [2025-12-28 05:28:15,581][ INFO][PID:810523] Searching for 'success' file in resultdir [2025-12-28 05:28:15,581][ ERROR][PID:810523] Build failed: Backend process error: No success file => build failure [2025-12-28 05:28:15,582][ INFO][PID:810523] Finished build: id=9954257 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/topazus/test-review chroot=fedora-41-ppc64le [2025-12-28 05:28:15,583][ ERROR][PID:810523] Backend process error: No success file => build failure [2025-12-28 05:28:15,583][ INFO][PID:810523] Worker failed build, took 773.4441449642181 [2025-12-28 05:28:15,584][ INFO][PID:810523] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "topazus", "project_name": "test-review", "project_dirname": "test-review", "submitter": "topazus", "ended_on": 1766899695.5839, "started_on": 1766898922.139755, "submitted_on": null, "status": 0, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9954257-fedora-41-ppc64le", "build_id": 9954257, "package_name": "python-uncertainties", "package_version": "3.2.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test-review/python-uncertainties", "git_hash": "fe8960b14610f5956677ab36fceee1e00d49fd1e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "topazus/test-review--topazus", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test-review/fedora-41-ppc64le/", "id": "copr_topazus_test_review", "name": "Additional repo copr_topazus_test_review" } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/topazus/test-review", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test-review", "result_dir": "09954257-python-uncertainties", "built_packages": "", "id": 9954257, "mockchain_macros": { "copr_username": "topazus", "copr_projectname": "test-review", "vendor": "Fedora Project COPR (topazus/test-review)" } } ] } [2025-12-28 05:28:15,641][ INFO][PID:810523] Sending fedora-messaging bus message in build.end [2025-12-28 05:28:15,667][ INFO][PID:810523] Compressing /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/builder-live.log by gzip [2025-12-28 05:28:15,668][ INFO][PID:810523] Running command 'gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/builder-live.log' as PID 871104 [2025-12-28 05:28:15,829][ INFO][PID:810523] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/builder-live.log) [2025-12-28 05:28:15,829][ INFO][PID:810523] Compressing /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/backend.log by gzip [2025-12-28 05:28:15,830][ INFO][PID:810523] Running command 'gzip /var/lib/copr/public_html/results/topazus/test-review/fedora-41-ppc64le/09954257-python-uncertainties/backend.log' as PID 871117