[2026-01-08 13:21:37,287][ INFO][PID:3020170] Marking build as starting [2026-01-08 13:21:37,486][ INFO][PID:3020170] Checking that /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/repodata/repomd.xml exists [2026-01-08 13:21:37,514][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:21:37,516][ INFO][PID:3020170] VM allocation process starts [2026-01-08 13:21:37,546][ INFO][PID:3020170] Trying to allocate VM: ResallocHost, ticket_id=714334, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-08 13:21:40,601][ INFO][PID:3020170] Allocated host ResallocHost, ticket_id=714334, hostname=52.23.238.21, name=aws_x86_64_spot_prod_01016450_20260108_131402, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-08 13:21:40,602][ INFO][PID:3020170] Allocating ssh connection to builder [2026-01-08 13:21:40,602][ INFO][PID:3020170] Checking that builder machine is OK [2026-01-08 13:21:40,812][ INFO][PID:3020170] Running remote command: copr-builder-ready openeuler-24.03-x86_64 [2026-01-08 13:21:41,036][ INFO][PID:3020170] Red Hat subscription not needed for openeuler-24.03-x86_64 Builder is ready to be used [2026-01-08 13:21:41,076][ INFO][PID:3020170] Filling build.info file with builder info [2026-01-08 13:21:41,198][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:21:41,202][ INFO][PID:3020170] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "victoriametrics", "project_name": "VictoriaLogs", "project_dirname": "VictoriaLogs", "submitter": "victoriametrics", "ended_on": null, "started_on": 1767878501.1999106, "submitted_on": null, "status": 3, "chroot": "openeuler-24.03-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9986813-openeuler-24.03-x86_64", "build_id": 9986813, "package_name": "vlogscli", "package_version": "1.43.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/victoriametrics/VictoriaLogs/vlogscli", "git_hash": "a5a634340be8787f202d4d3fc6975766c7fa59c7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "victoriametrics/VictoriaLogs--victoriametrics", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/victoriametrics/VictoriaLogs", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/victoriametrics/VictoriaLogs", "result_dir": "09986813-vlogscli", "built_packages": "", "id": 9986813, "mockchain_macros": { "copr_username": "victoriametrics", "copr_projectname": "VictoriaLogs", "vendor": "Fedora Project COPR (victoriametrics/VictoriaLogs)" } } ] } [2026-01-08 13:21:41,371][ INFO][PID:3020170] Sending fedora-messaging bus message in build.start [2026-01-08 13:21:42,073][ INFO][PID:3020170] Sending fedora-messaging bus message in chroot.start [2026-01-08 13:21:42,163][ INFO][PID:3020170] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9986813-openeuler-24.03-x86_64 --chroot openeuler-24.03-x86_64 --detached [2026-01-08 13:21:42,545][ INFO][PID:3020170] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '52.23.238.21' (ED25519) to the list of known hosts. [2026-01-08 13:21:42,548][ INFO][PID:3020170] Downloading the builder-live.log file, attempt 1 [2026-01-08 13:21:42,553][ INFO][PID:3020170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.23.238.21 copr-rpmbuild-log [2026-01-08 13:21:47,601][ INFO][PID:3020170] Periodic builder liveness probe: alive [2026-01-08 13:21:47,602][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:21:52,605][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:21:57,612][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:02,615][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:07,617][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:12,620][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:17,626][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:22,630][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:24,555][ ERROR][PID:3020170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-08 13:22:27,631][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:32,636][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:34,556][WARNING][PID:3020170] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-08 13:22:37,637][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:42,639][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:44,557][ INFO][PID:3020170] Downloading the builder-live.log file, attempt 2 [2026-01-08 13:22:44,563][ INFO][PID:3020170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.23.238.21 copr-rpmbuild-log [2026-01-08 13:22:44,589][ ERROR][PID:3020170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-08 13:22:47,642][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:52,644][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:22:54,680][WARNING][PID:3020170] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-08 13:22:57,645][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:02,650][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:04,681][ INFO][PID:3020170] Downloading the builder-live.log file, attempt 3 [2026-01-08 13:23:04,683][ INFO][PID:3020170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.23.238.21 copr-rpmbuild-log [2026-01-08 13:23:07,652][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:12,660][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:17,662][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:22,671][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:27,674][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:32,686][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:37,689][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:42,693][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:47,694][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:52,703][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:23:57,705][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:02,715][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:04,753][ ERROR][PID:3020170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-08 13:24:07,717][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:12,720][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:14,772][WARNING][PID:3020170] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-08 13:24:17,723][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:22,727][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:24,775][ INFO][PID:3020170] Downloading the builder-live.log file, attempt 4 [2026-01-08 13:24:24,779][ INFO][PID:3020170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.23.238.21 copr-rpmbuild-log [2026-01-08 13:24:27,734][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:32,736][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:37,737][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:42,740][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:47,742][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:52,751][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:24:57,753][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:02,755][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:07,756][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:12,760][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:17,762][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:22,764][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:24,879][ ERROR][PID:3020170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-08 13:25:27,778][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:32,780][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:34,893][ ERROR][PID:3020170] Giving up for unstable SSH, failures: 1767878554.5566957, 1767878574.6805089, 1767878654.771931, 1767878734.8931625 [2026-01-08 13:25:34,894][ ERROR][PID:3020170] Re-try request for task on 'ResallocHost, ticket_id=714334, hostname=52.23.238.21, name=aws_x86_64_spot_prod_01016450_20260108_131402, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-08 13:25:34,904][ INFO][PID:3020170] Releasing VM back to pool [2026-01-08 13:25:34,950][ INFO][PID:3020170] Retry #1 (on other host) [2026-01-08 13:25:34,950][ INFO][PID:3020170] Checking that /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/repodata/repomd.xml exists [2026-01-08 13:25:34,951][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:34,954][ INFO][PID:3020170] VM allocation process starts [2026-01-08 13:25:35,027][ INFO][PID:3020170] Trying to allocate VM: ResallocHost, ticket_id=714513, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-08 13:25:38,073][ INFO][PID:3020170] Allocated host ResallocHost, ticket_id=714513, hostname=54.226.98.94, name=aws_x86_64_normal_prod_01016235_20260108_130737, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-08 13:25:38,074][ INFO][PID:3020170] Allocating ssh connection to builder [2026-01-08 13:25:38,075][ INFO][PID:3020170] Checking that builder machine is OK [2026-01-08 13:25:38,461][ INFO][PID:3020170] Running remote command: copr-builder-ready openeuler-24.03-x86_64 [2026-01-08 13:25:38,711][ INFO][PID:3020170] Red Hat subscription not needed for openeuler-24.03-x86_64 Builder is ready to be used [2026-01-08 13:25:38,712][ INFO][PID:3020170] Filling build.info file with builder info [2026-01-08 13:25:38,731][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:38,732][ INFO][PID:3020170] Not re-notifying FE and msg buses for the new host. [2026-01-08 13:25:38,733][ INFO][PID:3020170] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9986813-openeuler-24.03-x86_64 --chroot openeuler-24.03-x86_64 --detached [2026-01-08 13:25:39,118][ INFO][PID:3020170] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.226.98.94' (ED25519) to the list of known hosts. [2026-01-08 13:25:39,120][ INFO][PID:3020170] Downloading the builder-live.log file, attempt 1 [2026-01-08 13:25:39,121][ INFO][PID:3020170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.226.98.94 copr-rpmbuild-log [2026-01-08 13:25:44,120][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:49,124][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:54,125][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:25:59,127][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:04,135][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:09,136][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:14,137][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:19,138][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:24,139][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:29,140][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:34,142][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:39,144][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:44,146][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:49,147][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:54,148][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:26:59,149][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:04,150][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:09,151][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:14,153][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:19,155][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:24,157][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:29,159][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:34,160][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:39,162][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:44,163][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:49,164][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:54,165][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:27:59,167][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:04,168][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:09,177][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:14,179][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:19,180][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:24,182][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:29,184][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:34,186][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:39,187][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:44,188][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:49,189][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:54,192][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:28:59,194][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:29:04,196][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:29:09,218][ INFO][PID:3020170] Checking for cancel request [2026-01-08 13:29:10,076][ INFO][PID:3020170] Downloading results from builder [2026-01-08 13:29:10,077][ INFO][PID:3020170] rsyncing of mockbuilder@54.226.98.94:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli started [2026-01-08 13:29:10,078][ INFO][PID:3020170] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.226.98.94:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/ &> /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/build-09986813.rsync.log [2026-01-08 13:29:10,334][ INFO][PID:3020170] rsyncing finished. [2026-01-08 13:29:10,335][ INFO][PID:3020170] Releasing VM back to pool [2026-01-08 13:29:10,385][ INFO][PID:3020170] Searching for 'success' file in resultdir [2026-01-08 13:29:10,385][ ERROR][PID:3020170] Build failed: Backend process error: No success file => build failure [2026-01-08 13:29:10,386][ INFO][PID:3020170] Finished build: id=9986813 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/victoriametrics/VictoriaLogs chroot=openeuler-24.03-x86_64 [2026-01-08 13:29:10,389][ ERROR][PID:3020170] Backend process error: No success file => build failure [2026-01-08 13:29:10,389][ INFO][PID:3020170] Worker failed build, took 211.65735840797424 [2026-01-08 13:29:10,390][ INFO][PID:3020170] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "victoriametrics", "project_name": "VictoriaLogs", "project_dirname": "VictoriaLogs", "submitter": "victoriametrics", "ended_on": 1767878950.3895895, "started_on": 1767878738.7322311, "submitted_on": null, "status": 0, "chroot": "openeuler-24.03-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9986813-openeuler-24.03-x86_64", "build_id": 9986813, "package_name": "vlogscli", "package_version": "1.43.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/victoriametrics/VictoriaLogs/vlogscli", "git_hash": "a5a634340be8787f202d4d3fc6975766c7fa59c7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "victoriametrics/VictoriaLogs--victoriametrics", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/victoriametrics/VictoriaLogs", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/victoriametrics/VictoriaLogs", "result_dir": "09986813-vlogscli", "built_packages": "", "id": 9986813, "mockchain_macros": { "copr_username": "victoriametrics", "copr_projectname": "VictoriaLogs", "vendor": "Fedora Project COPR (victoriametrics/VictoriaLogs)" } } ] } [2026-01-08 13:29:10,523][ INFO][PID:3020170] Sending fedora-messaging bus message in build.end [2026-01-08 13:29:10,554][ INFO][PID:3020170] Compressing /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/builder-live.log by gzip [2026-01-08 13:29:10,555][ INFO][PID:3020170] Running command 'gzip /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/builder-live.log' as PID 3092859 [2026-01-08 13:29:10,599][ INFO][PID:3020170] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/builder-live.log) [2026-01-08 13:29:10,600][ INFO][PID:3020170] Compressing /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/backend.log by gzip [2026-01-08 13:29:10,601][ INFO][PID:3020170] Running command 'gzip /var/lib/copr/public_html/results/victoriametrics/VictoriaLogs/openeuler-24.03-x86_64/09986813-vlogscli/backend.log' as PID 3092867