[2026-03-09 18:02:55,850][ INFO][PID:726230] Marking build as starting [2026-03-09 18:02:55,932][ INFO][PID:726230] Checking that /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/repodata/repomd.xml exists [2026-03-09 18:02:55,933][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:02:55,934][ INFO][PID:726230] VM allocation process starts [2026-03-09 18:02:55,965][ INFO][PID:726230] Trying to allocate VM: ResallocHost, ticket_id=1781614, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 18:03:00,967][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:06,029][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:08,008][ INFO][PID:726230] Allocated host ResallocHost, ticket_id=1781614, hostname=34.207.118.95, name=aws_x86_64_spot_prod_02952619_20260309_175746, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 18:03:08,009][ INFO][PID:726230] Allocating ssh connection to builder [2026-03-09 18:03:08,009][ INFO][PID:726230] Checking that builder machine is OK [2026-03-09 18:03:08,324][ INFO][PID:726230] Running remote command: copr-builder-ready epel-10-x86_64 [2026-03-09 18:03:08,519][ INFO][PID:726230] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-03-09 18:03:08,520][ INFO][PID:726230] Filling build.info file with builder info [2026-03-09 18:03:08,555][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:08,557][ INFO][PID:726230] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@oisf", "project_name": "suricata-8.0-testing", "project_dirname": "suricata-8.0-testing", "submitter": "jasonish", "ended_on": null, "started_on": 1773079388.5569868, "submitted_on": null, "status": 3, "chroot": "epel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10204643-epel-10-x86_64", "build_id": 10204643, "package_name": "suricata", "package_version": "1:8.0.4-0.202603091136", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@oisf/suricata-8.0-testing/suricata", "git_hash": "dfedd8047d9d2f05a17191024c0c37e8cbce6b8d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@oisf/suricata-8.0-testing--jasonish", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@oisf/suricata-8.0-testing/epel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@oisf/suricata-8.0-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@oisf/suricata-8.0-testing", "result_dir": "10204643-suricata", "built_packages": "", "id": 10204643, "mockchain_macros": { "copr_username": "@oisf", "copr_projectname": "suricata-8.0-testing", "vendor": "Fedora Project COPR (@oisf/suricata-8.0-testing)" } } ] } [2026-03-09 18:03:08,614][ INFO][PID:726230] Sending fedora-messaging bus message in build.start [2026-03-09 18:03:09,393][ INFO][PID:726230] Sending fedora-messaging bus message in chroot.start [2026-03-09 18:03:09,473][ INFO][PID:726230] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10204643-epel-10-x86_64 --chroot epel-10-x86_64 --detached [2026-03-09 18:03:09,798][ INFO][PID:726230] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.207.118.95' (ED25519) to the list of known hosts. [2026-03-09 18:03:09,800][ INFO][PID:726230] Downloading the builder-live.log file, attempt 1 [2026-03-09 18:03:09,802][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.207.118.95 copr-rpmbuild-log [2026-03-09 18:03:14,809][ INFO][PID:726230] Periodic builder liveness probe: alive [2026-03-09 18:03:14,810][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:19,811][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:24,812][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:29,813][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:34,814][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:39,815][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:44,816][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:49,816][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:54,817][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:03:59,818][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:04,819][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:09,821][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:14,822][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:19,823][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:24,824][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:29,825][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:34,826][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:39,828][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:44,829][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:49,829][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:54,831][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:04:57,066][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:04:59,832][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:04,833][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:07,067][WARNING][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 18:05:09,834][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:14,835][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:17,070][ INFO][PID:726230] Downloading the builder-live.log file, attempt 2 [2026-03-09 18:05:17,071][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.207.118.95 copr-rpmbuild-log [2026-03-09 18:05:19,842][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:24,846][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:29,847][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:34,848][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:39,849][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:44,852][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:49,853][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:54,854][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:05:59,855][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:04,856][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:09,857][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:14,859][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:17,139][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:06:19,860][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:24,861][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:27,174][WARNING][PID:726230] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 18:06:29,862][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:34,863][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:37,175][ INFO][PID:726230] Downloading the builder-live.log file, attempt 3 [2026-03-09 18:06:37,469][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.207.118.95 copr-rpmbuild-log [2026-03-09 18:06:39,864][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:44,865][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:49,867][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:54,869][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:06:59,871][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:04,873][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:09,874][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:14,876][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:19,879][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:24,884][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:29,886][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:34,887][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:37,538][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:07:39,888][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:44,890][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:47,544][WARNING][PID:726230] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 18:07:49,891][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:54,893][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:07:57,545][ INFO][PID:726230] Downloading the builder-live.log file, attempt 4 [2026-03-09 18:07:57,547][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.207.118.95 copr-rpmbuild-log [2026-03-09 18:07:59,897][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:04,898][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:09,901][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:14,904][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:19,906][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:24,909][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:29,911][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:34,913][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:39,921][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:44,927][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:49,930][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:54,934][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:08:57,614][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:08:59,939][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:04,943][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:07,625][ ERROR][PID:726230] Giving up for unstable SSH, failures: 1773079507.067758, 1773079587.1741395, 1773079667.5447023, 1773079747.6253386 [2026-03-09 18:09:07,626][ ERROR][PID:726230] Re-try request for task on 'ResallocHost, ticket_id=1781614, hostname=34.207.118.95, name=aws_x86_64_spot_prod_02952619_20260309_175746, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-03-09 18:09:07,627][ INFO][PID:726230] Releasing VM back to pool [2026-03-09 18:09:07,652][ INFO][PID:726230] Retry #1 (on other host) [2026-03-09 18:09:07,652][ INFO][PID:726230] Checking that /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/repodata/repomd.xml exists [2026-03-09 18:09:07,655][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:07,655][ INFO][PID:726230] VM allocation process starts [2026-03-09 18:09:07,678][ INFO][PID:726230] Trying to allocate VM: ResallocHost, ticket_id=1781751, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 18:09:12,680][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:13,746][ INFO][PID:726230] Allocated host ResallocHost, ticket_id=1781751, hostname=54.84.174.86, name=aws_x86_64_spot_prod_02953088_20260309_180624, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 18:09:13,747][ INFO][PID:726230] Allocating ssh connection to builder [2026-03-09 18:09:13,748][ INFO][PID:726230] Checking that builder machine is OK [2026-03-09 18:09:14,085][ INFO][PID:726230] Running remote command: copr-builder-ready epel-10-x86_64 [2026-03-09 18:09:14,303][ INFO][PID:726230] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-03-09 18:09:14,305][ INFO][PID:726230] Filling build.info file with builder info [2026-03-09 18:09:14,322][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:14,324][ INFO][PID:726230] Not re-notifying FE and msg buses for the new host. [2026-03-09 18:09:14,325][ INFO][PID:726230] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10204643-epel-10-x86_64 --chroot epel-10-x86_64 --detached [2026-03-09 18:09:14,671][ INFO][PID:726230] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.84.174.86' (ED25519) to the list of known hosts. [2026-03-09 18:09:14,674][ INFO][PID:726230] Downloading the builder-live.log file, attempt 1 [2026-03-09 18:09:14,682][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.84.174.86 copr-rpmbuild-log [2026-03-09 18:09:19,678][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:24,686][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:29,688][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:34,689][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:39,690][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:44,694][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:49,697][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:54,698][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:09:59,700][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:04,701][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:09,703][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:14,705][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:19,734][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:24,736][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:29,737][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:34,739][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:39,742][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:44,745][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:49,749][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:54,750][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:10:59,751][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:04,753][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:09,754][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:14,756][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:19,763][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:24,764][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:29,773][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:34,775][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:39,777][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:44,778][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:49,780][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:54,783][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:11:59,784][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:04,785][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:09,786][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:14,787][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:19,788][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:24,789][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:29,790][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:34,791][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:39,792][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:44,794][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:49,795][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:54,797][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:12:59,798][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:04,799][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:09,800][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:14,802][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:19,811][ INFO][PID:726230] Periodic builder liveness probe: alive [2026-03-09 18:13:19,812][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:24,812][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:29,814][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:34,815][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:39,816][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:44,817][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:49,819][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:54,820][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:13:59,821][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:04,825][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:09,829][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:14,830][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:19,856][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:24,859][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:29,860][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:34,884][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:39,885][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:44,887][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:49,888][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:51,280][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:14:54,890][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:14:59,893][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:01,281][WARNING][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 18:15:04,894][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:09,896][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:11,281][ INFO][PID:726230] Downloading the builder-live.log file, attempt 2 [2026-03-09 18:15:11,284][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.84.174.86 copr-rpmbuild-log [2026-03-09 18:15:14,898][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:19,899][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:24,901][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:29,902][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:34,906][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:39,908][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:44,909][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:49,910][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:54,911][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:15:59,912][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:04,914][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:09,916][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:11,354][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:16:14,918][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:19,919][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:21,371][WARNING][PID:726230] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 18:16:24,920][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:29,922][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:31,372][ INFO][PID:726230] Downloading the builder-live.log file, attempt 3 [2026-03-09 18:16:31,375][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.84.174.86 copr-rpmbuild-log [2026-03-09 18:16:34,923][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:39,924][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:44,925][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:49,926][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:54,927][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:16:59,928][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:04,929][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:09,946][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:14,947][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:19,948][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:24,949][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:29,950][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:31,443][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:17:34,951][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:39,952][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:41,468][WARNING][PID:726230] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-03-09 18:17:44,953][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:49,954][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:51,469][ INFO][PID:726230] Downloading the builder-live.log file, attempt 4 [2026-03-09 18:17:51,471][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.84.174.86 copr-rpmbuild-log [2026-03-09 18:17:54,955][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:17:59,957][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:04,958][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:09,961][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:14,967][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:19,968][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:24,969][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:29,970][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:34,972][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:39,977][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:44,979][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:49,982][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:51,541][ ERROR][PID:726230] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-03-09 18:18:54,984][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:18:59,992][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:01,543][ ERROR][PID:726230] Giving up for unstable SSH, failures: 1773080101.2811935, 1773080181.37139, 1773080261.4683902, 1773080341.543357 [2026-03-09 18:19:01,547][ ERROR][PID:726230] Re-try request for task on 'ResallocHost, ticket_id=1781751, hostname=54.84.174.86, name=aws_x86_64_spot_prod_02953088_20260309_180624, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-03-09 18:19:01,547][ INFO][PID:726230] Releasing VM back to pool [2026-03-09 18:19:01,559][ INFO][PID:726230] Retry #2 (on other host) [2026-03-09 18:19:01,559][ INFO][PID:726230] Checking that /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/repodata/repomd.xml exists [2026-03-09 18:19:01,585][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:01,587][ INFO][PID:726230] VM allocation process starts [2026-03-09 18:19:01,602][ INFO][PID:726230] Trying to allocate VM: ResallocHost, ticket_id=1781961, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 18:19:06,603][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:07,638][ INFO][PID:726230] Allocated host ResallocHost, ticket_id=1781961, hostname=54.234.121.226, name=aws_x86_64_normalreserved_prod_02953101_20260309_180648, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-09 18:19:07,639][ INFO][PID:726230] Allocating ssh connection to builder [2026-03-09 18:19:07,639][ INFO][PID:726230] Checking that builder machine is OK [2026-03-09 18:19:08,020][ INFO][PID:726230] Running remote command: copr-builder-ready epel-10-x86_64 [2026-03-09 18:19:08,262][ INFO][PID:726230] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-03-09 18:19:08,266][ INFO][PID:726230] Filling build.info file with builder info [2026-03-09 18:19:08,331][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:08,333][ INFO][PID:726230] Not re-notifying FE and msg buses for the new host. [2026-03-09 18:19:08,334][ INFO][PID:726230] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10204643-epel-10-x86_64 --chroot epel-10-x86_64 --detached [2026-03-09 18:19:08,731][ INFO][PID:726230] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.234.121.226' (ED25519) to the list of known hosts. [2026-03-09 18:19:08,734][ INFO][PID:726230] Downloading the builder-live.log file, attempt 1 [2026-03-09 18:19:08,738][ INFO][PID:726230] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.234.121.226 copr-rpmbuild-log [2026-03-09 18:19:13,735][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:18,736][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:23,738][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:28,740][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:33,741][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:38,897][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:43,899][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:48,906][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:53,908][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:19:58,910][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:03,917][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:08,925][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:13,927][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:18,928][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:23,986][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:29,005][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:34,006][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:39,008][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:44,010][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:49,012][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:54,013][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:20:59,014][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:04,015][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:09,017][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:14,040][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:19,041][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:24,042][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:29,048][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:34,049][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:39,050][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:44,171][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:49,182][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:54,183][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:21:59,184][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:04,257][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:09,258][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:14,259][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:19,291][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:24,294][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:29,297][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:34,298][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:39,302][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:44,305][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:49,306][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:54,338][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:22:59,339][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:04,340][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:09,341][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:14,342][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:19,343][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:24,351][ INFO][PID:726230] Periodic builder liveness probe: alive [2026-03-09 18:23:24,356][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:29,358][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:34,359][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:39,360][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:44,361][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:49,362][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:54,363][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:23:59,364][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:04,381][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:09,382][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:14,383][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:19,384][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:24,384][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:29,386][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:34,387][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:39,388][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:44,389][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:49,505][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:54,506][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:24:59,578][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:04,579][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:09,796][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:14,797][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:19,867][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:24,871][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:29,873][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:34,878][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:39,881][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:44,884][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:49,886][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:54,887][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:25:59,888][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:26:04,889][ INFO][PID:726230] Checking for cancel request [2026-03-09 18:26:08,134][ INFO][PID:726230] Downloading results from builder [2026-03-09 18:26:08,135][ INFO][PID:726230] rsyncing of mockbuilder@54.234.121.226:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata started [2026-03-09 18:26:08,136][ INFO][PID:726230] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.234.121.226:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/ &> /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/build-10204643.rsync.log [2026-03-09 18:26:08,916][ INFO][PID:726230] rsyncing finished. [2026-03-09 18:26:08,917][ INFO][PID:726230] Releasing VM back to pool [2026-03-09 18:26:08,928][ INFO][PID:726230] Searching for 'success' file in resultdir [2026-03-09 18:26:08,928][ INFO][PID:726230] Going to sign pkgs from source: 10204643-epel-10-x86_64 in chroot: /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64 [2026-03-09 18:26:08,929][ INFO][PID:726230] Calling '/bin/sign -u @oisf#suricata-8.0-testing@copr.fedorahosted.org -p' (attempt #1) [2026-03-09 18:26:09,202][ INFO][PID:726230] Calling '/bin/sign -4 -h sha256 -u @oisf#suricata-8.0-testing@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-8.0.4-0.202603091136.el10.src.rpm' (attempt #1) [2026-03-09 18:26:10,688][ INFO][PID:726230] signed rpm: /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-8.0.4-0.202603091136.el10.src.rpm [2026-03-09 18:26:10,689][ INFO][PID:726230] Calling '/bin/sign -4 -h sha256 -u @oisf#suricata-8.0-testing@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-8.0.4-0.202603091136.el10.x86_64.rpm' (attempt #1) [2026-03-09 18:26:11,606][ INFO][PID:726230] signed rpm: /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-8.0.4-0.202603091136.el10.x86_64.rpm [2026-03-09 18:26:11,606][ INFO][PID:726230] Calling '/bin/sign -4 -h sha256 -u @oisf#suricata-8.0-testing@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-debugsource-8.0.4-0.202603091136.el10.x86_64.rpm' (attempt #1) [2026-03-09 18:26:12,617][ INFO][PID:726230] signed rpm: /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-debugsource-8.0.4-0.202603091136.el10.x86_64.rpm [2026-03-09 18:26:12,618][ INFO][PID:726230] Calling '/bin/sign -4 -h sha256 -u @oisf#suricata-8.0-testing@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-debuginfo-8.0.4-0.202603091136.el10.x86_64.rpm' (attempt #1) [2026-03-09 18:26:14,450][ INFO][PID:726230] signed rpm: /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/suricata-debuginfo-8.0.4-0.202603091136.el10.x86_64.rpm [2026-03-09 18:26:14,451][ INFO][PID:726230] Sign done [2026-03-09 18:26:14,452][ INFO][PID:726230] Incremental createrepo run, adding 10204643-suricata into https://download.copr.fedorainfracloud.org/results/@oisf/suricata-8.0-testing/epel-10-x86_64, (auto-create-repo=True) [2026-03-09 18:26:14,453][ INFO][PID:726230] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64 --add 10204643-suricata --no-appstream-metadata' as PID 877457 [2026-03-09 18:26:15,469][ INFO][PID:726230] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64 --add 10204643-suricata --no-appstream-metadata) [2026-03-09 18:26:15,470][ INFO][PID:726230] Getting build details [2026-03-09 18:26:15,470][ INFO][PID:726230] Listing built binary packages in /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata [2026-03-09 18:26:15,471][ INFO][PID:726230] Built packages: ['suricata-debuginfo 8.0.4', 'suricata-debugsource 8.0.4', 'suricata 8.0.4'] [2026-03-09 18:26:15,471][ INFO][PID:726230] build details: {'built_packages': 'suricata-debuginfo 8.0.4\nsuricata-debugsource 8.0.4\nsuricata 8.0.4'} [2026-03-09 18:26:15,471][ INFO][PID:726230] Retrieving pubkey [2026-03-09 18:26:15,472][ INFO][PID:726230] Calling '/bin/sign -u @oisf#suricata-8.0-testing@copr.fedorahosted.org -p' (attempt #1) [2026-03-09 18:26:15,750][ INFO][PID:726230] Added pubkey for user @oisf project suricata-8.0-testing into: /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/pubkey.gpg [2026-03-09 18:26:15,750][ INFO][PID:726230] Finished build: id=10204643 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@oisf/suricata-8.0-testing chroot=epel-10-x86_64 [2026-03-09 18:26:15,752][ INFO][PID:726230] Worker succeeded build, took 427.419175863266 [2026-03-09 18:26:15,753][ INFO][PID:726230] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@oisf", "project_name": "suricata-8.0-testing", "project_dirname": "suricata-8.0-testing", "submitter": "jasonish", "ended_on": 1773080775.7524931, "started_on": 1773080348.3333173, "submitted_on": null, "status": 1, "chroot": "epel-10-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10204643-epel-10-x86_64", "build_id": 10204643, "package_name": "suricata", "package_version": "1:8.0.4-0.202603091136", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@oisf/suricata-8.0-testing/suricata", "git_hash": "dfedd8047d9d2f05a17191024c0c37e8cbce6b8d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@oisf/suricata-8.0-testing--jasonish", "results": { "packages": [ { "name": "suricata-debuginfo", "epoch": 1, "version": "8.0.4", "release": "0.202603091136.el10", "arch": "x86_64" }, { "name": "suricata-debugsource", "epoch": 1, "version": "8.0.4", "release": "0.202603091136.el10", "arch": "x86_64" }, { "name": "suricata", "epoch": 1, "version": "8.0.4", "release": "0.202603091136.el10", "arch": "src" }, { "name": "suricata", "epoch": 1, "version": "8.0.4", "release": "0.202603091136.el10", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@oisf/suricata-8.0-testing/epel-10-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@oisf/suricata-8.0-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@oisf/suricata-8.0-testing", "result_dir": "10204643-suricata", "built_packages": "suricata-debuginfo 8.0.4\nsuricata-debugsource 8.0.4\nsuricata 8.0.4", "id": 10204643, "mockchain_macros": { "copr_username": "@oisf", "copr_projectname": "suricata-8.0-testing", "vendor": "Fedora Project COPR (@oisf/suricata-8.0-testing)" } } ] } [2026-03-09 18:26:15,813][ INFO][PID:726230] Sending fedora-messaging bus message in build.end [2026-03-09 18:26:15,842][ INFO][PID:726230] Compressing /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/builder-live.log by gzip [2026-03-09 18:26:15,843][ INFO][PID:726230] Running command 'gzip /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/builder-live.log' as PID 877512 [2026-03-09 18:26:15,930][ INFO][PID:726230] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/builder-live.log) [2026-03-09 18:26:15,931][ INFO][PID:726230] Compressing /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/backend.log by gzip [2026-03-09 18:26:15,932][ INFO][PID:726230] Running command 'gzip /var/lib/copr/public_html/results/@oisf/suricata-8.0-testing/epel-10-x86_64/10204643-suricata/backend.log' as PID 877518