[2026-07-07 12:39:57,421][ INFO][PID:2281035] Marking build as starting [2026-07-07 12:39:57,467][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:39:57,471][ INFO][PID:2281035] VM allocation process starts [2026-07-07 12:39:57,522][ INFO][PID:2281035] Trying to allocate VM: ResallocHost, ticket_id=3793087, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-07 12:40:00,540][ INFO][PID:2281035] Allocated host ResallocHost, ticket_id=3793087, hostname=100.31.143.102, name=aws_x86_64_spot_prod_12934200_20260707_123503, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-07 12:40:00,541][ INFO][PID:2281035] Allocating ssh connection to builder [2026-07-07 12:40:00,542][ INFO][PID:2281035] Checking that builder machine is OK [2026-07-07 12:40:00,880][ INFO][PID:2281035] Installed copr-rpmbuild version: 1.8 [2026-07-07 12:40:00,881][ INFO][PID:2281035] Running remote command: copr-builder-ready srpm-builds [2026-07-07 12:40:01,069][ INFO][PID:2281035] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-07-07 12:40:01,070][ INFO][PID:2281035] Filling build.info file with builder info [2026-07-07 12:40:01,071][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:01,072][ INFO][PID:2281035] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@oamg", "project_name": "leapp", "project_dirname": "leapp", "submitter": "packit", "ended_on": null, "started_on": 1783428001.0723872, "submitted_on": null, "status": 3, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "10693217", "build_id": 10693217, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"\\n#!/bin/sh\\n\\ngit config --global user.email \\\"hello@packit.dev\\\"\\ngit config --global user.name \\\"Packit\\\"\\nresultdir=$PWD\\npackit -d prepare-sources --result-dir \\\"$resultdir\\\" --pr-id 1554 --no-merge-pr --job-config-index 0 --merged-ref 'main' --no-create-symlinks https://github.com/oamg/leapp-repository\\n\\n\", \"chroot\": \"fedora-44-x86_64\", \"builddeps\": \"packit make\", \"resultdir\": null, \"repos\": \"copr://packit/packit-stable\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@oamg/leapp--packit", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/packit-stable/fedora-44-x86_64/", "id": "copr_packit_packit_stable", "name": "Additional repo copr_packit_packit_stable" } ], "background": false, "distributions_in_build": [ "epel-8", "epel-9" ], "distributions_in_project": [ "epel-7", "epel-8", "epel-9", "fedora-43", "fedora-44", "fedora-rawhide" ], "destdir": "/var/lib/copr/public_html/results/@oamg/leapp", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@oamg/leapp", "result_dir": "10693217", "built_packages": "", "tags": [ "arch_x86_64" ], "rpmeta_prediction": null, "id": 10693217, "mockchain_macros": { "copr_username": "@oamg", "copr_projectname": "leapp", "vendor": "Fedora Project COPR (@oamg/leapp)" } } ] } [2026-07-07 12:40:01,125][ INFO][PID:2281035] Sending fedora-messaging bus message in build.start [2026-07-07 12:40:01,628][ INFO][PID:2281035] Sending fedora-messaging bus message in chroot.start [2026-07-07 12:40:01,660][ INFO][PID:2281035] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/10693217 --detached [2026-07-07 12:40:02,100][ INFO][PID:2281035] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.31.143.102' (ED25519) to the list of known hosts. [2026-07-07 12:40:02,102][ INFO][PID:2281035] Downloading the builder-live.log file, attempt 1 [2026-07-07 12:40:02,103][ INFO][PID:2281035] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.31.143.102 copr-rpmbuild-log [2026-07-07 12:40:07,141][ INFO][PID:2281035] Periodic builder liveness probe: alive [2026-07-07 12:40:07,142][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:12,143][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:17,147][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:22,160][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:27,164][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:32,166][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:37,167][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:42,169][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:47,170][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:52,172][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:40:54,868][ ERROR][PID:2281035] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-07 12:40:57,174][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:02,175][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:04,880][WARNING][PID:2281035] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-07 12:41:07,176][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:12,177][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:14,884][ INFO][PID:2281035] Downloading the builder-live.log file, attempt 2 [2026-07-07 12:41:14,886][ INFO][PID:2281035] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.31.143.102 copr-rpmbuild-log [2026-07-07 12:41:17,179][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:22,182][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:27,183][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:32,185][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:37,187][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:42,188][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:47,193][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:52,194][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:41:57,196][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:02,198][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:07,205][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:12,206][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:14,954][ ERROR][PID:2281035] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-07 12:42:17,209][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:22,210][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:24,964][WARNING][PID:2281035] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-07 12:42:27,212][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:32,213][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:34,965][ INFO][PID:2281035] Downloading the builder-live.log file, attempt 3 [2026-07-07 12:42:34,967][ INFO][PID:2281035] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.31.143.102 copr-rpmbuild-log [2026-07-07 12:42:37,215][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:42,220][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:47,224][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:52,228][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:42:57,229][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:02,232][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:07,235][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:12,237][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:17,238][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:22,239][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:27,241][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:32,243][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:35,035][ ERROR][PID:2281035] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-07 12:43:37,246][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:42,247][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:45,047][WARNING][PID:2281035] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-07-07 12:43:47,256][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:52,258][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:43:55,048][ INFO][PID:2281035] Downloading the builder-live.log file, attempt 4 [2026-07-07 12:43:55,055][ INFO][PID:2281035] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.31.143.102 copr-rpmbuild-log [2026-07-07 12:43:57,263][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:02,267][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:07,268][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:12,272][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:17,275][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:22,277][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:27,279][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:32,280][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:37,281][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:42,283][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:47,284][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:52,286][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:44:55,126][ ERROR][PID:2281035] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-07-07 12:44:57,288][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:02,289][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:05,134][ ERROR][PID:2281035] Giving up for unstable SSH, failures: 1783428064.8794198, 1783428144.9642687, 1783428225.0474136, 1783428305.13413 [2026-07-07 12:45:05,154][ ERROR][PID:2281035] Re-try request for task on 'ResallocHost, ticket_id=3793087, hostname=100.31.143.102, name=aws_x86_64_spot_prod_12934200_20260707_123503, requested_tags=['arch_x86_64', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-07-07 12:45:05,170][ INFO][PID:2281035] VM Release request [2026-07-07 12:45:05,187][ INFO][PID:2281035] Retry #1 (on other host) [2026-07-07 12:45:05,188][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:05,189][ INFO][PID:2281035] VM allocation process starts [2026-07-07 12:45:05,206][ INFO][PID:2281035] Trying to allocate VM: ResallocHost, ticket_id=3793170, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-07 12:45:08,221][ INFO][PID:2281035] Allocated host ResallocHost, ticket_id=3793170, hostname=34.204.197.101, name=aws_x86_64_reserved_prod_12934459_20260707_124305, requested_tags=['arch_x86_64', 'copr_builder'] [2026-07-07 12:45:08,222][ INFO][PID:2281035] Allocating ssh connection to builder [2026-07-07 12:45:08,223][ INFO][PID:2281035] Checking that builder machine is OK [2026-07-07 12:45:08,530][ INFO][PID:2281035] Installed copr-rpmbuild version: 1.8 [2026-07-07 12:45:08,531][ INFO][PID:2281035] Running remote command: copr-builder-ready srpm-builds [2026-07-07 12:45:08,702][ INFO][PID:2281035] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-07-07 12:45:08,703][ INFO][PID:2281035] Filling build.info file with builder info [2026-07-07 12:45:08,715][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:08,716][ INFO][PID:2281035] Not re-notifying FE and msg buses for the new host. [2026-07-07 12:45:08,717][ INFO][PID:2281035] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/10693217 --detached [2026-07-07 12:45:09,181][ INFO][PID:2281035] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '34.204.197.101' (ED25519) to the list of known hosts. [2026-07-07 12:45:09,182][ INFO][PID:2281035] Downloading the builder-live.log file, attempt 1 [2026-07-07 12:45:09,184][ INFO][PID:2281035] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.204.197.101 copr-rpmbuild-log [2026-07-07 12:45:14,183][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:19,184][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:24,185][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:29,187][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:34,189][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:39,190][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:44,191][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:49,193][ INFO][PID:2281035] Checking for cancel request [2026-07-07 12:45:51,681][ INFO][PID:2281035] Downloading results from builder [2026-07-07 12:45:51,681][ INFO][PID:2281035] rsyncing of mockbuilder@34.204.197.101:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217 started [2026-07-07 12:45:51,683][ INFO][PID:2281035] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.204.197.101:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/ &> /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/build-10693217.rsync.log [2026-07-07 12:45:51,886][ INFO][PID:2281035] rsyncing finished. [2026-07-07 12:45:51,887][ INFO][PID:2281035] VM Release request [2026-07-07 12:45:51,899][ INFO][PID:2281035] Searching for 'success' file in resultdir [2026-07-07 12:45:51,900][ INFO][PID:2281035] Getting build details [2026-07-07 12:45:51,900][ INFO][PID:2281035] Retrieving SRPM info from /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217 [2026-07-07 12:45:51,902][ INFO][PID:2281035] SRPM URL: https://download.copr.fedorainfracloud.org/results/@oamg/leapp/srpm-builds/10693217/leapp-repository-0.24.0-0.20260707124548429725.pr1554.109.gabb19f93.src.rpm [2026-07-07 12:45:51,902][ INFO][PID:2281035] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/@oamg/leapp/srpm-builds/10693217/leapp-repository-0.24.0-0.20260707124548429725.pr1554.109.gabb19f93.src.rpm', 'pkg_name': 'leapp-repository', 'pkg_version': '0.24.0-0.20260707124548429725.pr1554.109.gabb19f93'} [2026-07-07 12:45:51,903][ INFO][PID:2281035] Finished build: id=10693217 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/@oamg/leapp chroot=srpm-builds [2026-07-07 12:45:51,905][ INFO][PID:2281035] Worker succeeded build, took 43.18958330154419 [2026-07-07 12:45:51,906][ INFO][PID:2281035] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "@oamg", "project_name": "leapp", "project_dirname": "leapp", "submitter": "packit", "ended_on": 1783428351.9059095, "started_on": 1783428308.7163262, "submitted_on": null, "status": 1, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "10693217", "build_id": 10693217, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"\\n#!/bin/sh\\n\\ngit config --global user.email \\\"hello@packit.dev\\\"\\ngit config --global user.name \\\"Packit\\\"\\nresultdir=$PWD\\npackit -d prepare-sources --result-dir \\\"$resultdir\\\" --pr-id 1554 --no-merge-pr --job-config-index 0 --merged-ref 'main' --no-create-symlinks https://github.com/oamg/leapp-repository\\n\\n\", \"chroot\": \"fedora-44-x86_64\", \"builddeps\": \"packit make\", \"resultdir\": null, \"repos\": \"copr://packit/packit-stable\"}", "pkg_name": "leapp-repository", "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": "https://download.copr.fedorainfracloud.org/results/@oamg/leapp/srpm-builds/10693217/leapp-repository-0.24.0-0.20260707124548429725.pr1554.109.gabb19f93.src.rpm", "uses_devel_repo": null, "sandbox": "@oamg/leapp--packit", "results": { "architecture_specific_tags": { "epel-8": { "buildarch": [ "noarch" ] }, "epel-9": { "buildarch": [ "noarch" ] } }, "name": "leapp-repository", "epoch": null, "version": "0.24.0", "release": "0.20260707124548429725.pr1554.109.gabb19f93" }, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/packit-stable/fedora-44-x86_64/", "id": "copr_packit_packit_stable", "name": "Additional repo copr_packit_packit_stable" } ], "background": false, "distributions_in_build": [ "epel-8", "epel-9" ], "distributions_in_project": [ "epel-7", "epel-8", "epel-9", "fedora-43", "fedora-44", "fedora-rawhide" ], "destdir": "/var/lib/copr/public_html/results/@oamg/leapp", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@oamg/leapp", "result_dir": "10693217", "built_packages": "", "tags": [ "arch_x86_64" ], "rpmeta_prediction": null, "pkg_version": "0.24.0-0.20260707124548429725.pr1554.109.gabb19f93", "id": 10693217, "mockchain_macros": { "copr_username": "@oamg", "copr_projectname": "leapp", "vendor": "Fedora Project COPR (@oamg/leapp)" } } ] } [2026-07-07 12:45:51,955][ INFO][PID:2281035] Sending fedora-messaging bus message in build.end [2026-07-07 12:45:51,987][ INFO][PID:2281035] Compressing /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/builder-live.log by gzip [2026-07-07 12:45:51,989][ INFO][PID:2281035] Running command 'gzip /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/builder-live.log' as PID 2328728 [2026-07-07 12:45:52,000][ INFO][PID:2281035] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/builder-live.log) [2026-07-07 12:45:52,001][ INFO][PID:2281035] Compressing /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/backend.log by gzip [2026-07-07 12:45:52,002][ INFO][PID:2281035] Running command 'gzip /var/lib/copr/public_html/results/@oamg/leapp/srpm-builds/10693217/backend.log' as PID 2328731