[2026-02-12 15:04:49,332][ INFO][PID:358188] Marking build as starting [2026-02-12 15:04:49,423][ INFO][PID:358188] Checking that /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/repodata/repomd.xml exists [2026-02-12 15:04:49,436][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:04:49,439][ INFO][PID:358188] VM allocation process starts [2026-02-12 15:04:49,485][ INFO][PID:358188] Trying to allocate VM: ResallocHost, ticket_id=1297601, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-02-12 15:04:52,509][ INFO][PID:358188] Allocated host ResallocHost, ticket_id=1297601, hostname=2620:52:6:1161:dead:beef:cafe:c196, name=vmhost_p09_04_prod_02217241_20260212_145439, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-02-12 15:04:52,509][ INFO][PID:358188] Allocating ssh connection to builder [2026-02-12 15:04:52,510][ INFO][PID:358188] Checking that builder machine is OK [2026-02-12 15:04:53,463][ INFO][PID:358188] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-02-12 15:04:54,144][ INFO][PID:358188] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-02-12 15:04:54,146][ INFO][PID:358188] Filling build.info file with builder info [2026-02-12 15:04:54,147][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:04:54,155][ INFO][PID:358188] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": null, "started_on": 1770908694.1548405, "submitted_on": null, "status": 3, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10122100-fedora-43-ppc64le", "build_id": 10122100, "package_name": "koji-image-builder", "package_version": "10-1.20260212150302514880.main.2.gc7771d4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/koji-image-builder", "git_hash": "48bad961b3da4d7efca398f8236d75cfebaea121", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "10122100-koji-image-builder", "built_packages": "", "id": 10122100, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2026-02-12 15:04:54,387][ INFO][PID:358188] Sending fedora-messaging bus message in build.start [2026-02-12 15:04:55,194][ INFO][PID:358188] Sending fedora-messaging bus message in chroot.start [2026-02-12 15:04:55,225][ INFO][PID:358188] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10122100-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-02-12 15:04:56,198][ INFO][PID:358188] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts. [2026-02-12 15:04:56,200][ INFO][PID:358188] Downloading the builder-live.log file, attempt 1 [2026-02-12 15:04:56,207][ INFO][PID:358188] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c196 copr-rpmbuild-log [2026-02-12 15:05:01,208][ INFO][PID:358188] Periodic builder liveness probe: alive [2026-02-12 15:05:01,412][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:06,414][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:11,415][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:16,416][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:21,418][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:26,419][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:31,420][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:36,422][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:41,424][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:46,426][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:51,428][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:05:56,339][ ERROR][PID:358188] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-12 15:05:56,431][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:01,433][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:06,345][WARNING][PID:358188] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-12 15:06:06,436][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:11,463][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:16,462][ INFO][PID:358188] Downloading the builder-live.log file, attempt 2 [2026-02-12 15:06:16,481][ INFO][PID:358188] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c196 copr-rpmbuild-log [2026-02-12 15:06:16,699][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:21,931][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:26,939][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:32,282][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:37,303][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:42,386][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:47,446][ INFO][PID:358188] Checking for cancel request [2026-02-12 15:06:49,555][ INFO][PID:358188] Downloading results from builder [2026-02-12 15:06:49,556][ INFO][PID:358188] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder started [2026-02-12 15:06:49,558][ INFO][PID:358188] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/build-10122100.rsync.log [2026-02-12 15:07:49,693][ INFO][PID:358188] rsyncing finished. [2026-02-12 15:07:49,750][ ERROR][PID:358188] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-12 15:07:49,751][ ERROR][PID:358188] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-02-12 15:07:59,753][ INFO][PID:358188] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder started [2026-02-12 15:07:59,754][ INFO][PID:358188] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/build-10122100.rsync.log [2026-02-12 15:08:01,081][ INFO][PID:358188] rsyncing finished. [2026-02-12 15:08:01,082][ INFO][PID:358188] Releasing VM back to pool [2026-02-12 15:08:01,105][ INFO][PID:358188] Searching for 'success' file in resultdir [2026-02-12 15:08:01,106][ INFO][PID:358188] Going to sign pkgs from source: 10122100-fedora-43-ppc64le in chroot: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le [2026-02-12 15:08:01,107][ INFO][PID:358188] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2026-02-12 15:08:01,291][ INFO][PID:358188] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-hub-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm' (attempt #1) [2026-02-12 15:08:02,010][ INFO][PID:358188] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-hub-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm [2026-02-12 15:08:02,019][ INFO][PID:358188] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm' (attempt #1) [2026-02-12 15:08:02,992][ INFO][PID:358188] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm [2026-02-12 15:08:02,994][ INFO][PID:358188] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-10-1.20260212150302514880.main.2.gc7771d4.fc43.src.rpm' (attempt #1) [2026-02-12 15:08:04,960][ INFO][PID:358188] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-10-1.20260212150302514880.main.2.gc7771d4.fc43.src.rpm [2026-02-12 15:08:04,961][ INFO][PID:358188] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-builder-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm' (attempt #1) [2026-02-12 15:08:05,691][ INFO][PID:358188] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-builder-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm [2026-02-12 15:08:05,692][ INFO][PID:358188] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-cli-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm' (attempt #1) [2026-02-12 15:08:06,415][ INFO][PID:358188] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/koji-image-builder-cli-10-1.20260212150302514880.main.2.gc7771d4.fc43.noarch.rpm [2026-02-12 15:08:06,416][ INFO][PID:358188] Sign done [2026-02-12 15:08:06,417][ INFO][PID:358188] Incremental createrepo run, adding 10122100-koji-image-builder into https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-43-ppc64le, (auto-create-repo=True) [2026-02-12 15:08:06,425][ INFO][PID:358188] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le --add 10122100-koji-image-builder --no-appstream-metadata' as PID 394809 [2026-02-12 15:08:07,897][ INFO][PID:358188] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le --add 10122100-koji-image-builder --no-appstream-metadata) [2026-02-12 15:08:07,898][ INFO][PID:358188] Getting build details [2026-02-12 15:08:07,902][ INFO][PID:358188] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder [2026-02-12 15:08:07,902][ INFO][PID:358188] Built packages: ['koji-image-builder-hub 10', 'koji-image-builder-cli 10', 'koji-image-builder 10', 'koji-image-builder-builder 10'] [2026-02-12 15:08:07,904][ INFO][PID:358188] build details: {'built_packages': 'koji-image-builder-hub 10\nkoji-image-builder-cli 10\nkoji-image-builder 10\nkoji-image-builder-builder 10'} [2026-02-12 15:08:07,906][ INFO][PID:358188] Retrieving pubkey [2026-02-12 15:08:07,907][ INFO][PID:358188] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2026-02-12 15:08:08,208][ INFO][PID:358188] Added pubkey for user @osbuild project image-builder into: /var/lib/copr/public_html/results/@osbuild/image-builder/pubkey.gpg [2026-02-12 15:08:08,211][ INFO][PID:358188] Finished build: id=10122100 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/image-builder chroot=fedora-43-ppc64le [2026-02-12 15:08:08,217][ INFO][PID:358188] Worker succeeded build, took 194.06256079673767 [2026-02-12 15:08:08,223][ INFO][PID:358188] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": 1770908888.2174013, "started_on": 1770908694.1548405, "submitted_on": null, "status": 1, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10122100-fedora-43-ppc64le", "build_id": 10122100, "package_name": "koji-image-builder", "package_version": "10-1.20260212150302514880.main.2.gc7771d4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/koji-image-builder", "git_hash": "48bad961b3da4d7efca398f8236d75cfebaea121", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": { "packages": [ { "name": "koji-image-builder-hub", "epoch": null, "version": "10", "release": "1.20260212150302514880.main.2.gc7771d4.fc43", "arch": "noarch" }, { "name": "koji-image-builder-cli", "epoch": null, "version": "10", "release": "1.20260212150302514880.main.2.gc7771d4.fc43", "arch": "noarch" }, { "name": "koji-image-builder", "epoch": null, "version": "10", "release": "1.20260212150302514880.main.2.gc7771d4.fc43", "arch": "src" }, { "name": "koji-image-builder", "epoch": null, "version": "10", "release": "1.20260212150302514880.main.2.gc7771d4.fc43", "arch": "noarch" }, { "name": "koji-image-builder-builder", "epoch": null, "version": "10", "release": "1.20260212150302514880.main.2.gc7771d4.fc43", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "10122100-koji-image-builder", "built_packages": "koji-image-builder-hub 10\nkoji-image-builder-cli 10\nkoji-image-builder 10\nkoji-image-builder-builder 10", "id": 10122100, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2026-02-12 15:08:08,347][ INFO][PID:358188] Sending fedora-messaging bus message in build.end [2026-02-12 15:08:08,385][ INFO][PID:358188] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/builder-live.log by gzip [2026-02-12 15:08:08,387][ INFO][PID:358188] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/builder-live.log' as PID 395146 [2026-02-12 15:08:08,475][ INFO][PID:358188] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/builder-live.log) [2026-02-12 15:08:08,476][ INFO][PID:358188] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/backend.log by gzip [2026-02-12 15:08:08,478][ INFO][PID:358188] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-43-ppc64le/10122100-koji-image-builder/backend.log' as PID 395172