[2025-08-28 11:40:27,261][ INFO][PID:2711736] Marking build as starting [2025-08-28 11:40:27,363][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:40:27,364][ INFO][PID:2711736] VM allocation process starts [2025-08-28 11:40:27,376][ INFO][PID:2711736] Trying to allocate VM: ResallocHost, ticket_id=4799491, requested_tags=['copr_builder', 'arch_s390x'] [2025-08-28 11:40:30,391][ INFO][PID:2711736] Allocated host ResallocHost, ticket_id=4799491, hostname=13.116.88.74, name=copr_ic_s390x_br_sao_1_prod_06472637_20250828_112945, requested_tags=['copr_builder', 'arch_s390x'] [2025-08-28 11:40:30,392][ INFO][PID:2711736] Allocating ssh connection to builder [2025-08-28 11:40:30,392][ INFO][PID:2711736] Checking that builder machine is OK [2025-08-28 11:40:32,138][ INFO][PID:2711736] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-08-28 11:40:33,696][ INFO][PID:2711736] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-08-28 11:40:33,696][ INFO][PID:2711736] Filling build.info file with builder info [2025-08-28 11:40:33,697][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:40:33,699][ INFO][PID:2711736] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": null, "started_on": 1756381233.6988814, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9499499-fedora-rawhide-s390x", "build_id": 9499499, "package_name": "image-builder", "package_version": "32-1.20250828112832568739.main.1.g7a63097", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "4bd62ab108ea8434cbac1beb4a42f5ac0e9212d4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09499499-image-builder", "built_packages": "", "id": 9499499, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-08-28 11:40:33,762][ INFO][PID:2711736] Sending fedora-messaging bus message in build.start [2025-08-28 11:40:34,385][ INFO][PID:2711736] Sending fedora-messaging bus message in chroot.start [2025-08-28 11:40:34,409][ INFO][PID:2711736] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9499499-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-08-28 11:40:36,116][ INFO][PID:2711736] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.116.88.74' (ED25519) to the list of known hosts. [2025-08-28 11:40:36,117][ INFO][PID:2711736] Downloading the builder-live.log file, attempt 1 [2025-08-28 11:40:36,118][ INFO][PID:2711736] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.116.88.74 copr-rpmbuild-log [2025-08-28 11:40:41,122][ INFO][PID:2711736] Periodic builder liveness probe: alive [2025-08-28 11:40:41,123][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:40:46,124][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:40:51,125][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:40:56,126][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:01,127][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:06,128][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:11,129][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:16,130][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:21,131][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:26,132][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:31,133][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:36,134][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:41,135][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:46,136][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:51,137][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:41:56,138][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:01,139][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:06,140][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:11,141][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:16,142][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:21,143][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:26,144][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:31,145][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:36,146][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:41,147][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:46,148][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:51,149][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:42:56,150][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:01,151][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:06,152][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:11,153][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:16,154][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:21,155][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:26,156][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:31,157][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:36,158][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:41,159][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:46,160][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:51,161][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:43:56,162][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:01,163][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:06,164][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:11,165][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:16,166][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:21,167][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:26,172][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:31,174][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:36,174][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:41,175][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:46,176][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:51,177][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:44:56,178][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:01,179][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:06,180][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:11,181][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:16,182][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:21,183][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:26,184][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:31,185][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:36,186][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:41,188][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:46,190][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:51,191][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:45:56,192][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:01,193][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:06,195][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:11,196][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:16,199][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:21,200][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:26,201][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:31,202][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:36,203][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:41,204][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:46,205][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:51,206][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:46:56,207][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:01,208][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:06,209][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:11,211][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:16,214][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:21,215][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:26,216][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:31,217][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:36,218][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:41,219][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:46,220][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:51,221][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:47:56,222][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:01,223][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:06,224][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:11,226][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:16,227][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:21,228][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:26,230][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:31,233][ INFO][PID:2711736] Checking for cancel request [2025-08-28 11:48:34,967][ INFO][PID:2711736] Downloading results from builder [2025-08-28 11:48:34,967][ INFO][PID:2711736] rsyncing of mockbuilder@13.116.88.74:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder started [2025-08-28 11:48:34,968][ INFO][PID:2711736] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.116.88.74:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/build-09499499.rsync.log [2025-08-28 11:48:40,928][ INFO][PID:2711736] rsyncing finished. [2025-08-28 11:48:40,928][ INFO][PID:2711736] Releasing VM back to pool [2025-08-28 11:48:40,940][ INFO][PID:2711736] Searching for 'success' file in resultdir [2025-08-28 11:48:40,941][ INFO][PID:2711736] Going to sign pkgs from source: 9499499-fedora-rawhide-s390x in chroot: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x [2025-08-28 11:48:40,941][ INFO][PID:2711736] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-08-28 11:48:41,280][ INFO][PID:2711736] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-debuginfo-32-1.20250828112832568739.main.1.g7a63097.fc44.s390x.rpm' (attempt #1) [2025-08-28 11:48:42,521][ INFO][PID:2711736] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-debuginfo-32-1.20250828112832568739.main.1.g7a63097.fc44.s390x.rpm [2025-08-28 11:48:42,522][ INFO][PID:2711736] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-debugsource-32-1.20250828112832568739.main.1.g7a63097.fc44.s390x.rpm' (attempt #1) [2025-08-28 11:48:43,628][ INFO][PID:2711736] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-debugsource-32-1.20250828112832568739.main.1.g7a63097.fc44.s390x.rpm [2025-08-28 11:48:43,629][ INFO][PID:2711736] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-32-1.20250828112832568739.main.1.g7a63097.fc44.src.rpm' (attempt #1) [2025-08-28 11:48:44,824][ INFO][PID:2711736] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-32-1.20250828112832568739.main.1.g7a63097.fc44.src.rpm [2025-08-28 11:48:44,826][ INFO][PID:2711736] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-32-1.20250828112832568739.main.1.g7a63097.fc44.s390x.rpm' (attempt #1) [2025-08-28 11:48:46,089][ INFO][PID:2711736] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/image-builder-32-1.20250828112832568739.main.1.g7a63097.fc44.s390x.rpm [2025-08-28 11:48:46,089][ INFO][PID:2711736] Sign done [2025-08-28 11:48:46,090][ INFO][PID:2711736] Incremental createrepo run, adding 09499499-image-builder into https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-rawhide-s390x, (auto-create-repo=True) [2025-08-28 11:48:46,091][ INFO][PID:2711736] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x --add 09499499-image-builder --no-appstream-metadata' as PID 2750967 [2025-08-28 11:48:46,879][ INFO][PID:2711736] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x --add 09499499-image-builder --no-appstream-metadata) [2025-08-28 11:48:46,880][ INFO][PID:2711736] Getting build details [2025-08-28 11:48:46,881][ INFO][PID:2711736] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder [2025-08-28 11:48:46,881][ INFO][PID:2711736] Built packages: ['image-builder-debuginfo 32', 'image-builder 32', 'image-builder-debugsource 32'] [2025-08-28 11:48:46,881][ INFO][PID:2711736] build details: {'built_packages': 'image-builder-debuginfo 32\nimage-builder 32\nimage-builder-debugsource 32'} [2025-08-28 11:48:46,882][ INFO][PID:2711736] Retrieving pubkey [2025-08-28 11:48:46,882][ INFO][PID:2711736] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-08-28 11:48:47,068][ INFO][PID:2711736] Added pubkey for user @osbuild project image-builder into: /var/lib/copr/public_html/results/@osbuild/image-builder/pubkey.gpg [2025-08-28 11:48:47,068][ INFO][PID:2711736] Finished build: id=9499499 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/image-builder chroot=fedora-rawhide-s390x [2025-08-28 11:48:47,070][ INFO][PID:2711736] Worker succeeded build, took 493.3715217113495 [2025-08-28 11:48:47,071][ INFO][PID:2711736] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": 1756381727.070403, "started_on": 1756381233.6988814, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9499499-fedora-rawhide-s390x", "build_id": 9499499, "package_name": "image-builder", "package_version": "32-1.20250828112832568739.main.1.g7a63097", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "4bd62ab108ea8434cbac1beb4a42f5ac0e9212d4", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": { "packages": [ { "name": "image-builder", "epoch": null, "version": "32", "release": "1.20250828112832568739.main.1.g7a63097.fc44", "arch": "src" }, { "name": "image-builder-debuginfo", "epoch": null, "version": "32", "release": "1.20250828112832568739.main.1.g7a63097.fc44", "arch": "s390x" }, { "name": "image-builder", "epoch": null, "version": "32", "release": "1.20250828112832568739.main.1.g7a63097.fc44", "arch": "s390x" }, { "name": "image-builder-debugsource", "epoch": null, "version": "32", "release": "1.20250828112832568739.main.1.g7a63097.fc44", "arch": "s390x" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09499499-image-builder", "built_packages": "image-builder-debuginfo 32\nimage-builder 32\nimage-builder-debugsource 32", "id": 9499499, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-08-28 11:48:47,130][ INFO][PID:2711736] Sending fedora-messaging bus message in build.end [2025-08-28 11:48:47,156][ INFO][PID:2711736] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/builder-live.log by gzip [2025-08-28 11:48:47,157][ INFO][PID:2711736] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/builder-live.log' as PID 2751114 [2025-08-28 11:48:47,193][ INFO][PID:2711736] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/builder-live.log) [2025-08-28 11:48:47,194][ INFO][PID:2711736] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/backend.log by gzip [2025-08-28 11:48:47,195][ INFO][PID:2711736] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09499499-image-builder/backend.log' as PID 2751119