[2026-04-21 20:38:05,882][ INFO][PID:1666681] Marking build as starting [2026-04-21 20:38:05,959][ INFO][PID:1666681] Checking that /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/repodata/repomd.xml exists [2026-04-21 20:38:06,360][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:06,362][ INFO][PID:1666681] VM allocation process starts [2026-04-21 20:38:06,374][ INFO][PID:1666681] Trying to allocate VM: ResallocHost, ticket_id=2447660, requested_tags=['arch_s390x', 'copr_builder'] [2026-04-21 20:38:11,376][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:12,434][ INFO][PID:1666681] Allocated host ResallocHost, ticket_id=2447660, hostname=2620:52:6:1161:dead:beef:cafe:c134, name=vmhost_x86_02_prod_07613390_20260421_203213, requested_tags=['arch_s390x', 'copr_builder'] [2026-04-21 20:38:12,435][ INFO][PID:1666681] Allocating ssh connection to builder [2026-04-21 20:38:12,436][ INFO][PID:1666681] Checking that builder machine is OK [2026-04-21 20:38:13,008][ INFO][PID:1666681] Installed copr-rpmbuild version: 1.8 [2026-04-21 20:38:13,010][ INFO][PID:1666681] Running remote command: copr-builder-ready fedora-rawhide-s390x [2026-04-21 20:38:13,379][ INFO][PID:1666681] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2026-04-21 20:38:13,380][ INFO][PID:1666681] Filling build.info file with builder info [2026-04-21 20:38:13,409][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:13,412][ INFO][PID:1666681] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "vmojzis", "project_name": "userspace_test", "project_dirname": "userspace_test", "submitter": "vmojzis", "ended_on": null, "started_on": 1776803893.4124146, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10353452-fedora-rawhide-s390x", "build_id": 10353452, "package_name": "setroubleshoot", "package_version": "3.3.36-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/vmojzis/userspace_test/setroubleshoot", "git_hash": "d327b77e7bd60ac4b8724cbea531d5db1bdb0469", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "vmojzis/userspace_test--vmojzis", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/vmojzis/userspace_test/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/vmojzis/userspace_test", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/vmojzis/userspace_test", "result_dir": "10353452-setroubleshoot", "built_packages": "", "id": 10353452, "mockchain_macros": { "copr_username": "vmojzis", "copr_projectname": "userspace_test", "vendor": "Fedora Project COPR (vmojzis/userspace_test)" } } ] } [2026-04-21 20:38:13,490][ INFO][PID:1666681] Sending fedora-messaging bus message in build.start [2026-04-21 20:38:14,117][ INFO][PID:1666681] Sending fedora-messaging bus message in chroot.start [2026-04-21 20:38:14,153][ INFO][PID:1666681] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10353452-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2026-04-21 20:38:14,788][ INFO][PID:1666681] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c134' (ED25519) to the list of known hosts. [2026-04-21 20:38:14,789][ INFO][PID:1666681] Downloading the builder-live.log file, attempt 1 [2026-04-21 20:38:14,791][ INFO][PID:1666681] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c134 copr-rpmbuild-log [2026-04-21 20:38:19,802][ INFO][PID:1666681] Periodic builder liveness probe: alive [2026-04-21 20:38:19,803][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:24,804][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:29,805][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:34,807][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:39,809][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:44,810][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:49,812][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:54,814][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:38:59,817][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:04,865][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:09,870][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:14,874][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:19,878][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:24,897][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:29,909][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:34,914][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:39,917][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:44,922][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:49,924][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:54,926][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:39:59,930][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:04,935][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:09,945][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:14,974][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:20,043][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:25,055][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:30,058][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:35,074][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:40,191][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:45,203][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:50,204][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:40:55,212][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:00,229][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:05,236][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:10,296][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:15,298][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:20,314][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:25,316][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:30,321][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:35,402][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:40,417][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:45,470][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:50,484][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:41:55,494][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:00,502][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:05,507][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:10,510][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:15,538][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:20,543][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:25,550][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:30,624][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:35,628][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:40,630][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:45,631][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:50,707][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:42:55,708][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:00,710][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:05,746][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:10,990][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:15,992][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:20,994][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:25,996][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:30,997][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:36,027][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:41,128][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:46,131][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:51,135][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:43:56,138][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:01,179][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:06,186][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:11,197][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:16,207][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:21,210][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:26,214][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:31,216][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:36,219][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:41,247][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:46,250][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:51,281][ INFO][PID:1666681] Checking for cancel request [2026-04-21 20:44:53,916][ INFO][PID:1666681] Downloading results from builder [2026-04-21 20:44:53,917][ INFO][PID:1666681] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c134]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot started [2026-04-21 20:44:53,918][ INFO][PID:1666681] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c134]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/ &> /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/build-10353452.rsync.log [2026-04-21 20:44:54,545][ INFO][PID:1666681] rsyncing finished. [2026-04-21 20:44:54,546][ INFO][PID:1666681] VM Release request [2026-04-21 20:44:54,558][ INFO][PID:1666681] Searching for 'success' file in resultdir [2026-04-21 20:44:54,559][ INFO][PID:1666681] Going to sign pkgs from source: 10353452-fedora-rawhide-s390x in chroot: /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x [2026-04-21 20:44:54,560][ INFO][PID:1666681] Calling '/bin/sign -u vmojzis#userspace_test@copr.fedorahosted.org -p' (attempt #1) [2026-04-21 20:44:54,845][ INFO][PID:1666681] Calling '/bin/sign -4 -h sha256 -u vmojzis#userspace_test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-3.3.36-4.fc45.s390x.rpm' (attempt #1) [2026-04-21 20:44:55,642][ INFO][PID:1666681] signed rpm: /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-3.3.36-4.fc45.s390x.rpm [2026-04-21 20:44:55,643][ INFO][PID:1666681] Calling '/bin/sign -4 -h sha256 -u vmojzis#userspace_test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-3.3.36-4.fc45.src.rpm' (attempt #1) [2026-04-21 20:44:56,498][ INFO][PID:1666681] signed rpm: /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-3.3.36-4.fc45.src.rpm [2026-04-21 20:44:56,499][ INFO][PID:1666681] Calling '/bin/sign -4 -h sha256 -u vmojzis#userspace_test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-server-debuginfo-3.3.36-4.fc45.s390x.rpm' (attempt #1) [2026-04-21 20:44:57,293][ INFO][PID:1666681] signed rpm: /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-server-debuginfo-3.3.36-4.fc45.s390x.rpm [2026-04-21 20:44:57,294][ INFO][PID:1666681] Calling '/bin/sign -4 -h sha256 -u vmojzis#userspace_test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-server-3.3.36-4.fc45.s390x.rpm' (attempt #1) [2026-04-21 20:44:58,103][ INFO][PID:1666681] signed rpm: /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-server-3.3.36-4.fc45.s390x.rpm [2026-04-21 20:44:58,104][ INFO][PID:1666681] Calling '/bin/sign -4 -h sha256 -u vmojzis#userspace_test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-debugsource-3.3.36-4.fc45.s390x.rpm' (attempt #1) [2026-04-21 20:44:58,924][ INFO][PID:1666681] signed rpm: /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/setroubleshoot-debugsource-3.3.36-4.fc45.s390x.rpm [2026-04-21 20:44:58,924][ INFO][PID:1666681] Sign done [2026-04-21 20:44:58,925][ INFO][PID:1666681] Incremental createrepo run, adding 10353452-setroubleshoot into https://download.copr.fedorainfracloud.org/results/vmojzis/userspace_test/fedora-rawhide-s390x, (auto-create-repo=True) [2026-04-21 20:44:58,927][ INFO][PID:1666681] Running command 'copr-repo --batched /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x --add 10353452-setroubleshoot --no-appstream-metadata' as PID 1736978 [2026-04-21 20:44:59,538][ INFO][PID:1666681] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x --add 10353452-setroubleshoot --no-appstream-metadata) [2026-04-21 20:44:59,539][ INFO][PID:1666681] Getting build details [2026-04-21 20:44:59,540][ INFO][PID:1666681] Listing built binary packages in /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot [2026-04-21 20:44:59,540][ INFO][PID:1666681] Built packages: ['setroubleshoot-server 3.3.36', 'setroubleshoot 3.3.36', 'setroubleshoot-debugsource 3.3.36', 'setroubleshoot-server-debuginfo 3.3.36'] [2026-04-21 20:44:59,541][ INFO][PID:1666681] build details: {'built_packages': 'setroubleshoot-server 3.3.36\nsetroubleshoot 3.3.36\nsetroubleshoot-debugsource 3.3.36\nsetroubleshoot-server-debuginfo 3.3.36'} [2026-04-21 20:44:59,541][ INFO][PID:1666681] Retrieving pubkey [2026-04-21 20:44:59,542][ INFO][PID:1666681] Calling '/bin/sign -u vmojzis#userspace_test@copr.fedorahosted.org -p' (attempt #1) [2026-04-21 20:44:59,746][ INFO][PID:1666681] Added pubkey for user vmojzis project userspace_test into: /var/lib/copr/public_html/results/vmojzis/userspace_test/pubkey.gpg [2026-04-21 20:44:59,747][ INFO][PID:1666681] Finished build: id=10353452 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/vmojzis/userspace_test chroot=fedora-rawhide-s390x [2026-04-21 20:44:59,750][ INFO][PID:1666681] Worker succeeded build, took 406.3375792503357 [2026-04-21 20:44:59,750][ INFO][PID:1666681] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "vmojzis", "project_name": "userspace_test", "project_dirname": "userspace_test", "submitter": "vmojzis", "ended_on": 1776804299.7499938, "started_on": 1776803893.4124146, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "10353452-fedora-rawhide-s390x", "build_id": 10353452, "package_name": "setroubleshoot", "package_version": "3.3.36-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/vmojzis/userspace_test/setroubleshoot", "git_hash": "d327b77e7bd60ac4b8724cbea531d5db1bdb0469", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "vmojzis/userspace_test--vmojzis", "results": { "packages": [ { "name": "setroubleshoot-server", "epoch": null, "version": "3.3.36", "release": "4.fc45", "arch": "s390x" }, { "name": "setroubleshoot", "epoch": null, "version": "3.3.36", "release": "4.fc45", "arch": "s390x" }, { "name": "setroubleshoot-debugsource", "epoch": null, "version": "3.3.36", "release": "4.fc45", "arch": "s390x" }, { "name": "setroubleshoot", "epoch": null, "version": "3.3.36", "release": "4.fc45", "arch": "src" }, { "name": "setroubleshoot-server-debuginfo", "epoch": null, "version": "3.3.36", "release": "4.fc45", "arch": "s390x" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/vmojzis/userspace_test/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/vmojzis/userspace_test", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/vmojzis/userspace_test", "result_dir": "10353452-setroubleshoot", "built_packages": "setroubleshoot-server 3.3.36\nsetroubleshoot 3.3.36\nsetroubleshoot-debugsource 3.3.36\nsetroubleshoot-server-debuginfo 3.3.36", "id": 10353452, "mockchain_macros": { "copr_username": "vmojzis", "copr_projectname": "userspace_test", "vendor": "Fedora Project COPR (vmojzis/userspace_test)" } } ] } [2026-04-21 20:44:59,824][ INFO][PID:1666681] Sending fedora-messaging bus message in build.end [2026-04-21 20:44:59,855][ INFO][PID:1666681] Compressing /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/builder-live.log by gzip [2026-04-21 20:44:59,856][ INFO][PID:1666681] Running command 'gzip /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/builder-live.log' as PID 1737094 [2026-04-21 20:44:59,910][ INFO][PID:1666681] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/builder-live.log) [2026-04-21 20:44:59,911][ INFO][PID:1666681] Compressing /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/backend.log by gzip [2026-04-21 20:44:59,913][ INFO][PID:1666681] Running command 'gzip /var/lib/copr/public_html/results/vmojzis/userspace_test/fedora-rawhide-s390x/10353452-setroubleshoot/backend.log' as PID 1737102