[2025-03-25 13:23:27,748][ INFO][PID:3712389] Marking build as starting [2025-03-25 13:23:27,800][ INFO][PID:3712389] Trying to allocate VM [2025-03-25 13:27:46,024][ INFO][PID:3712389] Allocated host ResallocHost, ticket_id=2029288, hostname=52.91.3.66, name=aws_x86_64_spot_prod_02303843_20250325_132521 [2025-03-25 13:27:46,027][ INFO][PID:3712389] Allocating ssh connection to builder [2025-03-25 13:27:46,029][ INFO][PID:3712389] Checking that builder machine is OK [2025-03-25 13:27:46,448][ INFO][PID:3712389] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-03-25 13:27:46,729][ INFO][PID:3712389] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-03-25 13:27:46,730][ INFO][PID:3712389] Filling build.info file with builder info [2025-03-25 13:27:46,731][ INFO][PID:3712389] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-review", "project_name": "fedora-review-2343280-rust-sigul-pesign-bridge", "project_dirname": "fedora-review-2343280-rust-sigul-pesign-bridge", "submitter": "frostyx", "ended_on": null, "started_on": 1742909266.7315526, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "8818653-fedora-rawhide-x86_64", "build_id": 8818653, "package_name": "rust-sigul-pesign-bridge", "package_version": "0.3.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/rust-sigul-pesign-bridge", "git_hash": "58e5becf393714e6d226fc6b9385c70e64c43f93", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge--frostyx", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge", "result_dir": "08818653-rust-sigul-pesign-bridge", "built_packages": "", "id": 8818653, "mockchain_macros": { "copr_username": "@fedora-review", "copr_projectname": "fedora-review-2343280-rust-sigul-pesign-bridge", "vendor": "Fedora Project COPR (@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge)" } } ] } [2025-03-25 13:27:46,768][ INFO][PID:3712389] Sending fedora-messaging bus message in build.start [2025-03-25 13:27:47,562][ INFO][PID:3712389] Sending fedora-messaging bus message in chroot.start [2025-03-25 13:27:47,584][ INFO][PID:3712389] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8818653-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-03-25 13:27:47,962][ INFO][PID:3712389] Downloading the builder-live.log file, attempt 1 [2025-03-25 13:27:47,969][ INFO][PID:3712389] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.3.66 copr-rpmbuild-log [2025-03-25 13:27:52,980][ INFO][PID:3712389] Periodic builder liveness probe: alive [2025-03-25 13:33:55,082][ ERROR][PID:3712389] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-03-25 13:34:05,082][WARNING][PID:3712389] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-03-25 13:34:15,083][ INFO][PID:3712389] Downloading the builder-live.log file, attempt 2 [2025-03-25 13:34:15,085][ INFO][PID:3712389] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.3.66 copr-rpmbuild-log [2025-03-25 13:35:15,153][ ERROR][PID:3712389] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-03-25 13:35:25,154][WARNING][PID:3712389] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-03-25 13:35:35,155][ INFO][PID:3712389] Downloading the builder-live.log file, attempt 3 [2025-03-25 13:35:35,157][ INFO][PID:3712389] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.3.66 copr-rpmbuild-log [2025-03-25 13:36:35,227][ ERROR][PID:3712389] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-03-25 13:36:45,228][WARNING][PID:3712389] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-03-25 13:36:55,232][ INFO][PID:3712389] Downloading the builder-live.log file, attempt 4 [2025-03-25 13:36:55,235][ INFO][PID:3712389] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.91.3.66 copr-rpmbuild-log [2025-03-25 13:37:53,129][ INFO][PID:3712389] Periodic builder liveness probe: alive [2025-03-25 13:37:55,305][ ERROR][PID:3712389] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-03-25 13:38:05,307][ ERROR][PID:3712389] Giving up for unstable SSH, failures: 1742909645.0829353, 1742909725.1547363, 1742909805.2286339, 1742909885.3069916 [2025-03-25 13:38:05,308][ ERROR][PID:3712389] Re-try request for task on 'ResallocHost, ticket_id=2029288, hostname=52.91.3.66, name=aws_x86_64_spot_prod_02303843_20250325_132521': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-03-25 13:38:05,308][ INFO][PID:3712389] Releasing VM back to pool [2025-03-25 13:38:05,322][ INFO][PID:3712389] Retry #1 (on other host) [2025-03-25 13:38:05,323][ INFO][PID:3712389] Trying to allocate VM [2025-03-25 13:42:23,450][ INFO][PID:3712389] Allocated host ResallocHost, ticket_id=2029660, hostname=2620:52:3:1:dead:beef:cafe:c15a, name=copr_hv_x86_64_02_prod_02304321_20250325_133958 [2025-03-25 13:42:23,450][ INFO][PID:3712389] Allocating ssh connection to builder [2025-03-25 13:42:23,451][ INFO][PID:3712389] Checking that builder machine is OK [2025-03-25 13:42:24,038][ INFO][PID:3712389] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-03-25 13:42:24,368][ INFO][PID:3712389] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-03-25 13:42:24,369][ INFO][PID:3712389] Filling build.info file with builder info [2025-03-25 13:42:24,381][ INFO][PID:3712389] Not re-notifying FE and msg buses for the new host. [2025-03-25 13:42:24,385][ INFO][PID:3712389] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8818653-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-03-25 13:42:24,970][ INFO][PID:3712389] Downloading the builder-live.log file, attempt 1 [2025-03-25 13:42:24,974][ INFO][PID:3712389] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c15a copr-rpmbuild-log [2025-03-25 13:47:55,027][ INFO][PID:3712389] Periodic builder liveness probe: alive [2025-03-25 13:52:47,443][ INFO][PID:3712389] Downloading results from builder [2025-03-25 13:52:47,444][ INFO][PID:3712389] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c15a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge started [2025-03-25 13:52:47,444][ INFO][PID:3712389] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c15a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/ &> /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/build-08818653.rsync.log [2025-03-25 13:52:48,085][ INFO][PID:3712389] rsyncing finished. [2025-03-25 13:52:48,086][ INFO][PID:3712389] Releasing VM back to pool [2025-03-25 13:52:48,097][ INFO][PID:3712389] Searching for 'success' file in resultdir [2025-03-25 13:52:48,098][ INFO][PID:3712389] Going to sign pkgs from source: 8818653-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64 [2025-03-25 13:52:48,099][ INFO][PID:3712389] Calling '/bin/sign -u @fedora-review#fedora-review-2343280-rust-sigul-pesign-bridge@copr.fedorahosted.org -p' (attempt #1) [2025-03-25 13:52:48,407][ INFO][PID:3712389] Calling '/bin/sign -4 -h sha256 -u @fedora-review#fedora-review-2343280-rust-sigul-pesign-bridge@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/rust-sigul-pesign-bridge-0.3.1-1.fc43.src.rpm' (attempt #1) [2025-03-25 13:52:49,335][ INFO][PID:3712389] signed rpm: /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/rust-sigul-pesign-bridge-0.3.1-1.fc43.src.rpm [2025-03-25 13:52:49,336][ INFO][PID:3712389] Calling '/bin/sign -4 -h sha256 -u @fedora-review#fedora-review-2343280-rust-sigul-pesign-bridge@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/rust-sigul-pesign-bridge-debugsource-0.3.1-1.fc43.x86_64.rpm' (attempt #1) [2025-03-25 13:52:50,268][ INFO][PID:3712389] signed rpm: /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/rust-sigul-pesign-bridge-debugsource-0.3.1-1.fc43.x86_64.rpm [2025-03-25 13:52:50,269][ INFO][PID:3712389] Calling '/bin/sign -4 -h sha256 -u @fedora-review#fedora-review-2343280-rust-sigul-pesign-bridge@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/sigul-pesign-bridge-0.3.1-1.fc43.x86_64.rpm' (attempt #1) [2025-03-25 13:52:51,213][ INFO][PID:3712389] signed rpm: /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/sigul-pesign-bridge-0.3.1-1.fc43.x86_64.rpm [2025-03-25 13:52:51,214][ INFO][PID:3712389] Calling '/bin/sign -4 -h sha256 -u @fedora-review#fedora-review-2343280-rust-sigul-pesign-bridge@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/sigul-pesign-bridge-debuginfo-0.3.1-1.fc43.x86_64.rpm' (attempt #1) [2025-03-25 13:52:52,341][ INFO][PID:3712389] signed rpm: /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/sigul-pesign-bridge-debuginfo-0.3.1-1.fc43.x86_64.rpm [2025-03-25 13:52:52,342][ INFO][PID:3712389] Sign done [2025-03-25 13:52:52,343][ INFO][PID:3712389] Incremental createrepo run, adding 08818653-rust-sigul-pesign-bridge into https://download.copr.fedorainfracloud.org/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64, (auto-create-repo=True) [2025-03-25 13:52:52,344][ INFO][PID:3712389] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64 --add 08818653-rust-sigul-pesign-bridge --no-appstream-metadata' as PID 3964304 [2025-03-25 13:52:53,115][ INFO][PID:3712389] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64 --add 08818653-rust-sigul-pesign-bridge --no-appstream-metadata) [2025-03-25 13:52:53,117][ INFO][PID:3712389] Getting build details [2025-03-25 13:52:53,117][ INFO][PID:3712389] Listing built binary packages in /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge [2025-03-25 13:52:53,118][ INFO][PID:3712389] Built packages: ['sigul-pesign-bridge-debuginfo 0.3.1', 'sigul-pesign-bridge 0.3.1', 'rust-sigul-pesign-bridge-debugsource 0.3.1'] [2025-03-25 13:52:53,118][ INFO][PID:3712389] build details: {'built_packages': 'sigul-pesign-bridge-debuginfo 0.3.1\nsigul-pesign-bridge 0.3.1\nrust-sigul-pesign-bridge-debugsource 0.3.1'} [2025-03-25 13:52:53,119][ INFO][PID:3712389] Retrieving pubkey [2025-03-25 13:52:53,119][ INFO][PID:3712389] Calling '/bin/sign -u @fedora-review#fedora-review-2343280-rust-sigul-pesign-bridge@copr.fedorahosted.org -p' (attempt #1) [2025-03-25 13:52:53,423][ INFO][PID:3712389] Added pubkey for user @fedora-review project fedora-review-2343280-rust-sigul-pesign-bridge into: /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/pubkey.gpg [2025-03-25 13:52:53,424][ INFO][PID:3712389] Finished build: id=8818653 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge chroot=fedora-rawhide-x86_64 [2025-03-25 13:52:53,426][ INFO][PID:3712389] Worker succeeded build, took 629.0447688102722 [2025-03-25 13:52:53,426][ INFO][PID:3712389] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-review", "project_name": "fedora-review-2343280-rust-sigul-pesign-bridge", "project_dirname": "fedora-review-2343280-rust-sigul-pesign-bridge", "submitter": "frostyx", "ended_on": 1742910773.4261167, "started_on": 1742910144.381348, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "8818653-fedora-rawhide-x86_64", "build_id": 8818653, "package_name": "rust-sigul-pesign-bridge", "package_version": "0.3.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/rust-sigul-pesign-bridge", "git_hash": "58e5becf393714e6d226fc6b9385c70e64c43f93", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge--frostyx", "results": { "packages": [ { "name": "sigul-pesign-bridge-debuginfo", "epoch": null, "version": "0.3.1", "release": "1.fc43", "arch": "x86_64" }, { "name": "sigul-pesign-bridge", "epoch": null, "version": "0.3.1", "release": "1.fc43", "arch": "x86_64" }, { "name": "rust-sigul-pesign-bridge-debugsource", "epoch": null, "version": "0.3.1", "release": "1.fc43", "arch": "x86_64" }, { "name": "rust-sigul-pesign-bridge", "epoch": null, "version": "0.3.1", "release": "1.fc43", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge", "result_dir": "08818653-rust-sigul-pesign-bridge", "built_packages": "sigul-pesign-bridge-debuginfo 0.3.1\nsigul-pesign-bridge 0.3.1\nrust-sigul-pesign-bridge-debugsource 0.3.1", "id": 8818653, "mockchain_macros": { "copr_username": "@fedora-review", "copr_projectname": "fedora-review-2343280-rust-sigul-pesign-bridge", "vendor": "Fedora Project COPR (@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge)" } } ] } [2025-03-25 13:52:53,455][ INFO][PID:3712389] Sending fedora-messaging bus message in build.end [2025-03-25 13:52:53,473][ INFO][PID:3712389] Compressing /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/builder-live.log by gzip [2025-03-25 13:52:53,474][ INFO][PID:3712389] Running command 'gzip /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/builder-live.log' as PID 3964448 [2025-03-25 13:52:53,488][ INFO][PID:3712389] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/builder-live.log) [2025-03-25 13:52:53,488][ INFO][PID:3712389] Compressing /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/backend.log by gzip [2025-03-25 13:52:53,490][ INFO][PID:3712389] Running command 'gzip /var/lib/copr/public_html/results/@fedora-review/fedora-review-2343280-rust-sigul-pesign-bridge/fedora-rawhide-x86_64/08818653-rust-sigul-pesign-bridge/backend.log' as PID 3964451