[2025-05-15 12:47:00,702][ INFO][PID:2705593] Marking build as starting [2025-05-15 12:47:00,878][ INFO][PID:2705593] Trying to allocate VM: ResallocHost, ticket_id=3021547, requested_tags=['copr_builder', 'arch_x86_64'] [2025-05-15 12:47:19,377][ INFO][PID:2705593] Allocated host ResallocHost, ticket_id=3021547, hostname=54.90.180.10, name=aws_x86_64_spot_prod_03982592_20250515_124447, requested_tags=['copr_builder', 'arch_x86_64'] [2025-05-15 12:47:19,391][ INFO][PID:2705593] Allocating ssh connection to builder [2025-05-15 12:47:19,412][ INFO][PID:2705593] Checking that builder machine is OK [2025-05-15 12:47:20,035][ INFO][PID:2705593] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-05-15 12:47:20,501][ INFO][PID:2705593] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-05-15 12:47:20,503][ INFO][PID:2705593] Filling build.info file with builder info [2025-05-15 12:47:20,510][ INFO][PID:2705593] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "skoved", "project_name": "dice-roll-go", "project_dirname": "dice-roll-go", "submitter": "skoved", "ended_on": null, "started_on": 1747313240.5105393, "submitted_on": null, "status": 3, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9050068-fedora-41-x86_64", "build_id": 9050068, "package_name": "golang-github-skoved-dice-roll", "package_version": "0.0.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/skoved/dice-roll-go/golang-github-skoved-dice-roll", "git_hash": "82bce990b4396b7f801c0c34cbc4ffb80cdcaaa7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "skoved/dice-roll-go--skoved", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/skoved/dice-roll-go/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/skoved/dice-roll-go", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/skoved/dice-roll-go", "result_dir": "09050068-golang-github-skoved-dice-roll", "built_packages": "", "id": 9050068, "mockchain_macros": { "copr_username": "skoved", "copr_projectname": "dice-roll-go", "vendor": "Fedora Project COPR (skoved/dice-roll-go)" } } ] } [2025-05-15 12:47:20,558][ INFO][PID:2705593] Sending fedora-messaging bus message in build.start [2025-05-15 12:47:26,787][ INFO][PID:2705593] Sending fedora-messaging bus message in chroot.start [2025-05-15 12:47:26,868][ INFO][PID:2705593] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9050068-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-05-15 12:47:27,372][ INFO][PID:2705593] Downloading the builder-live.log file, attempt 1 [2025-05-15 12:47:27,380][ INFO][PID:2705593] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.180.10 copr-rpmbuild-log [2025-05-15 12:47:32,451][ INFO][PID:2705593] Periodic builder liveness probe: alive [2025-05-15 12:49:03,636][ ERROR][PID:2705593] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-05-15 12:49:13,640][WARNING][PID:2705593] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-05-15 12:49:23,642][ INFO][PID:2705593] Downloading the builder-live.log file, attempt 2 [2025-05-15 12:49:23,647][ INFO][PID:2705593] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.180.10 copr-rpmbuild-log [2025-05-15 12:50:23,766][ ERROR][PID:2705593] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-05-15 12:50:33,791][WARNING][PID:2705593] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-05-15 12:50:43,802][ INFO][PID:2705593] Downloading the builder-live.log file, attempt 3 [2025-05-15 12:50:43,829][ INFO][PID:2705593] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.180.10 copr-rpmbuild-log [2025-05-15 12:51:44,265][ ERROR][PID:2705593] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-05-15 12:51:54,315][WARNING][PID:2705593] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-05-15 12:52:04,320][ INFO][PID:2705593] Downloading the builder-live.log file, attempt 4 [2025-05-15 12:52:04,332][ INFO][PID:2705593] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.90.180.10 copr-rpmbuild-log [2025-05-15 12:53:04,477][ ERROR][PID:2705593] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-05-15 12:53:14,497][ ERROR][PID:2705593] Giving up for unstable SSH, failures: 1747313353.6401203, 1747313433.7913938, 1747313514.3153026, 1747313594.4957335 [2025-05-15 12:53:14,506][ ERROR][PID:2705593] Re-try request for task on 'ResallocHost, ticket_id=3021547, hostname=54.90.180.10, name=aws_x86_64_spot_prod_03982592_20250515_124447, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-05-15 12:53:14,516][ INFO][PID:2705593] Releasing VM back to pool [2025-05-15 12:53:14,693][ INFO][PID:2705593] Retry #1 (on other host) [2025-05-15 12:53:15,863][ INFO][PID:2705593] Trying to allocate VM: ResallocHost, ticket_id=3021650, requested_tags=['copr_builder', 'arch_x86_64'] [2025-05-15 12:57:34,617][ INFO][PID:2705593] Allocated host ResallocHost, ticket_id=3021650, hostname=54.221.68.99, name=aws_x86_64_spot_prod_03983262_20250515_125419, requested_tags=['copr_builder', 'arch_x86_64'] [2025-05-15 12:57:34,619][ INFO][PID:2705593] Allocating ssh connection to builder [2025-05-15 12:57:34,623][ INFO][PID:2705593] Checking that builder machine is OK [2025-05-15 12:57:35,131][ INFO][PID:2705593] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-05-15 12:57:35,526][ INFO][PID:2705593] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-05-15 12:57:35,532][ INFO][PID:2705593] Filling build.info file with builder info [2025-05-15 12:57:35,542][ INFO][PID:2705593] Not re-notifying FE and msg buses for the new host. [2025-05-15 12:57:35,552][ INFO][PID:2705593] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9050068-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-05-15 12:57:36,072][ INFO][PID:2705593] Downloading the builder-live.log file, attempt 1 [2025-05-15 12:57:36,077][ INFO][PID:2705593] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.221.68.99 copr-rpmbuild-log [2025-05-15 12:57:41,119][ INFO][PID:2705593] Periodic builder liveness probe: alive [2025-05-15 12:59:52,891][ INFO][PID:2705593] Downloading results from builder [2025-05-15 12:59:52,895][ INFO][PID:2705593] rsyncing of mockbuilder@54.221.68.99:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll started [2025-05-15 12:59:52,904][ INFO][PID:2705593] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.221.68.99:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/ &> /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/build-09050068.rsync.log [2025-05-15 12:59:53,565][ INFO][PID:2705593] rsyncing finished. [2025-05-15 12:59:53,568][ INFO][PID:2705593] Releasing VM back to pool [2025-05-15 12:59:53,594][ INFO][PID:2705593] Searching for 'success' file in resultdir [2025-05-15 12:59:53,596][ INFO][PID:2705593] Going to sign pkgs from source: 9050068-fedora-41-x86_64 in chroot: /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64 [2025-05-15 12:59:53,598][ INFO][PID:2705593] Calling '/bin/sign -u skoved#dice-roll-go@copr.fedorahosted.org -p' (attempt #1) [2025-05-15 12:59:53,778][ INFO][PID:2705593] Calling '/bin/sign -4 -h sha256 -u skoved#dice-roll-go@copr.fedorahosted.org -r /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-0.0.4-1.fc41.x86_64.rpm' (attempt #1) [2025-05-15 12:59:54,816][ INFO][PID:2705593] signed rpm: /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-0.0.4-1.fc41.x86_64.rpm [2025-05-15 12:59:54,822][ INFO][PID:2705593] Calling '/bin/sign -4 -h sha256 -u skoved#dice-roll-go@copr.fedorahosted.org -r /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-debuginfo-0.0.4-1.fc41.x86_64.rpm' (attempt #1) [2025-05-15 12:59:55,713][ INFO][PID:2705593] signed rpm: /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-debuginfo-0.0.4-1.fc41.x86_64.rpm [2025-05-15 12:59:55,718][ INFO][PID:2705593] Calling '/bin/sign -4 -h sha256 -u skoved#dice-roll-go@copr.fedorahosted.org -r /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-debugsource-0.0.4-1.fc41.x86_64.rpm' (attempt #1) [2025-05-15 12:59:56,489][ INFO][PID:2705593] signed rpm: /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-debugsource-0.0.4-1.fc41.x86_64.rpm [2025-05-15 12:59:56,492][ INFO][PID:2705593] Calling '/bin/sign -4 -h sha256 -u skoved#dice-roll-go@copr.fedorahosted.org -r /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-0.0.4-1.fc41.src.rpm' (attempt #1) [2025-05-15 12:59:57,578][ INFO][PID:2705593] signed rpm: /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-0.0.4-1.fc41.src.rpm [2025-05-15 12:59:57,580][ INFO][PID:2705593] Calling '/bin/sign -4 -h sha256 -u skoved#dice-roll-go@copr.fedorahosted.org -r /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-devel-0.0.4-1.fc41.noarch.rpm' (attempt #1) [2025-05-15 12:59:58,628][ INFO][PID:2705593] signed rpm: /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/golang-github-skoved-dice-roll-devel-0.0.4-1.fc41.noarch.rpm [2025-05-15 12:59:58,631][ INFO][PID:2705593] Sign done [2025-05-15 12:59:58,637][ INFO][PID:2705593] Incremental createrepo run, adding 09050068-golang-github-skoved-dice-roll into https://download.copr.fedorainfracloud.org/results/skoved/dice-roll-go/fedora-41-x86_64, (auto-create-repo=True) [2025-05-15 12:59:58,648][ INFO][PID:2705593] Running command 'copr-repo --batched /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64 --add 09050068-golang-github-skoved-dice-roll' as PID 2791768 [2025-05-15 13:00:02,399][ INFO][PID:2705593] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64 --add 09050068-golang-github-skoved-dice-roll) [2025-05-15 13:00:02,410][ INFO][PID:2705593] Getting build details [2025-05-15 13:00:02,416][ INFO][PID:2705593] Listing built binary packages in /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll [2025-05-15 13:00:02,424][ INFO][PID:2705593] Built packages: ['golang-github-skoved-dice-roll-debugsource 0.0.4', 'golang-github-skoved-dice-roll-debuginfo 0.0.4', 'golang-github-skoved-dice-roll 0.0.4', 'golang-github-skoved-dice-roll-devel 0.0.4'] [2025-05-15 13:00:02,433][ INFO][PID:2705593] build details: {'built_packages': 'golang-github-skoved-dice-roll-debugsource 0.0.4\ngolang-github-skoved-dice-roll-debuginfo 0.0.4\ngolang-github-skoved-dice-roll 0.0.4\ngolang-github-skoved-dice-roll-devel 0.0.4'} [2025-05-15 13:00:02,439][ INFO][PID:2705593] Retrieving pubkey [2025-05-15 13:00:02,445][ INFO][PID:2705593] Calling '/bin/sign -u skoved#dice-roll-go@copr.fedorahosted.org -p' (attempt #1) [2025-05-15 13:00:02,828][ INFO][PID:2705593] Added pubkey for user skoved project dice-roll-go into: /var/lib/copr/public_html/results/skoved/dice-roll-go/pubkey.gpg [2025-05-15 13:00:02,844][ INFO][PID:2705593] Finished build: id=9050068 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/skoved/dice-roll-go chroot=fedora-41-x86_64 [2025-05-15 13:00:02,881][ INFO][PID:2705593] Worker succeeded build, took 147.33901166915894 [2025-05-15 13:00:02,892][ INFO][PID:2705593] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "skoved", "project_name": "dice-roll-go", "project_dirname": "dice-roll-go", "submitter": "skoved", "ended_on": 1747314002.8818038, "started_on": 1747313855.542792, "submitted_on": null, "status": 1, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9050068-fedora-41-x86_64", "build_id": 9050068, "package_name": "golang-github-skoved-dice-roll", "package_version": "0.0.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/skoved/dice-roll-go/golang-github-skoved-dice-roll", "git_hash": "82bce990b4396b7f801c0c34cbc4ffb80cdcaaa7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "skoved/dice-roll-go--skoved", "results": { "packages": [ { "name": "golang-github-skoved-dice-roll-debugsource", "epoch": null, "version": "0.0.4", "release": "1.fc41", "arch": "x86_64" }, { "name": "golang-github-skoved-dice-roll-debuginfo", "epoch": null, "version": "0.0.4", "release": "1.fc41", "arch": "x86_64" }, { "name": "golang-github-skoved-dice-roll", "epoch": null, "version": "0.0.4", "release": "1.fc41", "arch": "x86_64" }, { "name": "golang-github-skoved-dice-roll-devel", "epoch": null, "version": "0.0.4", "release": "1.fc41", "arch": "noarch" }, { "name": "golang-github-skoved-dice-roll", "epoch": null, "version": "0.0.4", "release": "1.fc41", "arch": "src" } ] }, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/skoved/dice-roll-go/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/skoved/dice-roll-go", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/skoved/dice-roll-go", "result_dir": "09050068-golang-github-skoved-dice-roll", "built_packages": "golang-github-skoved-dice-roll-debugsource 0.0.4\ngolang-github-skoved-dice-roll-debuginfo 0.0.4\ngolang-github-skoved-dice-roll 0.0.4\ngolang-github-skoved-dice-roll-devel 0.0.4", "id": 9050068, "mockchain_macros": { "copr_username": "skoved", "copr_projectname": "dice-roll-go", "vendor": "Fedora Project COPR (skoved/dice-roll-go)" } } ] } [2025-05-15 13:00:02,973][ INFO][PID:2705593] Sending fedora-messaging bus message in build.end [2025-05-15 13:00:03,286][ INFO][PID:2705593] Compressing /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/builder-live.log by gzip [2025-05-15 13:00:03,300][ INFO][PID:2705593] Running command 'gzip /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/builder-live.log' as PID 2792495 [2025-05-15 13:00:03,361][ INFO][PID:2705593] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/builder-live.log) [2025-05-15 13:00:03,370][ INFO][PID:2705593] Compressing /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/backend.log by gzip [2025-05-15 13:00:03,381][ INFO][PID:2705593] Running command 'gzip /var/lib/copr/public_html/results/skoved/dice-roll-go/fedora-41-x86_64/09050068-golang-github-skoved-dice-roll/backend.log' as PID 2792511