[2025-03-06 17:34:10,074][ INFO][PID:587331] Marking build as starting
[2025-03-06 17:34:10,159][ INFO][PID:587331] Trying to allocate VM
[2025-03-06 17:34:22,297][ INFO][PID:587331] Allocated host ResallocHost, ticket_id=1681483, hostname=44.201.166.199, name=aws_x86_64_spot_prod_01731102_20250306_171943
[2025-03-06 17:34:22,299][ INFO][PID:587331] Allocating ssh connection to builder
[2025-03-06 17:34:22,300][ INFO][PID:587331] Checking that builder machine is OK
[2025-03-06 17:34:22,647][ INFO][PID:587331] Running remote command: copr-builder-ready fedora-41-i386
[2025-03-06 17:34:22,840][ INFO][PID:587331] Red Hat subscription not needed for fedora-41-i386
Builder is ready to be used
[2025-03-06 17:34:22,841][ INFO][PID:587331] Filling build.info file with builder info
[2025-03-06 17:34:22,842][ INFO][PID:587331] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "psimovec",
"project_name": "python3-scipy-1.10.1",
"project_dirname": "python3-scipy-1.10.1",
"submitter": "https://src.fedoraproject.org/user/jskarvad",
"ended_on": null,
"started_on": 1741282462.8425453,
"submitted_on": null,
"status": 3,
"chroot": "fedora-41-i386",
"arch": "i386",
"buildroot_pkgs": [],
"task_id": "8736772-fedora-41-i386",
"build_id": 8736772,
"package_name": "sdrangel",
"package_version": "7.22.6-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1/sdrangel",
"git_hash": "738a6fd486a43c9f0ca2948cb3ca50d27d24a3b0",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/jskarvad",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": null,
"background": true,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
},
{
"baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
"id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
"name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
}
],
"tags": [
"arch_i386"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1",
"result_dir": "08736772-sdrangel",
"built_packages": "",
"id": 8736772,
"mockchain_macros": {
"copr_username": "psimovec",
"copr_projectname": "python3-scipy-1.10.1",
"vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)"
}
}
]
}
[2025-03-06 17:34:22,899][ INFO][PID:587331] Sending fedora-messaging bus message in build.start
[2025-03-06 17:34:23,707][ INFO][PID:587331] Sending fedora-messaging bus message in chroot.start
[2025-03-06 17:34:23,731][ INFO][PID:587331] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8736772-fedora-41-i386 --chroot fedora-41-i386 --detached
[2025-03-06 17:34:24,110][ INFO][PID:587331] Downloading the builder-live.log file, attempt 1
[2025-03-06 17:34:24,115][ INFO][PID:587331] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.166.199 copr-rpmbuild-log
[2025-03-06 17:34:29,119][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 17:34:59,585][ ERROR][PID:587331] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-06 17:35:09,586][WARNING][PID:587331] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-03-06 17:35:19,587][ INFO][PID:587331] Downloading the builder-live.log file, attempt 2
[2025-03-06 17:35:19,589][ INFO][PID:587331] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.166.199 copr-rpmbuild-log
[2025-03-06 17:36:19,658][ ERROR][PID:587331] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-06 17:36:29,659][WARNING][PID:587331] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-03-06 17:36:39,660][ INFO][PID:587331] Downloading the builder-live.log file, attempt 3
[2025-03-06 17:36:39,661][ INFO][PID:587331] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.166.199 copr-rpmbuild-log
[2025-03-06 17:37:39,729][ ERROR][PID:587331] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-06 17:37:49,736][WARNING][PID:587331] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-03-06 17:37:59,736][ INFO][PID:587331] Downloading the builder-live.log file, attempt 4
[2025-03-06 17:37:59,738][ INFO][PID:587331] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.166.199 copr-rpmbuild-log
[2025-03-06 17:38:59,806][ ERROR][PID:587331] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-06 17:39:09,810][ ERROR][PID:587331] Giving up for unstable SSH, failures: 1741282509.5869133, 1741282589.6592314, 1741282669.736017, 1741282749.8104563
[2025-03-06 17:39:09,811][ ERROR][PID:587331] Re-try request for task on 'ResallocHost, ticket_id=1681483, hostname=44.201.166.199, name=aws_x86_64_spot_prod_01731102_20250306_171943': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-03-06 17:39:09,811][ INFO][PID:587331] Releasing VM back to pool
[2025-03-06 17:39:09,821][ INFO][PID:587331] Retry #1 (on other host)
[2025-03-06 17:39:09,822][ INFO][PID:587331] Trying to allocate VM
[2025-03-06 17:39:12,844][ INFO][PID:587331] Allocated host ResallocHost, ticket_id=1681545, hostname=2620:52:3:1:dead:beef:cafe:c189, name=copr_hv_x86_64_03_prod_01731563_20250306_173529
[2025-03-06 17:39:12,845][ INFO][PID:587331] Allocating ssh connection to builder
[2025-03-06 17:39:12,845][ INFO][PID:587331] Checking that builder machine is OK
[2025-03-06 17:39:13,450][ INFO][PID:587331] Running remote command: copr-builder-ready fedora-41-i386
[2025-03-06 17:39:13,788][ INFO][PID:587331] Red Hat subscription not needed for fedora-41-i386
Builder is ready to be used
[2025-03-06 17:39:13,789][ INFO][PID:587331] Filling build.info file with builder info
[2025-03-06 17:39:13,792][ INFO][PID:587331] Not re-notifying FE and msg buses for the new host.
[2025-03-06 17:39:13,792][ INFO][PID:587331] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8736772-fedora-41-i386 --chroot fedora-41-i386 --detached
[2025-03-06 17:39:14,455][ INFO][PID:587331] Downloading the builder-live.log file, attempt 1
[2025-03-06 17:39:14,456][ INFO][PID:587331] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c189 copr-rpmbuild-log
[2025-03-06 17:44:29,494][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 17:54:29,574][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 18:04:29,654][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 18:14:29,746][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 18:24:29,930][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 18:34:30,046][ INFO][PID:587331] Periodic builder liveness probe: alive
[2025-03-06 18:41:14,820][ INFO][PID:587331] Downloading results from builder
[2025-03-06 18:41:14,827][ INFO][PID:587331] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel started
[2025-03-06 18:41:14,830][ INFO][PID:587331] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c189]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/ &> /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/build-08736772.rsync.log
[2025-03-06 18:41:19,542][ INFO][PID:587331] rsyncing finished.
[2025-03-06 18:41:19,543][ INFO][PID:587331] Releasing VM back to pool
[2025-03-06 18:41:19,581][ INFO][PID:587331] Searching for 'success' file in resultdir
[2025-03-06 18:41:19,582][ INFO][PID:587331] Going to sign pkgs from source: 8736772-fedora-41-i386 in chroot: /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386
[2025-03-06 18:41:19,583][ INFO][PID:587331] Calling '/bin/sign -u psimovec#python3-scipy-1.10.1@copr.fedorahosted.org -p' (attempt #1)
[2025-03-06 18:41:19,831][ INFO][PID:587331] Calling '/bin/sign -4 -h sha256 -u psimovec#python3-scipy-1.10.1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-debuginfo-7.22.6-1.fc43.i686.rpm' (attempt #1)
[2025-03-06 18:41:23,444][ INFO][PID:587331] signed rpm: /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-debuginfo-7.22.6-1.fc43.i686.rpm
[2025-03-06 18:41:23,445][ INFO][PID:587331] Calling '/bin/sign -4 -h sha256 -u psimovec#python3-scipy-1.10.1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-7.22.6-1.fc43.src.rpm' (attempt #1)
[2025-03-06 18:41:25,900][ INFO][PID:587331] signed rpm: /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-7.22.6-1.fc43.src.rpm
[2025-03-06 18:41:25,900][ INFO][PID:587331] Calling '/bin/sign -4 -h sha256 -u psimovec#python3-scipy-1.10.1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-debugsource-7.22.6-1.fc43.i686.rpm' (attempt #1)
[2025-03-06 18:41:27,585][ INFO][PID:587331] signed rpm: /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-debugsource-7.22.6-1.fc43.i686.rpm
[2025-03-06 18:41:27,586][ INFO][PID:587331] Calling '/bin/sign -4 -h sha256 -u psimovec#python3-scipy-1.10.1@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-7.22.6-1.fc43.i686.rpm' (attempt #1)
[2025-03-06 18:41:29,727][ INFO][PID:587331] signed rpm: /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/sdrangel-7.22.6-1.fc43.i686.rpm
[2025-03-06 18:41:29,729][ INFO][PID:587331] Sign done
[2025-03-06 18:41:29,729][ INFO][PID:587331] Incremental createrepo run, adding 08736772-sdrangel into https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-41-i386, (auto-create-repo=True)
[2025-03-06 18:41:29,745][ INFO][PID:587331] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386 --add 08736772-sdrangel --no-appstream-metadata' as PID 997669
[2025-03-06 18:41:32,266][ INFO][PID:587331] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386 --add 08736772-sdrangel --no-appstream-metadata)
[2025-03-06 18:41:32,267][ INFO][PID:587331] Getting build details
[2025-03-06 18:41:32,268][ INFO][PID:587331] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel
[2025-03-06 18:41:32,268][ INFO][PID:587331] Built packages:
['sdrangel-debugsource 7.22.6', 'sdrangel 7.22.6', 'sdrangel-debuginfo 7.22.6']
[2025-03-06 18:41:32,269][ INFO][PID:587331] build details: {'built_packages': 'sdrangel-debugsource 7.22.6\nsdrangel 7.22.6\nsdrangel-debuginfo 7.22.6'}
[2025-03-06 18:41:32,269][ INFO][PID:587331] Retrieving pubkey
[2025-03-06 18:41:32,270][ INFO][PID:587331] Calling '/bin/sign -u psimovec#python3-scipy-1.10.1@copr.fedorahosted.org -p' (attempt #1)
[2025-03-06 18:41:32,461][ INFO][PID:587331] Added pubkey for user psimovec project python3-scipy-1.10.1 into: /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/pubkey.gpg
[2025-03-06 18:41:32,463][ INFO][PID:587331] Finished build: id=8736772 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1 chroot=fedora-41-i386
[2025-03-06 18:41:32,467][ INFO][PID:587331] Worker succeeded build, took 3738.674973487854
[2025-03-06 18:41:32,468][ INFO][PID:587331] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "psimovec",
"project_name": "python3-scipy-1.10.1",
"project_dirname": "python3-scipy-1.10.1",
"submitter": "https://src.fedoraproject.org/user/jskarvad",
"ended_on": 1741286492.4674506,
"started_on": 1741282753.7924771,
"submitted_on": null,
"status": 1,
"chroot": "fedora-41-i386",
"arch": "i386",
"buildroot_pkgs": [],
"task_id": "8736772-fedora-41-i386",
"build_id": 8736772,
"package_name": "sdrangel",
"package_version": "7.22.6-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/python3-scipy-1.10.1/sdrangel",
"git_hash": "738a6fd486a43c9f0ca2948cb3ca50d27d24a3b0",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "psimovec/python3-scipy-1.10.1--https://src.fedoraproject.org/user/jskarvad",
"results": {
"packages": [
{
"name": "sdrangel-debugsource",
"epoch": null,
"version": "7.22.6",
"release": "1.fc43",
"arch": "i686"
},
{
"name": "sdrangel",
"epoch": null,
"version": "7.22.6",
"release": "1.fc43",
"arch": "src"
},
{
"name": "sdrangel",
"epoch": null,
"version": "7.22.6",
"release": "1.fc43",
"arch": "i686"
},
{
"name": "sdrangel-debuginfo",
"epoch": null,
"version": "7.22.6",
"release": "1.fc43",
"arch": "i686"
}
]
},
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": null,
"background": true,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
},
{
"baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
"id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
"name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
}
],
"tags": [
"arch_i386"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/python3-scipy-1.10.1",
"result_dir": "08736772-sdrangel",
"built_packages": "sdrangel-debugsource 7.22.6\nsdrangel 7.22.6\nsdrangel-debuginfo 7.22.6",
"id": 8736772,
"mockchain_macros": {
"copr_username": "psimovec",
"copr_projectname": "python3-scipy-1.10.1",
"vendor": "Fedora Project COPR (psimovec/python3-scipy-1.10.1)"
}
}
]
}
[2025-03-06 18:41:32,517][ INFO][PID:587331] Sending fedora-messaging bus message in build.end
[2025-03-06 18:41:32,546][ INFO][PID:587331] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/builder-live.log by gzip
[2025-03-06 18:41:32,547][ INFO][PID:587331] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/builder-live.log' as PID 998200
[2025-03-06 18:41:32,833][ INFO][PID:587331] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/builder-live.log)
[2025-03-06 18:41:32,834][ INFO][PID:587331] Compressing /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/backend.log by gzip
[2025-03-06 18:41:32,835][ INFO][PID:587331] Running command 'gzip /var/lib/copr/public_html/results/psimovec/python3-scipy-1.10.1/fedora-41-i386/08736772-sdrangel/backend.log' as PID 998242