[2026-01-27 07:56:56,164][ INFO][PID:2050914] Marking build as starting [2026-01-27 07:56:56,339][ INFO][PID:2050914] Checking that /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/repodata/repomd.xml exists [2026-01-27 07:56:56,346][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:56:56,347][ INFO][PID:2050914] VM allocation process starts [2026-01-27 07:56:56,360][ INFO][PID:2050914] Trying to allocate VM: ResallocHost, ticket_id=1044051, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-27 07:56:59,373][ INFO][PID:2050914] Allocated host ResallocHost, ticket_id=1044051, hostname=3.81.230.48, name=aws_x86_64_spot_prod_01622555_20260127_074247, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-27 07:56:59,375][ INFO][PID:2050914] Allocating ssh connection to builder [2026-01-27 07:56:59,375][ INFO][PID:2050914] Checking that builder machine is OK [2026-01-27 07:57:59,448][ ERROR][PID:2050914] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 3.81.230.48 port 22: Connection timed out [2026-01-27 07:58:09,448][ ERROR][PID:2050914] Re-try request for task on 'ResallocHost, ticket_id=1044051, hostname=3.81.230.48, name=aws_x86_64_spot_prod_01622555_20260127_074247, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts [2026-01-27 07:58:09,449][ INFO][PID:2050914] Releasing VM back to pool [2026-01-27 07:58:09,459][ INFO][PID:2050914] Retry #1 (on other host) [2026-01-27 07:58:09,459][ INFO][PID:2050914] Checking that /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/repodata/repomd.xml exists [2026-01-27 07:58:09,460][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:58:09,460][ INFO][PID:2050914] VM allocation process starts [2026-01-27 07:58:09,473][ INFO][PID:2050914] Trying to allocate VM: ResallocHost, ticket_id=1044081, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-27 07:58:12,495][ INFO][PID:2050914] Allocated host ResallocHost, ticket_id=1044081, hostname=44.202.23.222, name=aws_x86_64_spot_prod_01622653_20260127_074907, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-27 07:58:12,496][ INFO][PID:2050914] Allocating ssh connection to builder [2026-01-27 07:58:12,496][ INFO][PID:2050914] Checking that builder machine is OK [2026-01-27 07:59:12,566][ ERROR][PID:2050914] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 44.202.23.222 port 22: Connection timed out [2026-01-27 07:59:22,567][ ERROR][PID:2050914] Re-try request for task on 'ResallocHost, ticket_id=1044081, hostname=44.202.23.222, name=aws_x86_64_spot_prod_01622653_20260127_074907, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts [2026-01-27 07:59:22,568][ INFO][PID:2050914] Releasing VM back to pool [2026-01-27 07:59:22,577][ INFO][PID:2050914] Retry #2 (on other host) [2026-01-27 07:59:22,578][ INFO][PID:2050914] Checking that /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/repodata/repomd.xml exists [2026-01-27 07:59:22,579][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:22,580][ INFO][PID:2050914] VM allocation process starts [2026-01-27 07:59:22,594][ INFO][PID:2050914] Trying to allocate VM: ResallocHost, ticket_id=1044106, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-27 07:59:25,611][ INFO][PID:2050914] Allocated host ResallocHost, ticket_id=1044106, hostname=18.207.92.30, name=aws_x86_64_spot_prod_01622740_20260127_075814, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-27 07:59:25,611][ INFO][PID:2050914] Allocating ssh connection to builder [2026-01-27 07:59:25,612][ INFO][PID:2050914] Checking that builder machine is OK [2026-01-27 07:59:25,956][ INFO][PID:2050914] Running remote command: copr-builder-ready epel-9-x86_64 [2026-01-27 07:59:26,180][ INFO][PID:2050914] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-01-27 07:59:26,181][ INFO][PID:2050914] Filling build.info file with builder info [2026-01-27 07:59:26,182][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:26,182][ INFO][PID:2050914] Not re-notifying FE and msg buses for the new host. [2026-01-27 07:59:26,183][ INFO][PID:2050914] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10066099-epel-9-x86_64 --chroot epel-9-x86_64 --detached [2026-01-27 07:59:26,532][ INFO][PID:2050914] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '18.207.92.30' (ED25519) to the list of known hosts. [2026-01-27 07:59:26,570][ INFO][PID:2050914] Downloading the builder-live.log file, attempt 1 [2026-01-27 07:59:26,578][ INFO][PID:2050914] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.207.92.30 copr-rpmbuild-log [2026-01-27 07:59:31,585][ INFO][PID:2050914] Periodic builder liveness probe: alive [2026-01-27 07:59:31,711][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:36,713][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:41,870][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:46,877][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:51,879][ INFO][PID:2050914] Checking for cancel request [2026-01-27 07:59:56,993][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:02,172][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:07,175][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:12,183][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:17,186][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:22,203][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:27,383][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:32,386][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:37,391][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:42,450][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:47,502][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:52,503][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:00:57,505][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:02,644][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:07,926][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:13,168][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:18,671][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:24,011][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:29,012][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:34,072][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:39,074][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:44,078][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:49,152][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:54,154][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:01:59,155][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:04,156][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:09,157][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:14,158][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:19,159][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:24,160][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:29,332][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:34,575][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:39,634][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:44,689][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:49,693][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:54,715][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:02:59,717][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:04,718][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:09,725][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:14,728][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:19,729][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:24,730][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:29,805][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:34,807][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:40,162][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:45,228][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:50,231][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:03:55,235][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:00,268][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:05,270][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:10,271][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:15,272][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:20,273][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:25,274][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:30,275][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:35,302][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:40,304][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:45,306][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:50,306][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:04:55,422][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:05:00,454][ INFO][PID:2050914] Checking for cancel request [2026-01-27 08:05:03,427][ INFO][PID:2050914] Downloading results from builder [2026-01-27 08:05:03,427][ INFO][PID:2050914] rsyncing of mockbuilder@18.207.92.30:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib started [2026-01-27 08:05:03,428][ INFO][PID:2050914] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@18.207.92.30:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/ &> /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/build-10066099.rsync.log [2026-01-27 08:05:03,782][ INFO][PID:2050914] rsyncing finished. [2026-01-27 08:05:03,782][ INFO][PID:2050914] Releasing VM back to pool [2026-01-27 08:05:03,791][ INFO][PID:2050914] Searching for 'success' file in resultdir [2026-01-27 08:05:03,792][ INFO][PID:2050914] Going to sign pkgs from source: 10066099-epel-9-x86_64 in chroot: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64 [2026-01-27 08:05:03,793][ INFO][PID:2050914] Calling '/bin/sign -u ron#bioinformatics@copr.fedorahosted.org -p' (attempt #1) [2026-01-27 08:05:03,978][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-debuginfo-1.23-1.el9.x86_64.rpm' (attempt #1) [2026-01-27 08:05:04,609][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-debuginfo-1.23-1.el9.x86_64.rpm [2026-01-27 08:05:04,610][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-tools-1.23-1.el9.x86_64.rpm' (attempt #1) [2026-01-27 08:05:05,223][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-tools-1.23-1.el9.x86_64.rpm [2026-01-27 08:05:05,224][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-1.23-1.el9.x86_64.rpm' (attempt #1) [2026-01-27 08:05:05,907][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-1.23-1.el9.x86_64.rpm [2026-01-27 08:05:05,907][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-debugsource-1.23-1.el9.x86_64.rpm' (attempt #1) [2026-01-27 08:05:06,666][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-debugsource-1.23-1.el9.x86_64.rpm [2026-01-27 08:05:06,667][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-1.23-1.el9.src.rpm' (attempt #1) [2026-01-27 08:05:07,654][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-1.23-1.el9.src.rpm [2026-01-27 08:05:07,655][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-tools-debuginfo-1.23-1.el9.x86_64.rpm' (attempt #1) [2026-01-27 08:05:08,567][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-tools-debuginfo-1.23-1.el9.x86_64.rpm [2026-01-27 08:05:08,567][ INFO][PID:2050914] Calling '/bin/sign -4 -h sha256 -u ron#bioinformatics@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-devel-1.23-1.el9.x86_64.rpm' (attempt #1) [2026-01-27 08:05:09,153][ INFO][PID:2050914] signed rpm: /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/htslib-devel-1.23-1.el9.x86_64.rpm [2026-01-27 08:05:09,154][ INFO][PID:2050914] Sign done [2026-01-27 08:05:09,154][ INFO][PID:2050914] Incremental createrepo run, adding 10066099-htslib into https://download.copr.fedorainfracloud.org/results/ron/bioinformatics/epel-9-x86_64, (auto-create-repo=True) [2026-01-27 08:05:09,156][ INFO][PID:2050914] Running command 'copr-repo --batched /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64 --add 10066099-htslib --no-appstream-metadata' as PID 2106196 [2026-01-27 08:05:09,911][ INFO][PID:2050914] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64 --add 10066099-htslib --no-appstream-metadata) [2026-01-27 08:05:09,912][ INFO][PID:2050914] Getting build details [2026-01-27 08:05:09,913][ INFO][PID:2050914] Listing built binary packages in /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib [2026-01-27 08:05:09,913][ INFO][PID:2050914] Built packages: ['htslib-tools-debuginfo 1.23', 'htslib-devel 1.23', 'htslib-tools 1.23', 'htslib-debuginfo 1.23', 'htslib-debugsource 1.23', 'htslib 1.23'] [2026-01-27 08:05:09,914][ INFO][PID:2050914] build details: {'built_packages': 'htslib-tools-debuginfo 1.23\nhtslib-devel 1.23\nhtslib-tools 1.23\nhtslib-debuginfo 1.23\nhtslib-debugsource 1.23\nhtslib 1.23'} [2026-01-27 08:05:09,914][ INFO][PID:2050914] Retrieving pubkey [2026-01-27 08:05:09,914][ INFO][PID:2050914] Calling '/bin/sign -u ron#bioinformatics@copr.fedorahosted.org -p' (attempt #1) [2026-01-27 08:05:10,250][ INFO][PID:2050914] Added pubkey for user ron project bioinformatics into: /var/lib/copr/public_html/results/ron/bioinformatics/pubkey.gpg [2026-01-27 08:05:10,251][ INFO][PID:2050914] Finished build: id=10066099 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/ron/bioinformatics chroot=epel-9-x86_64 [2026-01-27 08:05:10,253][ INFO][PID:2050914] Worker succeeded build, took 344.0705671310425 [2026-01-27 08:05:10,253][ INFO][PID:2050914] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ron", "project_name": "bioinformatics", "project_dirname": "bioinformatics", "submitter": "ron", "ended_on": 1769501110.2532496, "started_on": 1769500766.1826825, "submitted_on": null, "status": 1, "chroot": "epel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10066099-epel-9-x86_64", "build_id": 10066099, "package_name": "htslib", "package_version": "1.23-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ron/bioinformatics/htslib", "git_hash": "7f908d99caaa698e4edc070e538303e597a5ee85", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ron/bioinformatics--ron", "results": { "packages": [ { "name": "htslib-tools-debuginfo", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "x86_64" }, { "name": "htslib-devel", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "x86_64" }, { "name": "htslib-tools", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "x86_64" }, { "name": "htslib-debuginfo", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "x86_64" }, { "name": "htslib-debugsource", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "x86_64" }, { "name": "htslib", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "src" }, { "name": "htslib", "epoch": null, "version": "1.23", "release": "1.el9", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ron/bioinformatics/epel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ron/bioinformatics", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ron/bioinformatics", "result_dir": "10066099-htslib", "built_packages": "htslib-tools-debuginfo 1.23\nhtslib-devel 1.23\nhtslib-tools 1.23\nhtslib-debuginfo 1.23\nhtslib-debugsource 1.23\nhtslib 1.23", "id": 10066099, "mockchain_macros": { "copr_username": "ron", "copr_projectname": "bioinformatics", "vendor": "Fedora Project COPR (ron/bioinformatics)" } } ] } [2026-01-27 08:05:10,382][ INFO][PID:2050914] Sending fedora-messaging bus message in build.end [2026-01-27 08:05:10,896][ INFO][PID:2050914] Compressing /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/builder-live.log by gzip [2026-01-27 08:05:10,897][ INFO][PID:2050914] Running command 'gzip /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/builder-live.log' as PID 2106346 [2026-01-27 08:05:10,940][ INFO][PID:2050914] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/builder-live.log) [2026-01-27 08:05:10,941][ INFO][PID:2050914] Compressing /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/backend.log by gzip [2026-01-27 08:05:10,942][ INFO][PID:2050914] Running command 'gzip /var/lib/copr/public_html/results/ron/bioinformatics/epel-9-x86_64/10066099-htslib/backend.log' as PID 2106348