[2026-02-09 12:34:08,858][ INFO][PID:3455547] Marking build as starting [2026-02-09 12:34:08,948][ INFO][PID:3455547] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/epel-9-x86_64//repodata/repomd.xml exists [2026-02-09 12:34:09,490][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:09,495][ INFO][PID:3455547] VM allocation process starts [2026-02-09 12:34:09,522][ INFO][PID:3455547] Trying to allocate VM: ResallocHost, ticket_id=1235791, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-09 12:34:12,559][ INFO][PID:3455547] Allocated host ResallocHost, ticket_id=1235791, hostname=54.172.196.202, name=aws_x86_64_spot_prod_02076620_20260209_123101, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-09 12:34:12,560][ INFO][PID:3455547] Allocating ssh connection to builder [2026-02-09 12:34:12,560][ INFO][PID:3455547] Checking that builder machine is OK [2026-02-09 12:34:12,883][ INFO][PID:3455547] Running remote command: copr-builder-ready epel-9-x86_64 [2026-02-09 12:34:13,153][ INFO][PID:3455547] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-02-09 12:34:13,153][ INFO][PID:3455547] Filling build.info file with builder info [2026-02-09 12:34:13,156][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:13,158][ INFO][PID:3455547] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-dev", "project_dirname": "copr-dev", "submitter": "packit", "ended_on": null, "started_on": 1770640453.1581535, "submitted_on": null, "status": 3, "chroot": "epel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10108948-epel-9-x86_64", "build_id": 10108948, "package_name": "dist-git-client", "package_version": "1.2-1.20260209123347053612.main.3.g631ea50", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-dev/dist-git-client", "git_hash": "a596718b15161c06268d5b38c10920fb615717fa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-dev--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/epel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-dev", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev", "result_dir": "10108948-dist-git-client", "built_packages": "", "id": 10108948, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-dev", "vendor": "Fedora Project COPR (@copr/copr-dev)" } } ] } [2026-02-09 12:34:13,225][ INFO][PID:3455547] Sending fedora-messaging bus message in build.start [2026-02-09 12:34:14,129][ INFO][PID:3455547] Sending fedora-messaging bus message in chroot.start [2026-02-09 12:34:14,182][ INFO][PID:3455547] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10108948-epel-9-x86_64 --chroot epel-9-x86_64 --detached [2026-02-09 12:34:14,563][ INFO][PID:3455547] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.172.196.202' (ED25519) to the list of known hosts. [2026-02-09 12:34:14,564][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 1 [2026-02-09 12:34:14,586][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.172.196.202 copr-rpmbuild-log [2026-02-09 12:34:19,580][ INFO][PID:3455547] Periodic builder liveness probe: alive [2026-02-09 12:34:19,582][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:24,584][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:29,587][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:34,589][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:39,590][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:44,591][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:49,593][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:54,611][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:34:59,615][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:04,617][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:09,621][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:14,622][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:15,566][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:35:19,623][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:24,625][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:25,567][WARNING][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-09 12:35:29,626][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:34,682][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:35,568][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 2 [2026-02-09 12:35:35,570][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.172.196.202 copr-rpmbuild-log [2026-02-09 12:35:39,683][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:44,684][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:49,685][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:54,702][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:35:59,703][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:04,704][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:09,705][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:14,706][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:19,707][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:24,727][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:29,728][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:34,729][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:35,650][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:36:39,730][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:44,733][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:45,667][WARNING][PID:3455547] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-09 12:36:49,735][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:54,736][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:36:55,668][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 3 [2026-02-09 12:36:55,669][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.172.196.202 copr-rpmbuild-log [2026-02-09 12:36:59,738][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:04,739][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:09,740][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:14,741][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:19,742][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:24,743][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:29,744][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:34,745][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:39,746][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:44,748][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:49,750][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:54,750][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:37:55,737][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:37:59,751][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:04,752][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:05,744][WARNING][PID:3455547] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-09 12:38:09,832][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:14,833][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:15,746][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 4 [2026-02-09 12:38:15,747][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.172.196.202 copr-rpmbuild-log [2026-02-09 12:38:19,834][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:24,871][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:29,872][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:34,873][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:39,883][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:44,885][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:49,886][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:54,888][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:38:59,889][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:04,890][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:09,892][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:14,894][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:15,815][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:39:19,955][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:24,956][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:25,888][ ERROR][PID:3455547] Giving up for unstable SSH, failures: 1770640525.567224, 1770640605.667526, 1770640685.7440777, 1770640765.8883202 [2026-02-09 12:39:25,889][ ERROR][PID:3455547] Re-try request for task on 'ResallocHost, ticket_id=1235791, hostname=54.172.196.202, name=aws_x86_64_spot_prod_02076620_20260209_123101, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-02-09 12:39:25,890][ INFO][PID:3455547] Releasing VM back to pool [2026-02-09 12:39:25,903][ INFO][PID:3455547] Retry #1 (on other host) [2026-02-09 12:39:25,904][ INFO][PID:3455547] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/epel-9-x86_64//repodata/repomd.xml exists [2026-02-09 12:39:26,460][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:26,461][ INFO][PID:3455547] VM allocation process starts [2026-02-09 12:39:26,472][ INFO][PID:3455547] Trying to allocate VM: ResallocHost, ticket_id=1235874, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-09 12:39:29,488][ INFO][PID:3455547] Allocated host ResallocHost, ticket_id=1235874, hostname=44.210.150.238, name=aws_x86_64_spot_prod_02076907_20260209_123500, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-09 12:39:29,489][ INFO][PID:3455547] Allocating ssh connection to builder [2026-02-09 12:39:29,490][ INFO][PID:3455547] Checking that builder machine is OK [2026-02-09 12:39:29,841][ INFO][PID:3455547] Running remote command: copr-builder-ready epel-9-x86_64 [2026-02-09 12:39:30,089][ INFO][PID:3455547] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-02-09 12:39:30,090][ INFO][PID:3455547] Filling build.info file with builder info [2026-02-09 12:39:30,187][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:30,188][ INFO][PID:3455547] Not re-notifying FE and msg buses for the new host. [2026-02-09 12:39:30,189][ INFO][PID:3455547] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10108948-epel-9-x86_64 --chroot epel-9-x86_64 --detached [2026-02-09 12:39:30,537][ INFO][PID:3455547] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.210.150.238' (ED25519) to the list of known hosts. [2026-02-09 12:39:30,538][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 1 [2026-02-09 12:39:30,540][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.150.238 copr-rpmbuild-log [2026-02-09 12:39:35,541][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:40,542][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:45,544][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:50,545][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:39:55,546][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:00,551][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:05,552][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:10,555][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:15,557][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:20,560][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:25,561][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:27,417][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:40:30,562][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:35,563][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:37,497][WARNING][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-09 12:40:40,565][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:45,568][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:47,498][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 2 [2026-02-09 12:40:47,502][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.150.238 copr-rpmbuild-log [2026-02-09 12:40:50,571][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:40:55,572][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:00,574][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:05,575][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:10,576][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:15,577][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:20,578][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:25,579][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:30,580][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:35,581][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:40,582][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:45,583][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:47,566][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:41:50,584][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:55,585][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:41:57,591][WARNING][PID:3455547] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-09 12:42:00,586][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:05,587][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:07,592][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 3 [2026-02-09 12:42:07,593][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.150.238 copr-rpmbuild-log [2026-02-09 12:42:10,588][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:15,637][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:20,639][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:25,640][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:30,642][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:35,643][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:40,853][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:45,854][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:50,856][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:42:55,858][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:00,860][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:05,860][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:07,660][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:43:10,872][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:15,873][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:17,779][WARNING][PID:3455547] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-09 12:43:20,874][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:25,875][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:27,779][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 4 [2026-02-09 12:43:27,781][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.210.150.238 copr-rpmbuild-log [2026-02-09 12:43:30,876][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:35,877][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:40,878][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:45,879][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:50,880][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:43:55,881][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:00,883][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:05,884][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:10,885][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:15,886][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:20,892][ INFO][PID:3455547] Periodic builder liveness probe: alive [2026-02-09 12:44:20,893][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:25,894][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:27,847][ ERROR][PID:3455547] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-09 12:44:30,895][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:35,925][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:37,848][ ERROR][PID:3455547] Giving up for unstable SSH, failures: 1770640837.497483, 1770640917.5917997, 1770640997.7790642, 1770641077.8486629 [2026-02-09 12:44:37,849][ ERROR][PID:3455547] Re-try request for task on 'ResallocHost, ticket_id=1235874, hostname=44.210.150.238, name=aws_x86_64_spot_prod_02076907_20260209_123500, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-02-09 12:44:37,850][ INFO][PID:3455547] Releasing VM back to pool [2026-02-09 12:44:37,864][ INFO][PID:3455547] Retry #2 (on other host) [2026-02-09 12:44:37,865][ INFO][PID:3455547] Checking that https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/epel-9-x86_64//repodata/repomd.xml exists [2026-02-09 12:44:38,907][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:38,911][ INFO][PID:3455547] VM allocation process starts [2026-02-09 12:44:38,932][ INFO][PID:3455547] Trying to allocate VM: ResallocHost, ticket_id=1235954, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-09 12:44:41,957][ INFO][PID:3455547] Allocated host ResallocHost, ticket_id=1235954, hostname=52.90.120.163, name=aws_x86_64_spot_prod_02077010_20260209_123949, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-09 12:44:41,958][ INFO][PID:3455547] Allocating ssh connection to builder [2026-02-09 12:44:41,958][ INFO][PID:3455547] Checking that builder machine is OK [2026-02-09 12:44:42,284][ INFO][PID:3455547] Running remote command: copr-builder-ready epel-9-x86_64 [2026-02-09 12:44:42,478][ INFO][PID:3455547] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2026-02-09 12:44:42,478][ INFO][PID:3455547] Filling build.info file with builder info [2026-02-09 12:44:42,508][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:42,508][ INFO][PID:3455547] Not re-notifying FE and msg buses for the new host. [2026-02-09 12:44:42,509][ INFO][PID:3455547] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10108948-epel-9-x86_64 --chroot epel-9-x86_64 --detached [2026-02-09 12:44:42,827][ INFO][PID:3455547] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '52.90.120.163' (ED25519) to the list of known hosts. [2026-02-09 12:44:42,828][ INFO][PID:3455547] Downloading the builder-live.log file, attempt 1 [2026-02-09 12:44:42,829][ INFO][PID:3455547] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@52.90.120.163 copr-rpmbuild-log [2026-02-09 12:44:47,828][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:52,829][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:44:57,830][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:02,831][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:07,832][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:12,834][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:17,835][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:22,836][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:27,838][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:32,839][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:37,840][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:42,841][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:47,842][ INFO][PID:3455547] Checking for cancel request [2026-02-09 12:45:51,127][ INFO][PID:3455547] Downloading results from builder [2026-02-09 12:45:51,128][ INFO][PID:3455547] rsyncing of mockbuilder@52.90.120.163:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client started [2026-02-09 12:45:51,129][ INFO][PID:3455547] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@52.90.120.163:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/ &> /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/build-10108948.rsync.log [2026-02-09 12:45:51,408][ INFO][PID:3455547] rsyncing finished. [2026-02-09 12:45:51,409][ INFO][PID:3455547] Releasing VM back to pool [2026-02-09 12:45:51,418][ INFO][PID:3455547] Searching for 'success' file in resultdir [2026-02-09 12:45:51,418][ INFO][PID:3455547] Going to sign pkgs from source: 10108948-epel-9-x86_64 in chroot: /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64 [2026-02-09 12:45:51,419][ INFO][PID:3455547] Calling '/bin/sign -u @copr#copr-dev@copr.fedorahosted.org -p' (attempt #1) [2026-02-09 12:45:51,685][ INFO][PID:3455547] Calling '/bin/sign -4 -h sha256 -u @copr#copr-dev@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.noarch.rpm' (attempt #1) [2026-02-09 12:45:52,290][ INFO][PID:3455547] signed rpm: /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.noarch.rpm [2026-02-09 12:45:52,291][ INFO][PID:3455547] Calling '/bin/sign -4 -h sha256 -u @copr#copr-dev@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.src.rpm' (attempt #1) [2026-02-09 12:45:52,796][ INFO][PID:3455547] signed rpm: /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.src.rpm [2026-02-09 12:45:52,796][ INFO][PID:3455547] Sign done [2026-02-09 12:45:52,797][ INFO][PID:3455547] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.noarch.rpm [2026-02-09 12:45:53,529][ INFO][PID:3455547] [1/2] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.noarch.rpm [2026-02-09 12:45:53,529][ INFO][PID:3455547] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.src.rpm [2026-02-09 12:45:54,448][ INFO][PID:3455547] [2/2] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.src.rpm [2026-02-09 12:45:54,452][ INFO][PID:3455547] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fcopr-dev%2Fepel-9-x86_64&offset=0&limit=1 [2026-02-09 12:45:54,753][ INFO][PID:3455547] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c426f-e29c-7c31-a149-14916e3a26d2/ [2026-02-09 12:45:54,754][ INFO][PID:3455547] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c426f-e29c-7c31-a149-14916e3a26d2/ [2026-02-09 12:45:59,906][ INFO][PID:3455547] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c426f-e29c-7c31-a149-14916e3a26d2/ [2026-02-09 12:45:59,906][ INFO][PID:3455547] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c426f-e29c-7c31-a149-14916e3a26d2/ [2026-02-09 12:46:00,042][ INFO][PID:3455547] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/0195eecb-29de-71aa-a021-569ca980e957/ [2026-02-09 12:46:00,043][ INFO][PID:3455547] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/0195eecb-29de-71aa-a021-569ca980e957/ [2026-02-09 12:46:00,193][ INFO][PID:3455547] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c426f-f7dd-7f02-ba48-bbe7732c2a8b/ [2026-02-09 12:46:00,194][ INFO][PID:3455547] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c426f-f7dd-7f02-ba48-bbe7732c2a8b/ [2026-02-09 12:46:05,315][ INFO][PID:3455547] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019c426f-f7dd-7f02-ba48-bbe7732c2a8b/ [2026-02-09 12:46:05,315][ INFO][PID:3455547] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019c426f-f7dd-7f02-ba48-bbe7732c2a8b/ [2026-02-09 12:46:05,443][ INFO][PID:3455547] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/0195eecb-29de-71aa-a021-569ca980e957/ [2026-02-09 12:46:05,445][ INFO][PID:3455547] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/0195eecb-29de-71aa-a021-569ca980e957/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019c426f-dd8d-7e4f-af1f-f5242ac4dcdb/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019c426f-e12d-76b1-b847-9a1adfec135c/']) [2026-02-09 12:46:05,447][ INFO][PID:3455547] Getting build details [2026-02-09 12:46:05,447][ INFO][PID:3455547] Listing built binary packages in /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client [2026-02-09 12:46:05,447][ INFO][PID:3455547] Built packages: ['dist-git-client 1.2'] [2026-02-09 12:46:05,448][ INFO][PID:3455547] build details: {'built_packages': 'dist-git-client 1.2'} [2026-02-09 12:46:05,448][ INFO][PID:3455547] Retrieving pubkey [2026-02-09 12:46:05,449][ INFO][PID:3455547] Calling '/bin/sign -u @copr#copr-dev@copr.fedorahosted.org -p' (attempt #1) [2026-02-09 12:46:05,744][ INFO][PID:3455547] Added pubkey for user @copr project copr-dev into: /var/lib/copr/public_html/results/@copr/copr-dev/pubkey.gpg [2026-02-09 12:46:05,745][ INFO][PID:3455547] Removing /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.noarch.rpm, it is stored in Pulp [2026-02-09 12:46:05,745][ INFO][PID:3455547] Removing /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/dist-git-client-1.2-1.20260209123347053612.main.3.g631ea50.el9.src.rpm, it is stored in Pulp [2026-02-09 12:46:05,746][ INFO][PID:3455547] Finished build: id=10108948 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr-dev chroot=epel-9-x86_64 [2026-02-09 12:46:05,748][ INFO][PID:3455547] Worker succeeded build, took 83.23959922790527 [2026-02-09 12:46:05,749][ INFO][PID:3455547] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr-dev", "project_dirname": "copr-dev", "submitter": "packit", "ended_on": 1770641165.74846, "started_on": 1770641082.5088608, "submitted_on": null, "status": 1, "chroot": "epel-9-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10108948-epel-9-x86_64", "build_id": 10108948, "package_name": "dist-git-client", "package_version": "1.2-1.20260209123347053612.main.3.g631ea50", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr-dev/dist-git-client", "git_hash": "a596718b15161c06268d5b38c10920fb615717fa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr-dev--packit", "results": { "packages": [ { "name": "dist-git-client", "epoch": null, "version": "1.2", "release": "1.20260209123347053612.main.3.g631ea50.el9", "arch": "noarch" }, { "name": "dist-git-client", "epoch": null, "version": "1.2", "release": "1.20260209123347053612.main.3.g631ea50.el9", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev/epel-9-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr-dev", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr-dev", "result_dir": "10108948-dist-git-client", "built_packages": "dist-git-client 1.2", "id": 10108948, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr-dev", "vendor": "Fedora Project COPR (@copr/copr-dev)" } } ] } [2026-02-09 12:46:05,813][ INFO][PID:3455547] Sending fedora-messaging bus message in build.end [2026-02-09 12:46:05,843][ INFO][PID:3455547] Compressing /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/builder-live.log by gzip [2026-02-09 12:46:05,844][ INFO][PID:3455547] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/builder-live.log' as PID 3533629 [2026-02-09 12:46:05,869][ INFO][PID:3455547] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/builder-live.log) [2026-02-09 12:46:05,869][ INFO][PID:3455547] Compressing /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/backend.log by gzip [2026-02-09 12:46:05,870][ INFO][PID:3455547] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr-dev/epel-9-x86_64/10108948-dist-git-client/backend.log' as PID 3533630