[2026-02-06 16:30:37,451][ INFO][PID:3773333] Marking build as starting [2026-02-06 16:30:37,526][ INFO][PID:3773333] Checking that /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-02-06 16:30:37,553][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:30:37,555][ INFO][PID:3773333] VM allocation process starts [2026-02-06 16:30:37,570][ INFO][PID:3773333] Trying to allocate VM: ResallocHost, ticket_id=1203297, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-06 16:30:42,572][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:30:43,612][ INFO][PID:3773333] Allocated host ResallocHost, ticket_id=1203297, hostname=100.29.12.53, name=aws_x86_64_spot_prod_01983387_20260206_162825, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-06 16:30:43,613][ INFO][PID:3773333] Allocating ssh connection to builder [2026-02-06 16:30:43,613][ INFO][PID:3773333] Checking that builder machine is OK [2026-02-06 16:30:43,937][ INFO][PID:3773333] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-02-06 16:30:44,145][ INFO][PID:3773333] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-02-06 16:30:44,146][ INFO][PID:3773333] Filling build.info file with builder info [2026-02-06 16:30:44,149][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:30:44,151][ INFO][PID:3773333] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "solemnwarning", "project_name": "rehex-ci", "project_dirname": "rehex-ci", "submitter": "solemnwarning", "ended_on": null, "started_on": 1770395444.151101, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10100467-fedora-rawhide-x86_64", "build_id": 10100467, "package_name": "rehex", "package_version": "0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/solemnwarning/rehex-ci/rehex", "git_hash": "9933ff53952c53e4e13ed495c0d8341e106fa434", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "solemnwarning/rehex-ci--solemnwarning", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/solemnwarning/rehex-ci", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci", "result_dir": "10100467-rehex", "built_packages": "", "id": 10100467, "mockchain_macros": { "copr_username": "solemnwarning", "copr_projectname": "rehex-ci", "vendor": "Fedora Project COPR (solemnwarning/rehex-ci)" } } ] } [2026-02-06 16:30:44,220][ INFO][PID:3773333] Sending fedora-messaging bus message in build.start [2026-02-06 16:30:44,870][ INFO][PID:3773333] Sending fedora-messaging bus message in chroot.start [2026-02-06 16:30:44,897][ INFO][PID:3773333] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10100467-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-02-06 16:30:45,221][ INFO][PID:3773333] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.29.12.53' (ED25519) to the list of known hosts. [2026-02-06 16:30:45,222][ INFO][PID:3773333] Downloading the builder-live.log file, attempt 1 [2026-02-06 16:30:45,224][ INFO][PID:3773333] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.29.12.53 copr-rpmbuild-log [2026-02-06 16:30:50,228][ INFO][PID:3773333] Periodic builder liveness probe: alive [2026-02-06 16:30:50,228][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:30:55,229][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:00,230][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:05,231][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:10,232][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:15,233][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:20,234][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:25,236][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:30,237][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:35,238][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:40,243][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:45,245][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:50,246][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:31:55,248][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:00,249][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:05,251][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:10,253][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:15,256][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:20,258][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:25,260][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:30,262][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:35,264][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:40,266][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:45,268][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:50,271][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:32:55,272][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:00,273][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:05,274][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:10,275][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:15,277][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:20,278][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:25,278][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:30,280][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:35,281][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:40,282][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:45,283][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:50,284][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:33:55,286][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:00,287][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:05,288][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:10,289][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:15,290][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:20,293][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:25,294][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:30,299][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:35,300][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:38,635][ ERROR][PID:3773333] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-06 16:34:40,301][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:45,304][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:48,636][WARNING][PID:3773333] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-06 16:34:50,305][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:55,307][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:34:58,638][ INFO][PID:3773333] Downloading the builder-live.log file, attempt 2 [2026-02-06 16:34:58,640][ INFO][PID:3773333] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.29.12.53 copr-rpmbuild-log [2026-02-06 16:35:00,311][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:05,312][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:10,313][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:15,315][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:20,317][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:25,321][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:30,322][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:35,323][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:40,324][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:45,325][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:50,326][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:55,327][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:35:58,709][ ERROR][PID:3773333] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-06 16:36:00,328][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:05,330][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:08,723][WARNING][PID:3773333] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-06 16:36:10,331][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:15,332][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:18,725][ INFO][PID:3773333] Downloading the builder-live.log file, attempt 3 [2026-02-06 16:36:18,727][ INFO][PID:3773333] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.29.12.53 copr-rpmbuild-log [2026-02-06 16:36:20,333][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:25,335][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:30,337][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:35,338][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:40,343][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:45,344][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:50,348][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:36:55,351][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:00,353][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:05,359][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:10,362][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:15,365][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:18,801][ ERROR][PID:3773333] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-06 16:37:20,368][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:25,371][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:28,811][WARNING][PID:3773333] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-02-06 16:37:30,376][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:35,378][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:38,813][ INFO][PID:3773333] Downloading the builder-live.log file, attempt 4 [2026-02-06 16:37:38,815][ INFO][PID:3773333] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.29.12.53 copr-rpmbuild-log [2026-02-06 16:37:40,384][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:45,387][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:50,389][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:37:55,391][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:00,393][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:05,394][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:10,395][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:15,396][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:20,397][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:25,398][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:30,399][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:35,400][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:38,886][ ERROR][PID:3773333] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-02-06 16:38:40,403][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:45,404][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:48,888][ ERROR][PID:3773333] Giving up for unstable SSH, failures: 1770395688.6364157, 1770395768.7238564, 1770395848.8115458, 1770395928.8878946 [2026-02-06 16:38:48,889][ ERROR][PID:3773333] Re-try request for task on 'ResallocHost, ticket_id=1203297, hostname=100.29.12.53, name=aws_x86_64_spot_prod_01983387_20260206_162825, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-02-06 16:38:48,890][ INFO][PID:3773333] Releasing VM back to pool [2026-02-06 16:38:48,901][ INFO][PID:3773333] Retry #1 (on other host) [2026-02-06 16:38:48,902][ INFO][PID:3773333] Checking that /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-02-06 16:38:48,903][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:48,904][ INFO][PID:3773333] VM allocation process starts [2026-02-06 16:38:48,918][ INFO][PID:3773333] Trying to allocate VM: ResallocHost, ticket_id=1203401, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-06 16:38:53,920][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:54,953][ INFO][PID:3773333] Allocated host ResallocHost, ticket_id=1203401, hostname=100.24.70.101, name=aws_x86_64_normalreserved_prod_01983851_20260206_163649, requested_tags=['copr_builder', 'arch_x86_64'] [2026-02-06 16:38:54,955][ INFO][PID:3773333] Allocating ssh connection to builder [2026-02-06 16:38:54,956][ INFO][PID:3773333] Checking that builder machine is OK [2026-02-06 16:38:55,325][ INFO][PID:3773333] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-02-06 16:38:55,599][ INFO][PID:3773333] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-02-06 16:38:55,601][ INFO][PID:3773333] Filling build.info file with builder info [2026-02-06 16:38:55,612][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:38:55,623][ INFO][PID:3773333] Not re-notifying FE and msg buses for the new host. [2026-02-06 16:38:55,623][ INFO][PID:3773333] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10100467-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-02-06 16:38:56,006][ INFO][PID:3773333] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.24.70.101' (ED25519) to the list of known hosts. [2026-02-06 16:38:56,007][ INFO][PID:3773333] Downloading the builder-live.log file, attempt 1 [2026-02-06 16:38:56,013][ INFO][PID:3773333] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.24.70.101 copr-rpmbuild-log [2026-02-06 16:39:01,011][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:06,012][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:11,013][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:16,017][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:21,020][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:26,021][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:31,022][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:36,027][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:41,033][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:46,037][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:51,040][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:39:56,059][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:01,061][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:06,062][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:11,064][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:16,069][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:21,072][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:26,081][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:31,082][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:36,151][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:41,152][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:46,154][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:51,172][ INFO][PID:3773333] Periodic builder liveness probe: alive [2026-02-06 16:40:51,173][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:40:56,175][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:01,176][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:06,178][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:11,191][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:16,194][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:21,198][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:26,200][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:31,207][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:36,209][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:41,211][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:46,219][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:51,222][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:41:56,225][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:01,227][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:06,228][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:11,230][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:16,232][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:21,233][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:26,234][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:31,235][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:36,239][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:41,245][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:46,248][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:51,251][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:42:56,254][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:01,255][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:06,256][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:11,259][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:16,261][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:21,263][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:26,264][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:31,265][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:36,266][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:41,270][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:46,271][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:51,272][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:43:56,273][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:01,274][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:06,276][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:11,277][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:16,278][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:21,279][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:26,283][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:31,284][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:36,286][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:41,290][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:46,293][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:51,294][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:44:56,296][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:01,299][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:06,300][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:11,301][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:16,302][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:21,303][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:26,304][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:31,305][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:36,306][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:41,307][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:46,308][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:51,310][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:45:56,311][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:01,312][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:06,315][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:11,317][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:16,318][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:21,319][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:26,320][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:31,321][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:36,322][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:41,323][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:46,324][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:51,325][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:46:56,327][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:01,328][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:06,330][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:11,332][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:16,334][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:21,335][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:26,337][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:31,340][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:36,341][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:41,342][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:46,343][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:51,344][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:47:56,346][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:01,347][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:06,348][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:11,350][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:16,351][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:21,352][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:26,353][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:31,354][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:36,355][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:41,356][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:46,357][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:51,358][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:48:56,360][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:01,361][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:06,362][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:11,364][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:16,366][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:21,369][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:26,371][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:31,372][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:36,374][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:41,376][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:46,377][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:51,379][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:49:56,380][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:50:01,381][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:50:06,382][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:50:11,383][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:50:16,385][ INFO][PID:3773333] Checking for cancel request [2026-02-06 16:50:17,662][ INFO][PID:3773333] Downloading results from builder [2026-02-06 16:50:17,663][ INFO][PID:3773333] rsyncing of mockbuilder@100.24.70.101:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex started [2026-02-06 16:50:17,663][ INFO][PID:3773333] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@100.24.70.101:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/ &> /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/build-10100467.rsync.log [2026-02-06 16:50:18,248][ INFO][PID:3773333] rsyncing finished. [2026-02-06 16:50:18,249][ INFO][PID:3773333] Releasing VM back to pool [2026-02-06 16:50:18,260][ INFO][PID:3773333] Searching for 'success' file in resultdir [2026-02-06 16:50:18,261][ INFO][PID:3773333] Going to sign pkgs from source: 10100467-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64 [2026-02-06 16:50:18,262][ INFO][PID:3773333] Calling '/bin/sign -u solemnwarning#rehex-ci@copr.fedorahosted.org -p' (attempt #1) [2026-02-06 16:50:18,536][ INFO][PID:3773333] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.x86_64.rpm' (attempt #1) [2026-02-06 16:50:19,208][ INFO][PID:3773333] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.x86_64.rpm [2026-02-06 16:50:19,209][ INFO][PID:3773333] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-debugsource-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.x86_64.rpm' (attempt #1) [2026-02-06 16:50:19,914][ INFO][PID:3773333] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-debugsource-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.x86_64.rpm [2026-02-06 16:50:19,915][ INFO][PID:3773333] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.src.rpm' (attempt #1) [2026-02-06 16:50:20,740][ INFO][PID:3773333] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.src.rpm [2026-02-06 16:50:20,740][ INFO][PID:3773333] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-debuginfo-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.x86_64.rpm' (attempt #1) [2026-02-06 16:50:21,675][ INFO][PID:3773333] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/rehex-debuginfo-0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0~fc45.x86_64.rpm [2026-02-06 16:50:21,675][ INFO][PID:3773333] Sign done [2026-02-06 16:50:21,676][ INFO][PID:3773333] Incremental createrepo run, adding 10100467-rehex into https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64, (auto-create-repo=True) [2026-02-06 16:50:21,677][ INFO][PID:3773333] Running command 'copr-repo --batched /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64 --add 10100467-rehex --no-appstream-metadata' as PID 3898654 [2026-02-06 16:50:22,839][ INFO][PID:3773333] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64 --add 10100467-rehex --no-appstream-metadata) [2026-02-06 16:50:22,840][ INFO][PID:3773333] Getting build details [2026-02-06 16:50:22,840][ INFO][PID:3773333] Listing built binary packages in /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex [2026-02-06 16:50:22,841][ INFO][PID:3773333] Built packages: ['rehex-debugsource 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409', 'rehex-debuginfo 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409', 'rehex 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409'] [2026-02-06 16:50:22,841][ INFO][PID:3773333] build details: {'built_packages': 'rehex-debugsource 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409\nrehex-debuginfo 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409\nrehex 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409'} [2026-02-06 16:50:22,842][ INFO][PID:3773333] Retrieving pubkey [2026-02-06 16:50:22,842][ INFO][PID:3773333] Calling '/bin/sign -u solemnwarning#rehex-ci@copr.fedorahosted.org -p' (attempt #1) [2026-02-06 16:50:23,037][ INFO][PID:3773333] Added pubkey for user solemnwarning project rehex-ci into: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/pubkey.gpg [2026-02-06 16:50:23,038][ INFO][PID:3773333] Finished build: id=10100467 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/solemnwarning/rehex-ci chroot=fedora-rawhide-x86_64 [2026-02-06 16:50:23,039][ INFO][PID:3773333] Worker succeeded build, took 687.4165458679199 [2026-02-06 16:50:23,040][ INFO][PID:3773333] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "solemnwarning", "project_name": "rehex-ci", "project_dirname": "rehex-ci", "submitter": "solemnwarning", "ended_on": 1770396623.0396547, "started_on": 1770395935.6231089, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10100467-fedora-rawhide-x86_64", "build_id": 10100467, "package_name": "rehex", "package_version": "0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409-0", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/solemnwarning/rehex-ci/rehex", "git_hash": "9933ff53952c53e4e13ed495c0d8341e106fa434", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "solemnwarning/rehex-ci--solemnwarning", "results": { "packages": [ { "name": "rehex-debugsource", "epoch": null, "version": "0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409", "release": "0~fc45", "arch": "x86_64" }, { "name": "rehex-debuginfo", "epoch": null, "version": "0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409", "release": "0~fc45", "arch": "x86_64" }, { "name": "rehex", "epoch": null, "version": "0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409", "release": "0~fc45", "arch": "src" }, { "name": "rehex", "epoch": null, "version": "0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409", "release": "0~fc45", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/solemnwarning/rehex-ci", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci", "result_dir": "10100467-rehex", "built_packages": "rehex-debugsource 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409\nrehex-debuginfo 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409\nrehex 0.63.4+f766ea6b77e71846b85ced6675a6bc1588751409", "id": 10100467, "mockchain_macros": { "copr_username": "solemnwarning", "copr_projectname": "rehex-ci", "vendor": "Fedora Project COPR (solemnwarning/rehex-ci)" } } ] } [2026-02-06 16:50:23,090][ INFO][PID:3773333] Sending fedora-messaging bus message in build.end [2026-02-06 16:50:23,119][ INFO][PID:3773333] Compressing /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/builder-live.log by gzip [2026-02-06 16:50:23,120][ INFO][PID:3773333] Running command 'gzip /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/builder-live.log' as PID 3898812 [2026-02-06 16:50:23,231][ INFO][PID:3773333] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/builder-live.log) [2026-02-06 16:50:23,232][ INFO][PID:3773333] Compressing /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/backend.log by gzip [2026-02-06 16:50:23,233][ INFO][PID:3773333] Running command 'gzip /var/lib/copr/public_html/results/solemnwarning/rehex-ci/fedora-rawhide-x86_64/10100467-rehex/backend.log' as PID 3898821