[2025-08-29 12:45:03,416][ INFO][PID:1982600] Marking build as starting [2025-08-29 12:45:03,611][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:03,612][ INFO][PID:1982600] VM allocation process starts [2025-08-29 12:45:03,655][ INFO][PID:1982600] Trying to allocate VM: ResallocHost, ticket_id=4817210, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-29 12:45:08,658][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:09,716][ INFO][PID:1982600] Allocated host ResallocHost, ticket_id=4817210, hostname=54.221.180.17, name=aws_x86_64_spot_prod_06493020_20250829_124151, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-29 12:45:09,718][ INFO][PID:1982600] Allocating ssh connection to builder [2025-08-29 12:45:09,719][ INFO][PID:1982600] Checking that builder machine is OK [2025-08-29 12:45:10,223][ INFO][PID:1982600] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-08-29 12:45:10,427][ INFO][PID:1982600] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-08-29 12:45:10,428][ INFO][PID:1982600] Filling build.info file with builder info [2025-08-29 12:45:10,429][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:10,433][ INFO][PID:1982600] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "medzik", "project_name": "jetbrains", "project_dirname": "jetbrains", "submitter": null, "ended_on": null, "started_on": 1756471510.4328082, "submitted_on": null, "status": 3, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9505763-fedora-41-x86_64", "build_id": 9505763, "package_name": "webstorm", "package_version": "2025.2.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/medzik/jetbrains/webstorm", "git_hash": "025a45b31d7725ff490bcd5ec11a5de6dc8a928e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "medzik/jetbrains--740c6757-aa6c-44a4-bf31-7f635d93a3d6", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/medzik/jetbrains/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/medzik/jetbrains", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/medzik/jetbrains", "result_dir": "09505763-webstorm", "built_packages": "", "id": 9505763, "mockchain_macros": { "copr_username": "medzik", "copr_projectname": "jetbrains", "vendor": "Fedora Project COPR (medzik/jetbrains)" } } ] } [2025-08-29 12:45:10,520][ INFO][PID:1982600] Sending fedora-messaging bus message in build.start [2025-08-29 12:45:11,656][ INFO][PID:1982600] Sending fedora-messaging bus message in chroot.start [2025-08-29 12:45:11,687][ INFO][PID:1982600] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9505763-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-08-29 12:45:12,010][ INFO][PID:1982600] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.221.180.17' (ED25519) to the list of known hosts. [2025-08-29 12:45:12,011][ INFO][PID:1982600] Downloading the builder-live.log file, attempt 1 [2025-08-29 12:45:12,013][ INFO][PID:1982600] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.221.180.17 copr-rpmbuild-log [2025-08-29 12:45:17,073][ INFO][PID:1982600] Periodic builder liveness probe: alive [2025-08-29 12:45:17,075][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:22,080][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:27,082][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:32,083][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:37,084][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:42,085][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:47,087][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:52,088][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:45:57,090][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:02,091][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:07,095][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:12,097][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:17,099][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:22,100][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:27,102][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:32,104][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:37,108][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:42,112][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:47,114][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:52,116][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:46:57,120][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:02,125][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:07,127][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:12,128][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:17,130][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:22,131][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:27,133][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:32,134][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:37,136][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:42,137][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:47,139][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:52,141][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:47:57,142][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:02,144][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:07,147][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:12,148][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:17,150][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:22,151][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:27,152][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:32,153][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:37,154][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:42,155][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:47,157][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:52,158][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:48:57,159][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:02,160][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:07,161][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:12,162][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:17,163][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:22,164][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:27,165][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:32,166][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:37,168][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:42,169][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:47,170][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:52,171][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:49:57,172][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:02,173][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:07,174][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:12,175][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:17,176][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:22,177][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:27,178][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:30,168][ ERROR][PID:1982600] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-29 12:50:32,179][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:37,180][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:40,169][WARNING][PID:1982600] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-29 12:50:42,181][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:47,182][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:50,169][ INFO][PID:1982600] Downloading the builder-live.log file, attempt 2 [2025-08-29 12:50:50,202][ INFO][PID:1982600] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.221.180.17 copr-rpmbuild-log [2025-08-29 12:50:52,183][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:50:57,184][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:02,185][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:07,186][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:12,187][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:17,189][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:22,190][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:27,191][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:32,192][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:37,193][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:42,194][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:47,196][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:50,270][ ERROR][PID:1982600] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-29 12:51:52,197][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:51:57,198][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:00,272][WARNING][PID:1982600] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-29 12:52:02,199][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:07,200][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:10,272][ INFO][PID:1982600] Downloading the builder-live.log file, attempt 3 [2025-08-29 12:52:10,274][ INFO][PID:1982600] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.221.180.17 copr-rpmbuild-log [2025-08-29 12:52:12,201][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:17,203][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:22,206][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:27,207][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:32,208][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:37,210][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:42,211][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:47,216][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:52,219][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:52:57,222][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:02,223][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:07,224][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:10,343][ ERROR][PID:1982600] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-29 12:53:12,227][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:17,230][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:20,346][WARNING][PID:1982600] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-29 12:53:22,232][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:27,245][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:30,350][ INFO][PID:1982600] Downloading the builder-live.log file, attempt 4 [2025-08-29 12:53:30,352][ INFO][PID:1982600] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.221.180.17 copr-rpmbuild-log [2025-08-29 12:53:32,246][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:37,247][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:42,254][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:47,256][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:52,260][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:53:57,264][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:02,268][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:07,269][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:12,270][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:17,272][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:22,273][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:27,275][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:30,435][ ERROR][PID:1982600] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-29 12:54:32,276][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:37,278][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:40,439][ ERROR][PID:1982600] Giving up for unstable SSH, failures: 1756471840.1692393, 1756471920.2719524, 1756472000.3460977, 1756472080.4391804 [2025-08-29 12:54:40,440][ ERROR][PID:1982600] Re-try request for task on 'ResallocHost, ticket_id=4817210, hostname=54.221.180.17, name=aws_x86_64_spot_prod_06493020_20250829_124151, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-08-29 12:54:40,441][ INFO][PID:1982600] Releasing VM back to pool [2025-08-29 12:54:40,453][ INFO][PID:1982600] Retry #1 (on other host) [2025-08-29 12:54:40,454][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:40,455][ INFO][PID:1982600] VM allocation process starts [2025-08-29 12:54:40,468][ INFO][PID:1982600] Trying to allocate VM: ResallocHost, ticket_id=4817372, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-29 12:54:45,469][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:50,470][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:54:55,474][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:00,476][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:05,478][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:10,479][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:15,480][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:18,596][ INFO][PID:1982600] Allocated host ResallocHost, ticket_id=4817372, hostname=3.80.148.109, name=aws_x86_64_spot_prod_06493273_20250829_125349, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-29 12:55:18,599][ INFO][PID:1982600] Allocating ssh connection to builder [2025-08-29 12:55:18,601][ INFO][PID:1982600] Checking that builder machine is OK [2025-08-29 12:55:19,116][ INFO][PID:1982600] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-08-29 12:55:19,345][ INFO][PID:1982600] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-08-29 12:55:19,345][ INFO][PID:1982600] Filling build.info file with builder info [2025-08-29 12:55:19,353][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:19,354][ INFO][PID:1982600] Not re-notifying FE and msg buses for the new host. [2025-08-29 12:55:19,356][ INFO][PID:1982600] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9505763-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-08-29 12:55:19,702][ INFO][PID:1982600] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.80.148.109' (ED25519) to the list of known hosts. [2025-08-29 12:55:19,708][ INFO][PID:1982600] Downloading the builder-live.log file, attempt 1 [2025-08-29 12:55:19,716][ INFO][PID:1982600] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.148.109 copr-rpmbuild-log [2025-08-29 12:55:24,738][ INFO][PID:1982600] Periodic builder liveness probe: alive [2025-08-29 12:55:24,740][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:29,743][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:34,745][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:39,749][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:44,750][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:49,752][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:54,753][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:55:59,754][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:04,755][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:09,757][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:14,758][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:19,759][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:24,761][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:29,763][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:34,767][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:39,769][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:44,771][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:49,772][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:54,774][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:56:59,775][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:04,776][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:09,777][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:14,778][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:19,779][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:24,780][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:29,780][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:34,782][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:39,783][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:44,784][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:49,785][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:54,786][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:57:59,787][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:04,789][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:09,791][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:14,794][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:19,796][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:24,799][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:29,800][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:34,801][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:39,802][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:44,803][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:49,804][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:54,805][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:58:59,807][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:04,808][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:09,809][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:14,810][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:19,812][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:24,813][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:29,814][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:34,815][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:39,816][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:44,817][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:49,819][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:54,820][ INFO][PID:1982600] Checking for cancel request [2025-08-29 12:59:59,821][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:06,205][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:11,250][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:16,287][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:21,619][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:26,628][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:32,111][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:37,363][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:42,377][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:47,750][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:52,752][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:00:57,754][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:02,768][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:07,772][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:12,774][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:17,778][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:22,785][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:27,787][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:32,793][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:37,802][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:42,804][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:47,807][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:52,928][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:01:57,946][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:02,986][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:08,133][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:13,150][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:18,159][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:23,169][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:28,193][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:33,196][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:38,201][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:43,213][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:48,254][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:53,266][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:02:58,339][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:03,446][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:08,569][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:13,577][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:18,670][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:23,857][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:28,864][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:34,031][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:39,089][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:44,137][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:49,352][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:03:54,569][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:00,089][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:05,368][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:10,500][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:15,648][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:20,754][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:25,902][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:30,915][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:36,224][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:41,229][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:53,495][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:04:58,557][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:03,686][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:09,961][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:15,491][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:21,414][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:26,694][ INFO][PID:1982600] Periodic builder liveness probe: alive [2025-08-29 13:05:26,895][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:31,897][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:37,042][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:42,097][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:47,113][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:52,226][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:05:57,465][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:02,558][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:07,795][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:12,817][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:18,122][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:23,171][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:28,173][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:33,174][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:38,176][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:43,177][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:48,211][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:53,224][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:06:58,238][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:03,242][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:08,247][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:13,253][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:18,256][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:23,274][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:28,289][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:33,319][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:38,326][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:43,336][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:48,545][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:53,651][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:07:58,665][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:03,696][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:08,796][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:17,596][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:22,713][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:27,768][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:32,791][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:37,803][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:42,815][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:47,822][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:52,824][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:08:57,829][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:02,835][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:07,842][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:12,856][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:17,860][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:22,873][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:27,890][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:32,906][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:37,915][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:42,924][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:47,941][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:52,949][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:09:57,958][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:02,978][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:08,242][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:13,296][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:18,329][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:23,345][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:28,353][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:33,364][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:38,382][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:43,393][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:48,398][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:53,417][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:10:58,424][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:03,436][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:08,446][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:13,457][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:18,471][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:23,477][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:28,481][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:33,483][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:38,487][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:43,501][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:48,510][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:53,513][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:11:58,516][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:03,525][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:08,527][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:13,529][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:18,534][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:23,541][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:28,542][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:33,544][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:38,547][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:43,549][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:48,556][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:53,558][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:12:58,566][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:03,569][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:08,570][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:13,585][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:18,587][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:23,593][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:28,598][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:33,601][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:38,608][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:43,611][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:48,612][ INFO][PID:1982600] Checking for cancel request [2025-08-29 13:13:49,158][ INFO][PID:1982600] Downloading results from builder [2025-08-29 13:13:49,160][ INFO][PID:1982600] rsyncing of mockbuilder@3.80.148.109:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm started [2025-08-29 13:13:49,164][ INFO][PID:1982600] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.80.148.109:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/ &> /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/build-09505763.rsync.log [2025-08-29 13:13:54,309][ INFO][PID:1982600] rsyncing finished. [2025-08-29 13:13:54,311][ INFO][PID:1982600] Releasing VM back to pool [2025-08-29 13:13:54,333][ INFO][PID:1982600] Searching for 'success' file in resultdir [2025-08-29 13:13:54,334][ INFO][PID:1982600] Going to sign pkgs from source: 9505763-fedora-41-x86_64 in chroot: /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64 [2025-08-29 13:13:54,336][ INFO][PID:1982600] Calling '/bin/sign -u medzik#jetbrains@copr.fedorahosted.org -p' (attempt #1) [2025-08-29 13:13:54,675][ INFO][PID:1982600] Calling '/bin/sign -4 -h sha256 -u medzik#jetbrains@copr.fedorahosted.org -r /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/webstorm-2025.2.1-1.fc41.src.rpm' (attempt #1) [2025-08-29 13:13:55,635][ INFO][PID:1982600] signed rpm: /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/webstorm-2025.2.1-1.fc41.src.rpm [2025-08-29 13:13:55,635][ INFO][PID:1982600] Calling '/bin/sign -4 -h sha256 -u medzik#jetbrains@copr.fedorahosted.org -r /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/webstorm-2025.2.1-1.fc41.x86_64.rpm' (attempt #1) [2025-08-29 13:14:14,125][ INFO][PID:1982600] signed rpm: /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/webstorm-2025.2.1-1.fc41.x86_64.rpm [2025-08-29 13:14:14,126][ INFO][PID:1982600] Calling '/bin/sign -4 -h sha256 -u medzik#jetbrains@copr.fedorahosted.org -r /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/webstorm-jbr-2025.2.1-1.fc41.x86_64.rpm' (attempt #1) [2025-08-29 13:14:18,944][ INFO][PID:1982600] signed rpm: /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/webstorm-jbr-2025.2.1-1.fc41.x86_64.rpm [2025-08-29 13:14:18,945][ INFO][PID:1982600] Sign done [2025-08-29 13:14:18,946][ INFO][PID:1982600] Incremental createrepo run, adding 09505763-webstorm into https://download.copr.fedorainfracloud.org/results/medzik/jetbrains/fedora-41-x86_64, (auto-create-repo=True) [2025-08-29 13:14:18,948][ INFO][PID:1982600] Running command 'copr-repo --batched /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64 --add 09505763-webstorm' as PID 2203287 [2025-08-29 13:20:05,328][ INFO][PID:1982600] Finished after 346 seconds with exit code 1 (copr-repo --batched /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64 --add 09505763-webstorm) stdout: stderr: Sub-command failed Traceback (most recent call last): File "/usr/bin/copr-repo", line 445, in main main_try_lock(opts, batch) ~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/bin/copr-repo", line 394, in main_try_lock main_locked(opts, batch, opts.log) ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/bin/copr-repo", line 359, in main_locked add_appdata(opts) ~~~~~~~~~~~^^^^^^ File "/usr/bin/copr-repo", line 242, in add_appdata run_cmd([ ~~~~~~~^^ "/usr/bin/timeout", "--kill-after=240", "180", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<10 lines>... "--origin=" + origin], ^^^^^^^^^^^^^^^^^^^^^^ check=True, logger=opts.log) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/site-packages/copr_backend/helpers.py", line 148, in run_cmd raise CommandException(exc_msg) copr_backend.helpers.CommandException: Command '/usr/bin/timeout --kill-after=240 180 /usr/bin/appstream-builder --temp-dir=/var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/tmp --cache-dir=/var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/cache --packages-dir=/var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64 --output-dir=/var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/appdata --basename=appstream --include-failed --min-icon-size=48 --veto-ignore=missing-parents --enable-hidpi --origin=medzik/jetbrains' failed, exit code '124 [2025-08-29 13:20:05,338][ ERROR][PID:1982600] Createrepo failed [2025-08-29 13:20:05,339][ ERROR][PID:1982600] Build failed: Backend process error: createrepo failed [2025-08-29 13:20:05,340][ INFO][PID:1982600] Finished build: id=9505763 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/medzik/jetbrains chroot=fedora-41-x86_64 [2025-08-29 13:20:05,342][ ERROR][PID:1982600] Backend process error: createrepo failed [2025-08-29 13:20:05,343][ INFO][PID:1982600] Worker failed build, took 1485.9885828495026 [2025-08-29 13:20:05,344][ INFO][PID:1982600] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "medzik", "project_name": "jetbrains", "project_dirname": "jetbrains", "submitter": null, "ended_on": 1756473605.3433614, "started_on": 1756472119.3547785, "submitted_on": null, "status": 0, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9505763-fedora-41-x86_64", "build_id": 9505763, "package_name": "webstorm", "package_version": "2025.2.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/medzik/jetbrains/webstorm", "git_hash": "025a45b31d7725ff490bcd5ec11a5de6dc8a928e", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "medzik/jetbrains--740c6757-aa6c-44a4-bf31-7f635d93a3d6", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/medzik/jetbrains/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/medzik/jetbrains", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/medzik/jetbrains", "result_dir": "09505763-webstorm", "built_packages": "", "id": 9505763, "mockchain_macros": { "copr_username": "medzik", "copr_projectname": "jetbrains", "vendor": "Fedora Project COPR (medzik/jetbrains)" } } ] } [2025-08-29 13:20:05,372][ INFO][PID:1982600] Sending fedora-messaging bus message in build.end [2025-08-29 13:20:05,400][ INFO][PID:1982600] Compressing /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/builder-live.log by gzip [2025-08-29 13:20:05,401][ INFO][PID:1982600] Running command 'gzip /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/builder-live.log' as PID 2247876 [2025-08-29 13:20:06,707][ INFO][PID:1982600] Finished after 1 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/builder-live.log) [2025-08-29 13:20:06,708][ INFO][PID:1982600] Compressing /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/backend.log by gzip [2025-08-29 13:20:06,709][ INFO][PID:1982600] Running command 'gzip /var/lib/copr/public_html/results/medzik/jetbrains/fedora-41-x86_64/09505763-webstorm/backend.log' as PID 2248029