[2026-01-12 19:16:59,019][ INFO][PID:2260261] Marking build as starting [2026-01-12 19:16:59,159][ INFO][PID:2260261] Checking that /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-12 19:16:59,172][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:16:59,174][ INFO][PID:2260261] VM allocation process starts [2026-01-12 19:16:59,200][ INFO][PID:2260261] Trying to allocate VM: ResallocHost, ticket_id=782351, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:17:04,203][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:09,209][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:14,211][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:19,214][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:24,217][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:29,218][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:34,223][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:39,224][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:44,225][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:49,228][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:54,230][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:17:59,231][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:04,238][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:09,242][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:14,244][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:19,250][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:24,251][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:29,253][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:34,254][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:39,256][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:44,257][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:49,263][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:54,266][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:18:59,267][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:04,269][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:09,271][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:14,272][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:17,439][ INFO][PID:2260261] Allocated host ResallocHost, ticket_id=782351, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_01164521_20260112_191419, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:19:17,440][ INFO][PID:2260261] Allocating ssh connection to builder [2026-01-12 19:19:17,441][ INFO][PID:2260261] Checking that builder machine is OK [2026-01-12 19:19:18,338][ INFO][PID:2260261] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 19:19:18,882][ INFO][PID:2260261] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 19:19:18,882][ INFO][PID:2260261] Filling build.info file with builder info [2026-01-12 19:19:18,883][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:18,884][ INFO][PID:2260261] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "osloup", "project_name": "docbook5_style_xsl_license_and_jar_build", "project_dirname": "docbook5_style_xsl_license_and_jar_build", "submitter": "https://src.fedoraproject.org/user/jakub", "ended_on": null, "started_on": 1768245558.8844116, "submitted_on": null, "status": 3, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10001859-fedora-43-ppc64le", "build_id": 10001859, "package_name": "gcc", "package_version": "16.0.1-0.1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osloup/docbook5_style_xsl_license_and_jar_build/gcc", "git_hash": "5c945bc83f0825928ff6f2803d3eb09fdefa2e22", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "osloup/docbook5_style_xsl_license_and_jar_build--https://src.fedoraproject.org/user/jakub", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build", "result_dir": "10001859-gcc", "built_packages": "", "id": 10001859, "mockchain_macros": { "copr_username": "osloup", "copr_projectname": "docbook5_style_xsl_license_and_jar_build", "vendor": "Fedora Project COPR (osloup/docbook5_style_xsl_license_and_jar_build)" } } ] } [2026-01-12 19:19:18,955][ INFO][PID:2260261] Sending fedora-messaging bus message in build.start [2026-01-12 19:19:19,573][ INFO][PID:2260261] Sending fedora-messaging bus message in chroot.start [2026-01-12 19:19:19,600][ INFO][PID:2260261] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10001859-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 19:19:20,674][ INFO][PID:2260261] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts. [2026-01-12 19:19:20,675][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 1 [2026-01-12 19:19:20,677][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-12 19:19:25,689][ INFO][PID:2260261] Periodic builder liveness probe: alive [2026-01-12 19:19:25,690][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:30,691][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:35,693][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:40,695][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:45,697][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:50,976][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:19:55,979][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:00,986][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:05,991][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:10,993][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:15,995][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:20,996][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:25,999][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:31,003][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:36,004][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:41,006][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:46,007][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:51,009][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:20:56,012][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:01,014][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:06,016][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:11,019][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:16,020][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:21,021][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:26,022][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:31,023][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:36,025][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:41,026][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:46,034][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:51,038][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:21:56,047][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:01,053][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:06,054][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:11,057][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:16,066][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:21,069][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:26,071][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:31,075][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:36,077][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:41,082][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:46,089][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:51,090][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:22:56,092][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:01,094][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:06,095][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:11,100][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:16,102][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:21,105][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:26,107][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:31,110][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:36,111][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:41,112][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:46,113][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:51,114][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:23:56,116][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:01,119][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:06,123][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:11,125][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:16,127][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:21,128][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:26,132][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:31,137][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:36,145][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:41,146][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:46,149][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:51,150][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:24:56,151][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:01,156][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:06,157][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:11,159][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:16,217][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:21,224][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:26,225][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:29,378][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:25:31,226][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:36,450][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:39,379][WARNING][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 19:25:41,451][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:46,453][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:49,380][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 2 [2026-01-12 19:25:49,381][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-12 19:25:51,455][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:25:56,456][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:01,457][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:06,458][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:11,459][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:16,461][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:21,462][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:26,465][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:31,917][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:36,918][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:41,921][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:46,923][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:49,410][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:26:51,925][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:56,926][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:26:59,411][WARNING][PID:2260261] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 19:27:01,927][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:06,928][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:09,412][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 3 [2026-01-12 19:27:09,417][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-12 19:27:11,929][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:16,930][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:22,240][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:28,003][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:33,005][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:38,097][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:43,102][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:48,104][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:53,107][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:27:58,108][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:03,112][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:08,114][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:09,486][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:28:13,115][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:18,118][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:19,501][WARNING][PID:2260261] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 19:28:23,121][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:28,124][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:29,502][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 4 [2026-01-12 19:28:29,504][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log [2026-01-12 19:28:33,412][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:38,413][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:43,414][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:48,426][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:53,427][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:28:58,428][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:03,429][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:08,431][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:13,433][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:18,435][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:23,436][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:28,451][ INFO][PID:2260261] Periodic builder liveness probe: alive [2026-01-12 19:29:28,452][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:29,570][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:29:33,453][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:38,454][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:39,575][ ERROR][PID:2260261] Giving up for unstable SSH, failures: 1768245939.3797057, 1768246019.4117098, 1768246099.5017643, 1768246179.5750654 [2026-01-12 19:29:39,576][ ERROR][PID:2260261] Re-try request for task on 'ResallocHost, ticket_id=782351, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_01164521_20260112_191419, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-12 19:29:39,576][ INFO][PID:2260261] Releasing VM back to pool [2026-01-12 19:29:39,584][ INFO][PID:2260261] Retry #1 (on other host) [2026-01-12 19:29:39,585][ INFO][PID:2260261] Checking that /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-12 19:29:39,586][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:39,586][ INFO][PID:2260261] VM allocation process starts [2026-01-12 19:29:39,632][ INFO][PID:2260261] Trying to allocate VM: ResallocHost, ticket_id=782617, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:29:44,634][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:49,649][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:29:51,715][ INFO][PID:2260261] Allocated host ResallocHost, ticket_id=782617, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_01164521_20260112_191419, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:29:51,716][ INFO][PID:2260261] Allocating ssh connection to builder [2026-01-12 19:29:51,717][ INFO][PID:2260261] Checking that builder machine is OK [2026-01-12 19:30:51,779][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Connection timed out [2026-01-12 19:31:01,780][ ERROR][PID:2260261] Re-try request for task on 'ResallocHost, ticket_id=782617, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_01164521_20260112_191419, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-12 19:31:01,781][ INFO][PID:2260261] Releasing VM back to pool [2026-01-12 19:31:01,793][ INFO][PID:2260261] Retry #2 (on other host) [2026-01-12 19:31:01,793][ INFO][PID:2260261] Checking that /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-12 19:31:01,794][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:01,795][ INFO][PID:2260261] VM allocation process starts [2026-01-12 19:31:01,807][ INFO][PID:2260261] Trying to allocate VM: ResallocHost, ticket_id=782628, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:31:06,810][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:11,812][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:16,814][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:21,815][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:26,816][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:31,817][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:36,818][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:41,819][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:46,821][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:51,822][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:31:56,823][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:01,824][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:06,825][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:11,826][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:16,827][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:21,828][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:26,829][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:31,830][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:36,831][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:41,832][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:46,833][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:51,839][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:32:56,843][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:01,844][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:06,845][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:11,846][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:16,849][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:21,850][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:26,851][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:31,852][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:36,853][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:41,856][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:46,858][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:51,860][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:33:56,862][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:01,863][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:06,864][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:11,865][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:16,867][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:21,868][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:26,869][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:31,870][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:36,871][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:41,872][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:46,873][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:51,874][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:34:56,875][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:01,876][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:06,877][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:11,878][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:16,879][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:21,880][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:26,881][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:31,882][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:36,883][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:41,885][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:46,886][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:51,887][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:35:56,888][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:01,891][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:06,894][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:11,903][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:16,904][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:19,961][ INFO][PID:2260261] Allocated host ResallocHost, ticket_id=782628, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_01165043_20260112_193142, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:36:20,075][ INFO][PID:2260261] Allocating ssh connection to builder [2026-01-12 19:36:20,076][ INFO][PID:2260261] Checking that builder machine is OK [2026-01-12 19:36:20,953][ INFO][PID:2260261] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 19:36:21,422][ INFO][PID:2260261] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 19:36:21,422][ INFO][PID:2260261] Filling build.info file with builder info [2026-01-12 19:36:21,463][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:21,464][ INFO][PID:2260261] Not re-notifying FE and msg buses for the new host. [2026-01-12 19:36:21,465][ INFO][PID:2260261] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10001859-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 19:36:22,381][ INFO][PID:2260261] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c189' (ED25519) to the list of known hosts. [2026-01-12 19:36:22,383][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 1 [2026-01-12 19:36:22,385][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2026-01-12 19:36:27,384][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:32,386][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:37,396][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:42,399][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:47,401][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:52,404][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:36:57,405][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:02,406][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:07,407][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:12,408][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:17,410][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:22,411][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:27,413][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:32,414][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:37,415][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:42,417][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:47,419][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:52,420][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:37:57,421][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:02,423][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:07,424][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:12,425][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:17,427][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:22,429][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:27,430][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:32,431][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:37,432][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:42,435][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:47,439][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:52,440][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:38:57,442][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:02,444][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:07,446][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:12,447][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:16,370][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:39:17,448][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:22,450][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:26,371][WARNING][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 19:39:27,454][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:32,461][ INFO][PID:2260261] Periodic builder liveness probe: alive [2026-01-12 19:39:32,462][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:36,372][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 2 [2026-01-12 19:39:36,376][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2026-01-12 19:39:37,463][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:42,464][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:47,465][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:52,466][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:39:57,467][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:02,468][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:07,469][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:12,471][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:17,472][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:22,473][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:27,474][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:32,475][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:36,445][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:40:37,476][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:42,477][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:46,471][WARNING][PID:2260261] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 19:40:47,478][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:52,479][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:40:56,472][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 3 [2026-01-12 19:40:56,736][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2026-01-12 19:40:57,481][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:02,482][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:07,482][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:12,483][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:17,485][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:22,486][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:27,487][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:32,488][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:37,490][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:42,491][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:47,493][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:52,493][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:41:56,804][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:41:57,495][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:02,496][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:06,818][WARNING][PID:2260261] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-12 19:42:07,497][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:12,498][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:16,818][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 4 [2026-01-12 19:42:16,820][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c189 copr-rpmbuild-log [2026-01-12 19:42:17,499][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:22,500][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:27,501][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:32,502][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:37,503][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:42,504][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:47,505][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:52,506][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:42:57,507][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:02,508][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:07,509][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:12,510][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:16,888][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-12 19:43:17,511][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:22,512][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:26,904][ ERROR][PID:2260261] Giving up for unstable SSH, failures: 1768246766.3716362, 1768246846.4718182, 1768246926.8180041, 1768247006.904524 [2026-01-12 19:43:26,907][ ERROR][PID:2260261] Re-try request for task on 'ResallocHost, ticket_id=782628, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_01165043_20260112_193142, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-12 19:43:26,907][ INFO][PID:2260261] Releasing VM back to pool [2026-01-12 19:43:26,922][ INFO][PID:2260261] Retry #3 (on other host) [2026-01-12 19:43:26,923][ INFO][PID:2260261] Checking that /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/repodata/repomd.xml exists [2026-01-12 19:43:26,927][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:26,928][ INFO][PID:2260261] VM allocation process starts [2026-01-12 19:43:26,947][ INFO][PID:2260261] Trying to allocate VM: ResallocHost, ticket_id=782848, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:43:31,948][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:36,949][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:41,950][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:46,951][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:51,954][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:43:56,955][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:01,960][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:06,961][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:11,962][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:16,963][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:21,964][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:26,965][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:31,966][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:36,967][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:41,969][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:46,971][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:51,972][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:44:56,973][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:01,974][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:06,975][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:11,976][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:16,979][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:21,979][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:26,980][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:31,981][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:36,982][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:41,983][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:46,984][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:51,985][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:45:56,986][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:01,987][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:06,988][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:12,400][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:17,401][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:22,402][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:27,403][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:32,404][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:37,405][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:42,406][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:47,407][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:52,408][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:46:57,409][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:02,410][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:07,411][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:12,412][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:17,413][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:22,414][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:27,415][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:32,416][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:37,417][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:42,418][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:47,419][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:52,420][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:47:57,423][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:02,424][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:07,425][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:12,426][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:17,427][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:22,428][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:27,429][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:32,433][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:37,433][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:42,435][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:47,436][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:52,437][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:48:57,438][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:02,439][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:07,440][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:12,441][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:17,442][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:22,443][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:27,444][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:32,445][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:37,446][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:42,447][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:47,448][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:52,463][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:49:57,464][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:02,465][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:07,467][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:12,468][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:17,468][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:22,470][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:27,472][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:32,473][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:37,474][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:42,475][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:45,129][ INFO][PID:2260261] Allocated host ResallocHost, ticket_id=782848, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_01165344_20260112_194616, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-12 19:50:45,130][ INFO][PID:2260261] Allocating ssh connection to builder [2026-01-12 19:50:45,130][ INFO][PID:2260261] Checking that builder machine is OK [2026-01-12 19:50:46,074][ INFO][PID:2260261] Running remote command: copr-builder-ready fedora-43-ppc64le [2026-01-12 19:50:46,589][ INFO][PID:2260261] Red Hat subscription not needed for fedora-43-ppc64le Builder is ready to be used [2026-01-12 19:50:46,997][ INFO][PID:2260261] Filling build.info file with builder info [2026-01-12 19:50:47,334][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:47,335][ INFO][PID:2260261] Not re-notifying FE and msg buses for the new host. [2026-01-12 19:50:47,335][ INFO][PID:2260261] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10001859-fedora-43-ppc64le --chroot fedora-43-ppc64le --detached [2026-01-12 19:50:48,242][ INFO][PID:2260261] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c195' (ED25519) to the list of known hosts. [2026-01-12 19:50:48,242][ INFO][PID:2260261] Downloading the builder-live.log file, attempt 1 [2026-01-12 19:50:48,244][ INFO][PID:2260261] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c195 copr-rpmbuild-log [2026-01-12 19:50:53,250][ INFO][PID:2260261] Periodic builder liveness probe: alive [2026-01-12 19:50:53,251][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:50:58,252][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:03,253][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:08,254][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:13,255][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:18,256][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:23,257][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:28,258][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:33,259][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:38,696][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:43,697][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:48,698][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:53,699][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:51:58,700][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:03,701][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:08,702][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:13,703][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:18,704][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:23,705][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:28,706][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:33,707][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:38,708][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:43,709][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:48,710][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:53,711][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:52:58,711][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:03,712][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:08,713][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:13,714][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:18,715][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:23,716][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:28,718][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:33,720][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:38,722][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:43,723][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:48,725][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:53,726][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:53:58,727][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:03,728][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:08,729][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:13,733][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:18,734][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:23,736][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:28,737][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:33,738][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:38,739][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:43,740][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:48,741][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:53,742][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:54:58,743][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:03,744][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:08,745][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:13,746][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:18,748][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:23,749][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:28,750][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:33,751][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:38,753][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:43,754][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:48,755][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:53,757][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:55:58,758][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:03,759][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:08,760][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:13,780][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:18,781][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:23,782][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:28,783][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:33,993][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:38,999][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:44,001][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:49,002][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:54,003][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:56:59,005][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:04,007][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:09,009][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:14,010][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:19,020][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:24,022][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:29,024][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:34,025][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:39,027][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:44,029][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:49,030][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:54,031][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:57:59,032][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:04,034][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:09,035][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:14,037][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:19,039][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:24,042][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:29,043][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:34,044][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:39,046][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:44,048][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:49,049][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:54,050][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:58:59,052][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:04,057][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:09,060][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:14,063][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:19,064][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:24,066][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:29,067][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:34,068][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:39,077][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:44,083][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:49,087][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:54,088][ INFO][PID:2260261] Checking for cancel request [2026-01-12 19:59:59,092][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:04,095][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:09,096][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:14,097][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:19,098][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:24,100][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:29,100][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:34,102][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:39,107][ INFO][PID:2260261] Checking for cancel request [2026-01-12 20:00:42,986][ INFO][PID:2260261] Downloading results from builder [2026-01-12 20:00:42,987][ INFO][PID:2260261] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc started [2026-01-12 20:00:42,988][ INFO][PID:2260261] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/ &> /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/build-10001859.rsync.log [2026-01-12 20:01:43,068][ INFO][PID:2260261] rsyncing finished. [2026-01-12 20:01:43,072][ ERROR][PID:2260261] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-12 20:01:43,075][ ERROR][PID:2260261] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-12 20:01:53,075][ INFO][PID:2260261] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc started [2026-01-12 20:01:53,077][ INFO][PID:2260261] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/ &> /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/build-10001859.rsync.log [2026-01-12 20:01:55,155][ INFO][PID:2260261] rsyncing finished. [2026-01-12 20:01:55,162][ INFO][PID:2260261] Releasing VM back to pool [2026-01-12 20:01:55,175][ INFO][PID:2260261] Searching for 'success' file in resultdir [2026-01-12 20:01:55,176][ ERROR][PID:2260261] Build failed: Backend process error: No success file => build failure [2026-01-12 20:01:55,176][ INFO][PID:2260261] Finished build: id=10001859 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build chroot=fedora-43-ppc64le [2026-01-12 20:01:55,179][ ERROR][PID:2260261] Backend process error: No success file => build failure [2026-01-12 20:01:55,180][ INFO][PID:2260261] Worker failed build, took 667.8452637195587 [2026-01-12 20:01:55,181][ INFO][PID:2260261] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "osloup", "project_name": "docbook5_style_xsl_license_and_jar_build", "project_dirname": "docbook5_style_xsl_license_and_jar_build", "submitter": "https://src.fedoraproject.org/user/jakub", "ended_on": 1768248115.1802752, "started_on": 1768247447.3350115, "submitted_on": null, "status": 0, "chroot": "fedora-43-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10001859-fedora-43-ppc64le", "build_id": 10001859, "package_name": "gcc", "package_version": "16.0.1-0.1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osloup/docbook5_style_xsl_license_and_jar_build/gcc", "git_hash": "5c945bc83f0825928ff6f2803d3eb09fdefa2e22", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "osloup/docbook5_style_xsl_license_and_jar_build--https://src.fedoraproject.org/user/jakub", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build", "result_dir": "10001859-gcc", "built_packages": "", "id": 10001859, "mockchain_macros": { "copr_username": "osloup", "copr_projectname": "docbook5_style_xsl_license_and_jar_build", "vendor": "Fedora Project COPR (osloup/docbook5_style_xsl_license_and_jar_build)" } } ] } [2026-01-12 20:01:55,250][ INFO][PID:2260261] Sending fedora-messaging bus message in build.end [2026-01-12 20:01:55,284][ INFO][PID:2260261] Compressing /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/builder-live.log by gzip [2026-01-12 20:01:55,286][ INFO][PID:2260261] Running command 'gzip /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/builder-live.log' as PID 2569830 [2026-01-12 20:01:55,393][ INFO][PID:2260261] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/builder-live.log) [2026-01-12 20:01:55,394][ INFO][PID:2260261] Compressing /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/backend.log by gzip [2026-01-12 20:01:55,395][ INFO][PID:2260261] Running command 'gzip /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/fedora-43-ppc64le/10001859-gcc/backend.log' as PID 2569840