[2025-08-26 10:38:04,314][ INFO][PID:2429997] Marking build as starting [2025-08-26 10:38:04,468][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:04,478][ INFO][PID:2429997] VM allocation process starts [2025-08-26 10:38:04,545][ INFO][PID:2429997] Trying to allocate VM: ResallocHost, ticket_id=4749226, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-26 10:38:09,556][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:14,558][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:19,562][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:24,573][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:29,584][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:32,698][ INFO][PID:2429997] Allocated host ResallocHost, ticket_id=4749226, hostname=140.211.168.163, name=copr_osuosl_p09_prod_06430154_20250826_090821, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-26 10:38:32,699][ INFO][PID:2429997] Allocating ssh connection to builder [2025-08-26 10:38:32,699][ INFO][PID:2429997] Checking that builder machine is OK [2025-08-26 10:38:34,109][ INFO][PID:2429997] Running remote command: copr-builder-ready epel-8-ppc64le [2025-08-26 10:38:35,114][ INFO][PID:2429997] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-08-26 10:38:35,115][ INFO][PID:2429997] Filling build.info file with builder info [2025-08-26 10:38:35,115][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:35,116][ INFO][PID:2429997] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr", "project_dirname": "copr", "submitter": "frostyx", "ended_on": null, "started_on": 1756204715.1165245, "submitted_on": null, "status": 3, "chroot": "epel-8-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9491854-epel-8-ppc64le", "build_id": 9491854, "package_name": "copr-cli", "package_version": "2.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr/copr-cli", "git_hash": "450c58c448feb1be92419667080eee3c6da48eb9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr--frostyx", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr/epel-8-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr", "result_dir": "09491854-copr-cli", "built_packages": "", "id": 9491854, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr", "vendor": "Fedora Project COPR (@copr/copr)" } } ] } [2025-08-26 10:38:35,168][ INFO][PID:2429997] Sending fedora-messaging bus message in build.start [2025-08-26 10:38:37,364][ INFO][PID:2429997] Sending fedora-messaging bus message in chroot.start [2025-08-26 10:38:37,425][ INFO][PID:2429997] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9491854-epel-8-ppc64le --chroot epel-8-ppc64le --detached [2025-08-26 10:38:38,732][ INFO][PID:2429997] Downloading the builder-live.log file, attempt 1 [2025-08-26 10:38:38,739][ INFO][PID:2429997] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-08-26 10:38:43,764][ INFO][PID:2429997] Periodic builder liveness probe: alive [2025-08-26 10:38:43,765][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:48,768][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:53,770][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:38:58,773][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:03,775][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:08,781][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:13,786][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:18,787][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:23,789][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:28,792][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:33,795][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:38,797][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:43,802][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:48,808][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:53,812][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:39:58,817][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:03,822][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:08,823][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:13,825][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:18,832][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:23,836][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:28,839][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:33,840][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:38,846][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:43,850][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:48,854][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:53,855][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:40:58,857][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:03,860][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:08,861][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:13,863][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:18,865][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:23,870][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:28,877][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:33,878][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:38,879][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:43,882][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:48,885][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:53,887][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:41:58,888][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:03,892][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:08,893][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:13,898][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:18,905][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:23,906][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:28,910][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:33,912][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:38,914][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:43,917][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:48,920][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:53,921][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:42:58,923][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:03,927][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:08,931][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:13,933][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:18,936][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:23,938][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:28,941][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:33,944][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:38,950][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:43,956][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:48,962][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:53,973][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:43:58,982][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:03,989][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:08,996][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:14,002][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:19,011][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:24,013][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:29,019][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:34,020][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:39,021][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:44,023][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:49,027][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:54,033][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:44:59,038][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:04,053][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:09,061][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:14,063][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:19,065][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:24,067][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:29,076][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:34,078][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:39,079][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:44,083][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:49,086][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:54,090][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:45:59,094][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:04,097][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:09,098][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:14,101][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:19,103][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:24,105][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:29,110][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:34,113][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:39,119][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:44,120][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:49,124][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:54,126][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:46:59,129][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:04,139][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:09,142][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:14,147][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:19,153][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:24,157][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:29,159][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:34,162][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:39,163][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:44,171][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:49,172][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:54,175][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:47:59,177][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:04,179][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:09,187][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:14,191][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:19,192][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:24,193][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:29,195][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:34,196][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:39,198][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:44,212][ INFO][PID:2429997] Periodic builder liveness probe: alive [2025-08-26 10:48:44,213][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:49,214][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:54,217][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:48:59,223][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:04,226][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:09,231][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:14,233][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:19,234][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:24,237][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:29,239][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:34,240][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:39,242][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:44,247][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:49,248][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:54,252][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:49:59,257][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:04,258][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:09,271][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:14,277][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:19,278][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:24,281][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:29,285][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:34,287][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:39,289][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:44,290][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:49,291][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:54,292][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:50:59,294][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:04,295][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:09,300][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:14,302][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:19,304][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:24,305][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:29,308][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:34,310][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:39,314][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:44,318][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:49,320][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:54,323][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:51:59,327][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:04,333][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:09,338][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:14,344][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:19,356][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:24,359][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:29,361][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:34,363][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:39,366][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:44,371][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:49,374][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:54,378][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:52:59,380][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:04,383][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:09,388][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:14,389][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:19,391][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:24,396][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:29,399][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:34,400][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:39,401][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:44,402][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:49,404][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:54,405][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:53:59,408][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:04,411][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:09,413][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:14,414][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:19,415][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:24,417][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:29,419][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:34,421][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:39,423][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:44,427][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:49,428][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:54,429][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:54:59,431][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:04,432][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:09,433][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:14,434][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:19,436][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:24,438][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:29,439][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:34,441][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:39,449][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:44,451][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:49,452][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:54,453][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:55:59,455][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:04,456][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:09,457][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:14,459][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:19,461][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:24,462][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:29,463][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:34,464][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:39,465][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:44,466][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:49,468][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:54,469][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:56:59,470][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:04,472][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:09,474][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:14,475][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:19,476][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:24,477][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:29,479][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:34,480][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:39,482][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:44,482][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:49,483][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:54,484][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:57:59,487][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:04,491][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:09,492][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:14,493][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:19,494][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:24,495][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:29,496][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:34,497][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:39,498][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:44,518][ INFO][PID:2429997] Periodic builder liveness probe: alive [2025-08-26 10:58:44,522][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:49,523][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:54,526][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:58:59,527][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:04,529][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:09,530][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:14,531][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:19,532][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:24,533][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:29,534][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:34,536][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:39,537][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:44,538][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:49,539][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:54,540][ INFO][PID:2429997] Checking for cancel request [2025-08-26 10:59:59,542][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:04,543][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:09,545][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:14,545][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:19,547][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:24,550][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:29,551][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:34,552][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:39,553][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:44,558][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:49,559][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:54,560][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:00:59,562][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:04,564][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:09,565][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:14,566][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:19,567][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:24,568][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:29,569][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:34,571][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:39,572][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:44,573][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:49,574][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:54,576][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:01:59,577][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:04,579][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:09,580][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:14,581][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:19,582][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:24,583][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:29,585][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:34,588][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:39,590][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:44,591][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:49,593][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:54,594][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:02:59,595][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:04,596][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:09,599][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:14,601][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:19,603][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:24,606][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:29,607][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:34,608][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:39,609][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:44,610][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:49,611][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:54,612][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:03:59,613][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:04,619][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:09,621][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:14,622][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:19,624][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:24,625][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:29,626][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:34,627][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:39,628][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:44,633][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:49,635][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:54,636][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:04:59,637][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:04,638][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:09,639][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:14,641][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:19,643][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:24,644][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:29,646][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:34,647][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:39,649][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:44,650][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:49,651][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:54,653][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:05:59,654][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:04,655][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:09,656][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:14,657][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:19,658][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:24,660][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:29,661][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:34,662][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:39,663][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:44,665][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:49,666][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:52,140][ ERROR][PID:2429997] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 11:06:54,669][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:06:59,672][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:02,142][WARNING][PID:2429997] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-26 11:07:04,673][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:09,674][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:12,143][ INFO][PID:2429997] Downloading the builder-live.log file, attempt 2 [2025-08-26 11:07:12,144][ INFO][PID:2429997] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-08-26 11:07:14,675][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:19,676][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:24,678][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:29,680][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:34,681][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:39,683][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:44,684][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:49,685][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:54,688][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:07:59,691][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:04,692][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:09,694][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:12,213][ ERROR][PID:2429997] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 11:08:14,695][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:19,696][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:22,214][WARNING][PID:2429997] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-26 11:08:24,697][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:29,699][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:32,215][ INFO][PID:2429997] Downloading the builder-live.log file, attempt 3 [2025-08-26 11:08:32,216][ INFO][PID:2429997] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-08-26 11:08:34,700][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:39,702][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:08:44,723][ INFO][PID:2429997] Periodic builder liveness probe: dead [2025-08-26 11:09:32,298][ ERROR][PID:2429997] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 11:09:42,303][WARNING][PID:2429997] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-26 11:09:44,813][ ERROR][PID:2429997] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-08-26 11:09:52,305][ INFO][PID:2429997] Downloading the builder-live.log file, attempt 4 [2025-08-26 11:09:52,311][ INFO][PID:2429997] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-08-26 11:10:52,400][ ERROR][PID:2429997] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-26 11:10:54,917][ ERROR][PID:2429997] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-08-26 11:11:02,405][ ERROR][PID:2429997] Giving up for unstable SSH, failures: 1756206422.1421463, 1756206502.2143476, 1756206582.3031723, 1756206662.404775 [2025-08-26 11:12:04,998][ ERROR][PID:2429997] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-08-26 11:13:15,087][ ERROR][PID:2429997] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-08-26 11:13:25,094][ ERROR][PID:2429997] Can't ssh to cancel build. [2025-08-26 11:13:25,096][ ERROR][PID:2429997] Re-try request for task on 'ResallocHost, ticket_id=4749226, hostname=140.211.168.163, name=copr_osuosl_p09_prod_06430154_20250826_090821, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-08-26 11:13:25,099][ INFO][PID:2429997] Releasing VM back to pool [2025-08-26 11:13:25,130][ INFO][PID:2429997] Retry #1 (on other host) [2025-08-26 11:13:25,132][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:13:25,138][ INFO][PID:2429997] VM allocation process starts [2025-08-26 11:13:25,176][ INFO][PID:2429997] Trying to allocate VM: ResallocHost, ticket_id=4750682, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-26 11:13:30,179][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:13:31,223][ INFO][PID:2429997] Allocated host ResallocHost, ticket_id=4750682, hostname=2620:52:3:1:dead:beef:cafe:c29e, name=copr_p09_01_prod_06431990_20250826_104232, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-08-26 11:13:31,224][ INFO][PID:2429997] Allocating ssh connection to builder [2025-08-26 11:13:31,225][ INFO][PID:2429997] Checking that builder machine is OK [2025-08-26 11:13:32,011][ INFO][PID:2429997] Running remote command: copr-builder-ready epel-8-ppc64le [2025-08-26 11:13:32,509][ INFO][PID:2429997] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-08-26 11:13:32,518][ INFO][PID:2429997] Filling build.info file with builder info [2025-08-26 11:13:32,532][ INFO][PID:2429997] Checking for cancel request [2025-08-26 11:13:32,535][ INFO][PID:2429997] Not re-notifying FE and msg buses for the new host. [2025-08-26 11:13:32,538][ INFO][PID:2429997] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9491854-epel-8-ppc64le --chroot epel-8-ppc64le --detached [2025-08-26 11:13:33,310][ INFO][PID:2429997] Downloading the builder-live.log file, attempt 1 [2025-08-26 11:13:33,319][ INFO][PID:2429997] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c29e copr-rpmbuild-log [2025-08-26 11:13:41,952][ INFO][PID:2429997] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29e' (ED25519) to the list of known hosts. [2025-08-26 11:13:41,953][ INFO][PID:2429997] Downloading results from builder [2025-08-26 11:13:41,957][ INFO][PID:2429997] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c29e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli started [2025-08-26 11:13:41,963][ INFO][PID:2429997] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c29e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/ &> /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/build-09491854.rsync.log [2025-08-26 11:13:42,445][ INFO][PID:2429997] rsyncing finished. [2025-08-26 11:13:42,445][ INFO][PID:2429997] Releasing VM back to pool [2025-08-26 11:13:42,464][ INFO][PID:2429997] Searching for 'success' file in resultdir [2025-08-26 11:13:42,467][ ERROR][PID:2429997] Build failed: Backend process error: No success file => build failure [2025-08-26 11:13:42,471][ INFO][PID:2429997] Finished build: id=9491854 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/copr chroot=epel-8-ppc64le [2025-08-26 11:13:42,484][ ERROR][PID:2429997] Backend process error: No success file => build failure [2025-08-26 11:13:42,485][ INFO][PID:2429997] Worker failed build, took 9.95001769065857 [2025-08-26 11:13:42,491][ INFO][PID:2429997] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@copr", "project_name": "copr", "project_dirname": "copr", "submitter": "frostyx", "ended_on": 1756206822.4852045, "started_on": 1756206812.5351868, "submitted_on": null, "status": 0, "chroot": "epel-8-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9491854-epel-8-ppc64le", "build_id": 9491854, "package_name": "copr-cli", "package_version": "2.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/copr/copr-cli", "git_hash": "450c58c448feb1be92419667080eee3c6da48eb9", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@copr/copr--frostyx", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/copr/epel-8-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@copr/copr", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/copr", "result_dir": "09491854-copr-cli", "built_packages": "", "id": 9491854, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "copr", "vendor": "Fedora Project COPR (@copr/copr)" } } ] } [2025-08-26 11:13:42,599][ INFO][PID:2429997] Sending fedora-messaging bus message in build.end [2025-08-26 11:13:42,638][ INFO][PID:2429997] Compressing /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/builder-live.log by gzip [2025-08-26 11:13:42,642][ INFO][PID:2429997] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/builder-live.log' as PID 2764811 [2025-08-26 11:13:42,647][ INFO][PID:2429997] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/builder-live.log) [2025-08-26 11:13:42,648][ INFO][PID:2429997] Compressing /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/backend.log by gzip [2025-08-26 11:13:42,650][ INFO][PID:2429997] Running command 'gzip /var/lib/copr/public_html/results/@copr/copr/epel-8-ppc64le/09491854-copr-cli/backend.log' as PID 2764812