[2026-04-02 13:16:34,707][ INFO][PID:1683199] Marking build as starting [2026-04-02 13:16:34,752][ INFO][PID:1683199] Checking that /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-02 13:16:34,817][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:16:34,818][ INFO][PID:1683199] VM allocation process starts [2026-04-02 13:16:34,830][ INFO][PID:1683199] Trying to allocate VM: ResallocHost, ticket_id=2150751, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 13:16:39,831][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:16:44,832][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:16:49,833][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:16:54,834][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:16:59,835][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:04,836][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:09,837][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:14,838][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:19,839][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:24,840][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:29,841][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:34,842][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:39,849][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:45,014][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:50,015][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:17:55,016][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:00,016][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:05,017][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:10,018][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:15,026][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:20,026][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:25,027][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:30,028][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:35,029][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:40,030][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:45,031][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:50,039][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:18:55,040][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:00,041][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:05,042][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:10,043][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:15,043][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:20,050][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:25,051][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:30,057][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:35,057][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:40,058][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:45,059][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:50,060][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:19:55,061][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:00,062][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:05,063][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:10,064][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:15,064][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:20,065][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:25,066][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:30,067][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:35,114][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:40,393][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:45,396][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:50,398][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:20:55,399][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:00,400][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:05,416][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:10,417][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:15,419][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:20,421][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:25,422][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:30,424][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:35,426][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:40,427][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:45,428][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:50,429][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:21:55,430][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:00,431][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:05,432][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:10,433][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:15,434][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:20,435][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:25,436][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:30,437][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:35,439][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:40,440][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:45,441][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:50,442][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:22:55,443][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:00,444][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:05,447][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:10,449][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:15,450][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:20,451][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:25,453][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:30,454][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:35,456][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:40,459][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:45,460][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:50,461][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:23:55,462][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:00,463][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:05,464][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:10,465][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:15,466][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:20,467][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:25,469][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:30,470][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:35,471][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:40,472][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:45,474][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:50,475][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:24:55,478][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:00,480][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:05,483][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:10,484][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:15,485][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:20,486][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:25,487][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:30,488][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:35,489][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:40,490][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:45,491][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:50,492][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:25:55,493][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:00,494][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:05,496][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:10,497][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:15,502][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:20,503][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:25,504][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:30,506][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:35,512][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:40,513][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:45,521][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:50,528][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:52,989][ INFO][PID:1683199] Allocated host ResallocHost, ticket_id=2150751, hostname=100.54.134.204, name=aws_x86_64_spot_prod_04479792_20260402_131841, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 13:26:52,990][ INFO][PID:1683199] Allocating ssh connection to builder [2026-04-02 13:26:52,990][ INFO][PID:1683199] Checking that builder machine is OK [2026-04-02 13:26:53,359][ INFO][PID:1683199] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-02 13:26:53,574][ INFO][PID:1683199] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-02 13:26:53,575][ INFO][PID:1683199] Filling build.info file with builder info [2026-04-02 13:26:53,772][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:26:53,773][ INFO][PID:1683199] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "errornointernet", "project_name": "quickshell", "project_dirname": "quickshell", "submitter": "https://api.github.com/users/github-actions%5Bbot%5D", "ended_on": null, "started_on": 1775136413.7732954, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10287345-fedora-rawhide-x86_64", "build_id": 10287345, "package_name": "quickshell-git", "package_version": "0.2.1^784.git1eb3d8b-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/errornointernet/quickshell/quickshell-git", "git_hash": "d76715912ddac44c457d096d2075411f8f1d9cab", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "errornointernet/quickshell--https://api.github.com/users/github-actions%5Bbot%5D", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/errornointernet/quickshell/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/errornointernet/quickshell", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/errornointernet/quickshell", "result_dir": "10287345-quickshell-git", "built_packages": "", "id": 10287345, "mockchain_macros": { "copr_username": "errornointernet", "copr_projectname": "quickshell", "vendor": "Fedora Project COPR (errornointernet/quickshell)" } } ] } [2026-04-02 13:26:53,815][ INFO][PID:1683199] Sending fedora-messaging bus message in build.start [2026-04-02 13:26:54,406][ INFO][PID:1683199] Sending fedora-messaging bus message in chroot.start [2026-04-02 13:26:54,437][ INFO][PID:1683199] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287345-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-02 13:26:54,795][ INFO][PID:1683199] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '100.54.134.204' (ED25519) to the list of known hosts. [2026-04-02 13:26:54,796][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 1 [2026-04-02 13:26:54,819][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.54.134.204 copr-rpmbuild-log [2026-04-02 13:26:59,809][ INFO][PID:1683199] Periodic builder liveness probe: alive [2026-04-02 13:26:59,810][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:04,813][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:09,817][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:14,818][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:19,819][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:24,820][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:29,822][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:34,823][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:39,825][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:44,828][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:49,829][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:54,831][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:27:59,832][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:04,833][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:09,834][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:14,835][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:19,836][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:24,837][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:29,838][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:35,003][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:40,004][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:45,005][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:50,007][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:28:55,008][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:00,009][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:05,010][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:10,011][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:15,373][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:20,374][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:25,376][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:30,377][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:35,378][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:40,379][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:45,381][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:50,382][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:29:55,383][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:00,385][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:05,386][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:10,388][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:15,389][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:20,390][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:25,391][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:30,392][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:35,393][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:40,394][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:45,395][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:50,406][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:30:55,407][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:00,408][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:05,409][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:10,410][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:15,411][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:20,412][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:25,413][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:30,414][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:35,415][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:40,417][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:45,419][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:50,420][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:31:55,421][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:00,422][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:05,423][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:10,424][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:15,425][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:20,426][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:25,427][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:30,428][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:35,429][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:40,440][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:45,440][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:50,441][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:32:55,442][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:00,443][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:05,444][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:10,445][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:15,446][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:20,447][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:25,449][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:30,450][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:35,451][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:40,452][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:45,453][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:50,454][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:33:55,455][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:00,456][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:05,457][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:09,881][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:34:10,457][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:15,458][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:19,882][WARNING][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 13:34:20,459][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:25,461][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:29,882][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 2 [2026-04-02 13:34:29,891][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.54.134.204 copr-rpmbuild-log [2026-04-02 13:34:29,899][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:34:30,467][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:35,468][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:39,904][WARNING][PID:1683199] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 13:34:40,469][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:45,470][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:49,906][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 3 [2026-04-02 13:34:49,907][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.54.134.204 copr-rpmbuild-log [2026-04-02 13:34:50,471][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:34:55,472][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:00,473][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:05,474][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:10,475][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:15,476][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:20,477][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:25,478][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:30,479][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:35,481][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:40,481][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:45,483][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:49,972][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:35:50,484][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:55,485][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:35:59,977][WARNING][PID:1683199] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 13:36:00,519][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:05,520][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:09,978][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 4 [2026-04-02 13:36:09,979][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.54.134.204 copr-rpmbuild-log [2026-04-02 13:36:10,521][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:15,522][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:20,522][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:25,524][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:30,525][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:35,526][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:40,527][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:45,528][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:50,529][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:36:55,530][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:00,538][ INFO][PID:1683199] Periodic builder liveness probe: alive [2026-04-02 13:37:00,539][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:05,540][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:10,043][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:37:10,541][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:15,542][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:20,049][ ERROR][PID:1683199] Giving up for unstable SSH, failures: 1775136859.882059, 1775136879.9047256, 1775136959.977456, 1775137040.0490596 [2026-04-02 13:37:20,050][ ERROR][PID:1683199] Re-try request for task on 'ResallocHost, ticket_id=2150751, hostname=100.54.134.204, name=aws_x86_64_spot_prod_04479792_20260402_131841, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-02 13:37:20,051][ INFO][PID:1683199] Releasing VM back to pool [2026-04-02 13:37:20,060][ INFO][PID:1683199] Retry #1 (on other host) [2026-04-02 13:37:20,060][ INFO][PID:1683199] Checking that /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-02 13:37:20,061][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:20,061][ INFO][PID:1683199] VM allocation process starts [2026-04-02 13:37:20,071][ INFO][PID:1683199] Trying to allocate VM: ResallocHost, ticket_id=2151035, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 13:37:25,072][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:30,073][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:35,074][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:40,075][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:45,076][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:50,077][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:37:55,078][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:00,079][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:05,080][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:10,081][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:15,082][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:20,083][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:25,084][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:30,085][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:35,086][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:40,087][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:45,088][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:50,097][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:38:55,099][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:00,100][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:05,101][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:10,106][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:15,110][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:20,111][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:25,113][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:30,114][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:35,114][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:40,115][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:45,116][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:50,123][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:39:55,124][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:00,125][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:05,126][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:10,127][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:15,128][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:20,133][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:25,134][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:30,135][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:35,136][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:40,136][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:45,137][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:50,138][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:40:55,140][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:00,141][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:05,142][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:10,143][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:15,144][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:20,145][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:25,146][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:30,147][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:35,152][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:40,153][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:45,154][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:50,155][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:41:55,156][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:00,158][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:05,159][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:10,160][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:15,162][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:20,163][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:25,164][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:30,165][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:35,166][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:40,166][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:45,167][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:50,168][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:42:55,169][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:00,170][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:05,171][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:10,172][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:15,173][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:20,175][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:25,176][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:30,177][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:35,178][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:40,179][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:45,180][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:50,181][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:43:55,182][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:00,183][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:05,184][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:10,185][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:15,186][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:20,187][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:25,188][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:30,190][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:35,191][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:40,192][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:45,193][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:50,194][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:44:55,195][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:00,202][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:05,203][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:10,208][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:15,209][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:20,210][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:25,211][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:30,212][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:35,213][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:40,214][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:45,215][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:50,216][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:45:55,217][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:00,218][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:05,219][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:10,220][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:15,221][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:20,222][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:25,223][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:30,224][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:35,274][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:38,192][ INFO][PID:1683199] Allocated host ResallocHost, ticket_id=2151035, hostname=44.192.38.76, name=aws_x86_64_spot_prod_04479789_20260402_131816, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 13:46:38,193][ INFO][PID:1683199] Allocating ssh connection to builder [2026-04-02 13:46:38,193][ INFO][PID:1683199] Checking that builder machine is OK [2026-04-02 13:46:38,517][ INFO][PID:1683199] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-02 13:46:38,709][ INFO][PID:1683199] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-02 13:46:38,709][ INFO][PID:1683199] Filling build.info file with builder info [2026-04-02 13:46:38,749][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:38,750][ INFO][PID:1683199] Not re-notifying FE and msg buses for the new host. [2026-04-02 13:46:38,751][ INFO][PID:1683199] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287345-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-02 13:46:39,065][ INFO][PID:1683199] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.192.38.76' (ED25519) to the list of known hosts. [2026-04-02 13:46:39,066][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 1 [2026-04-02 13:46:39,068][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.38.76 copr-rpmbuild-log [2026-04-02 13:46:44,066][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:49,067][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:54,068][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:46:59,069][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:04,079][ INFO][PID:1683199] Periodic builder liveness probe: alive [2026-04-02 13:47:04,079][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:09,080][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:14,081][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:19,082][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:24,083][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:29,083][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:34,084][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:39,085][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:44,086][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:49,087][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:54,088][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:47:59,089][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:04,090][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:09,096][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:14,097][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:19,098][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:24,099][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:29,100][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:34,101][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:39,102][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:44,103][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:49,104][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:54,105][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:48:59,106][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:04,107][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:09,108][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:14,108][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:19,109][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:24,110][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:29,111][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:34,112][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:39,114][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:44,115][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:49,115][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:54,116][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:49:59,117][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:04,122][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:09,126][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:14,127][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:19,128][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:24,129][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:29,131][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:32,749][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:50:34,132][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:39,133][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:42,753][WARNING][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 13:50:44,134][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:49,135][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:52,770][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 2 [2026-04-02 13:50:52,772][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.38.76 copr-rpmbuild-log [2026-04-02 13:50:54,136][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:50:59,137][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:04,139][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:09,140][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:14,141][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:19,142][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:24,143][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:29,143][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:34,144][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:39,145][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:44,146][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:49,148][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:52,827][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:51:54,148][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:51:59,149][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:02,838][WARNING][PID:1683199] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 13:52:04,151][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:09,153][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:12,838][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 3 [2026-04-02 13:52:12,840][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.38.76 copr-rpmbuild-log [2026-04-02 13:52:14,156][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:19,157][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:24,158][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:29,159][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:34,160][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:39,161][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:44,162][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:49,163][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:54,164][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:52:59,165][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:04,166][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:09,167][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:12,907][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:53:14,168][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:19,169][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:22,908][WARNING][PID:1683199] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-04-02 13:53:24,171][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:29,172][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:32,970][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 4 [2026-04-02 13:53:32,972][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.38.76 copr-rpmbuild-log [2026-04-02 13:53:34,173][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:39,174][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:44,175][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:49,176][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:54,177][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:53:59,178][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:04,179][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:09,180][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:14,181][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:19,182][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:24,183][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:29,184][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:33,036][ ERROR][PID:1683199] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-04-02 13:54:34,185][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:39,186][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:43,079][ ERROR][PID:1683199] Giving up for unstable SSH, failures: 1775137842.7538347, 1775137922.838249, 1775138002.9084992, 1775138083.0793278 [2026-04-02 13:54:43,080][ ERROR][PID:1683199] Re-try request for task on 'ResallocHost, ticket_id=2151035, hostname=44.192.38.76, name=aws_x86_64_spot_prod_04479789_20260402_131816, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-04-02 13:54:43,080][ INFO][PID:1683199] Releasing VM back to pool [2026-04-02 13:54:43,091][ INFO][PID:1683199] Retry #2 (on other host) [2026-04-02 13:54:43,092][ INFO][PID:1683199] Checking that /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-02 13:54:43,092][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:43,093][ INFO][PID:1683199] VM allocation process starts [2026-04-02 13:54:43,103][ INFO][PID:1683199] Trying to allocate VM: ResallocHost, ticket_id=2151186, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 13:54:48,104][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:53,105][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:54:58,106][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:03,107][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:08,108][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:13,109][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:18,110][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:23,111][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:28,113][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:33,114][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:38,115][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:43,141][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:48,142][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:53,143][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:55:58,144][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:03,145][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:08,145][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:13,146][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:18,147][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:23,148][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:28,149][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:33,150][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:38,151][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:43,152][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:48,153][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:53,154][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:56:58,155][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:03,156][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:08,157][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:13,158][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:18,159][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:23,160][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:28,161][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:33,162][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:38,163][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:43,164][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:48,165][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:53,166][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:57:58,167][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:03,168][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:08,169][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:13,170][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:18,171][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:23,172][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:28,173][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:33,174][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:38,175][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:43,176][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:48,177][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:53,178][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:58:58,179][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:03,180][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:08,359][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:13,360][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:18,361][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:23,362][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:28,363][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:33,364][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:38,365][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:43,366][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:48,367][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:53,368][ INFO][PID:1683199] Checking for cancel request [2026-04-02 13:59:58,369][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:03,371][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:08,371][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:13,372][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:18,373][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:23,374][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:28,375][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:33,376][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:38,377][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:43,378][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:48,379][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:53,380][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:00:58,381][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:03,384][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:08,385][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:13,386][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:18,574][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:23,576][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:28,577][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:33,579][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:38,580][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:43,673][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:48,792][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:53,846][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:01:58,912][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:03,913][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:08,914][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:13,915][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:18,917][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:23,924][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:28,983][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:33,984][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:38,986][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:44,051][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:49,069][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:54,072][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:02:59,076][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:04,077][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:09,079][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:14,081][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:19,083][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:24,084][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:29,085][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:34,086][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:39,088][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:44,089][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:49,091][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:54,092][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:03:59,094][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:04,095][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:09,096][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:14,097][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:19,098][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:24,099][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:29,100][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:34,101][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:39,102][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:44,103][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:49,104][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:54,105][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:04:59,106][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:04,107][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:09,108][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:14,109][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:19,110][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:24,121][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:29,129][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:34,130][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:39,131][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:44,132][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:49,138][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:54,139][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:05:59,140][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:04,141][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:09,142][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:14,144][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:19,145][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:24,149][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:29,150][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:34,151][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:39,152][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:44,153][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:49,154][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:54,158][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:06:59,159][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:04,160][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:09,164][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:14,164][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:19,165][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:24,166][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:29,167][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:34,168][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:39,169][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:44,170][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:49,171][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:54,171][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:07:59,172][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:04,173][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:09,174][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:14,176][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:19,177][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:24,178][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:29,179][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:34,179][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:39,180][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:44,224][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:49,225][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:54,227][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:08:59,228][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:04,230][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:09,231][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:14,232][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:19,233][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:24,234][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:29,235][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:34,236][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:39,238][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:44,239][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:49,240][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:54,246][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:09:59,248][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:04,250][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:09,251][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:14,255][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:19,256][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:24,257][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:29,258][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:34,260][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:39,263][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:44,264][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:49,265][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:54,267][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:10:59,267][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:04,268][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:09,271][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:14,276][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:19,276][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:24,277][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:29,279][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:34,280][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:39,281][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:44,282][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:49,283][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:54,284][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:11:59,285][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:04,286][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:09,287][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:14,288][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:19,289][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:24,290][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:29,292][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:34,293][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:39,294][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:44,295][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:49,296][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:54,297][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:12:59,298][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:04,299][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:09,300][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:14,301][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:19,302][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:24,302][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:29,303][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:34,304][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:39,305][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:44,306][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:49,307][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:54,309][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:13:59,310][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:04,311][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:09,311][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:14,312][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:19,313][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:24,314][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:29,315][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:34,316][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:39,317][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:44,318][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:49,319][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:54,320][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:14:59,321][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:04,322][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:09,323][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:14,324][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:19,325][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:24,327][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:29,327][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:34,328][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:39,330][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:44,331][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:49,332][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:54,521][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:15:59,542][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:01,317][ INFO][PID:1683199] Allocated host ResallocHost, ticket_id=2151186, hostname=3.236.104.2, name=aws_x86_64_normalreserved_prod_04481057_20260402_140534, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-02 14:16:01,317][ INFO][PID:1683199] Allocating ssh connection to builder [2026-04-02 14:16:01,318][ INFO][PID:1683199] Checking that builder machine is OK [2026-04-02 14:16:01,659][ INFO][PID:1683199] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-02 14:16:01,868][ INFO][PID:1683199] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-02 14:16:01,868][ INFO][PID:1683199] Filling build.info file with builder info [2026-04-02 14:16:01,901][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:01,902][ INFO][PID:1683199] Not re-notifying FE and msg buses for the new host. [2026-04-02 14:16:01,902][ INFO][PID:1683199] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10287345-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-02 14:16:02,239][ INFO][PID:1683199] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.236.104.2' (ED25519) to the list of known hosts. [2026-04-02 14:16:02,240][ INFO][PID:1683199] Downloading the builder-live.log file, attempt 1 [2026-04-02 14:16:02,241][ INFO][PID:1683199] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.104.2 copr-rpmbuild-log [2026-04-02 14:16:07,249][ INFO][PID:1683199] Periodic builder liveness probe: alive [2026-04-02 14:16:07,249][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:12,250][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:17,251][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:22,252][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:27,253][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:32,254][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:37,259][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:42,261][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:47,262][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:52,263][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:16:57,264][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:02,265][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:07,266][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:12,267][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:17,268][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:22,269][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:27,270][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:32,271][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:37,272][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:42,273][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:47,274][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:52,275][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:17:57,276][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:02,277][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:07,278][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:12,279][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:17,280][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:22,281][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:27,282][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:32,283][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:37,284][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:42,285][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:47,286][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:52,287][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:18:57,288][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:02,289][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:07,290][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:12,291][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:17,292][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:22,293][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:27,294][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:32,295][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:37,296][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:42,297][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:47,297][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:52,298][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:19:57,299][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:02,301][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:07,302][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:12,303][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:17,304][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:22,305][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:27,306][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:32,307][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:37,308][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:42,309][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:47,310][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:52,311][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:20:57,312][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:02,313][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:07,314][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:12,315][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:17,316][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:22,317][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:27,318][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:32,319][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:37,320][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:42,321][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:47,322][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:52,323][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:21:57,325][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:02,326][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:07,327][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:12,328][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:17,329][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:22,330][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:27,331][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:32,332][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:37,333][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:42,334][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:47,335][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:52,336][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:22:57,336][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:02,337][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:07,339][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:12,345][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:17,346][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:22,348][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:27,351][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:32,352][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:37,353][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:42,354][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:47,355][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:52,356][ INFO][PID:1683199] Checking for cancel request [2026-04-02 14:23:56,060][ INFO][PID:1683199] Downloading results from builder [2026-04-02 14:23:56,060][ INFO][PID:1683199] rsyncing of mockbuilder@3.236.104.2:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git started [2026-04-02 14:23:56,061][ INFO][PID:1683199] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.236.104.2:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/ &> /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/build-10287345.rsync.log [2026-04-02 14:23:56,649][ INFO][PID:1683199] rsyncing finished. [2026-04-02 14:23:56,650][ INFO][PID:1683199] Releasing VM back to pool [2026-04-02 14:23:56,666][ INFO][PID:1683199] Searching for 'success' file in resultdir [2026-04-02 14:23:56,667][ INFO][PID:1683199] Going to sign pkgs from source: 10287345-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64 [2026-04-02 14:23:56,667][ INFO][PID:1683199] Calling '/bin/sign -u errornointernet#quickshell@copr.fedorahosted.org -p' (attempt #1) [2026-04-02 14:23:56,945][ INFO][PID:1683199] Calling '/bin/sign -4 -h sha256 -u errornointernet#quickshell@copr.fedorahosted.org -r /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-debugsource-0.2.1^784.git1eb3d8b-1.fc45.x86_64.rpm' (attempt #1) [2026-04-02 14:23:57,763][ INFO][PID:1683199] signed rpm: /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-debugsource-0.2.1^784.git1eb3d8b-1.fc45.x86_64.rpm [2026-04-02 14:23:57,764][ INFO][PID:1683199] Calling '/bin/sign -4 -h sha256 -u errornointernet#quickshell@copr.fedorahosted.org -r /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-debuginfo-0.2.1^784.git1eb3d8b-1.fc45.x86_64.rpm' (attempt #1) [2026-04-02 14:23:59,133][ INFO][PID:1683199] signed rpm: /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-debuginfo-0.2.1^784.git1eb3d8b-1.fc45.x86_64.rpm [2026-04-02 14:23:59,134][ INFO][PID:1683199] Calling '/bin/sign -4 -h sha256 -u errornointernet#quickshell@copr.fedorahosted.org -r /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-0.2.1^784.git1eb3d8b-1.fc45.x86_64.rpm' (attempt #1) [2026-04-02 14:23:59,994][ INFO][PID:1683199] signed rpm: /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-0.2.1^784.git1eb3d8b-1.fc45.x86_64.rpm [2026-04-02 14:23:59,995][ INFO][PID:1683199] Calling '/bin/sign -4 -h sha256 -u errornointernet#quickshell@copr.fedorahosted.org -r /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-0.2.1^784.git1eb3d8b-1.fc45.src.rpm' (attempt #1) [2026-04-02 14:24:00,839][ INFO][PID:1683199] signed rpm: /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/quickshell-git-0.2.1^784.git1eb3d8b-1.fc45.src.rpm [2026-04-02 14:24:00,839][ INFO][PID:1683199] Sign done [2026-04-02 14:24:00,840][ INFO][PID:1683199] Incremental createrepo run, adding 10287345-quickshell-git into https://download.copr.fedorainfracloud.org/results/errornointernet/quickshell/fedora-rawhide-x86_64, (auto-create-repo=True) [2026-04-02 14:24:00,841][ INFO][PID:1683199] Running command 'copr-repo --batched /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64 --add 10287345-quickshell-git --no-appstream-metadata' as PID 1987421 [2026-04-02 14:24:01,911][ INFO][PID:1683199] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64 --add 10287345-quickshell-git --no-appstream-metadata) [2026-04-02 14:24:01,911][ INFO][PID:1683199] Getting build details [2026-04-02 14:24:01,912][ INFO][PID:1683199] Listing built binary packages in /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git [2026-04-02 14:24:01,912][ INFO][PID:1683199] Built packages: ['quickshell-git 0.2.1^784.git1eb3d8b', 'quickshell-git-debugsource 0.2.1^784.git1eb3d8b', 'quickshell-git-debuginfo 0.2.1^784.git1eb3d8b'] [2026-04-02 14:24:01,913][ INFO][PID:1683199] build details: {'built_packages': 'quickshell-git 0.2.1^784.git1eb3d8b\nquickshell-git-debugsource 0.2.1^784.git1eb3d8b\nquickshell-git-debuginfo 0.2.1^784.git1eb3d8b'} [2026-04-02 14:24:01,913][ INFO][PID:1683199] Retrieving pubkey [2026-04-02 14:24:01,914][ INFO][PID:1683199] Calling '/bin/sign -u errornointernet#quickshell@copr.fedorahosted.org -p' (attempt #1) [2026-04-02 14:24:02,198][ INFO][PID:1683199] Added pubkey for user errornointernet project quickshell into: /var/lib/copr/public_html/results/errornointernet/quickshell/pubkey.gpg [2026-04-02 14:24:02,199][ INFO][PID:1683199] Finished build: id=10287345 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/errornointernet/quickshell chroot=fedora-rawhide-x86_64 [2026-04-02 14:24:02,200][ INFO][PID:1683199] Worker succeeded build, took 480.2982339859009 [2026-04-02 14:24:02,201][ INFO][PID:1683199] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "errornointernet", "project_name": "quickshell", "project_dirname": "quickshell", "submitter": "https://api.github.com/users/github-actions%5Bbot%5D", "ended_on": 1775139842.2005913, "started_on": 1775139361.9023573, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10287345-fedora-rawhide-x86_64", "build_id": 10287345, "package_name": "quickshell-git", "package_version": "0.2.1^784.git1eb3d8b-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/errornointernet/quickshell/quickshell-git", "git_hash": "d76715912ddac44c457d096d2075411f8f1d9cab", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "errornointernet/quickshell--https://api.github.com/users/github-actions%5Bbot%5D", "results": { "packages": [ { "name": "quickshell-git", "epoch": null, "version": "0.2.1^784.git1eb3d8b", "release": "1.fc45", "arch": "x86_64" }, { "name": "quickshell-git-debugsource", "epoch": null, "version": "0.2.1^784.git1eb3d8b", "release": "1.fc45", "arch": "x86_64" }, { "name": "quickshell-git-debuginfo", "epoch": null, "version": "0.2.1^784.git1eb3d8b", "release": "1.fc45", "arch": "x86_64" }, { "name": "quickshell-git", "epoch": null, "version": "0.2.1^784.git1eb3d8b", "release": "1.fc45", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/errornointernet/quickshell/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/errornointernet/quickshell", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/errornointernet/quickshell", "result_dir": "10287345-quickshell-git", "built_packages": "quickshell-git 0.2.1^784.git1eb3d8b\nquickshell-git-debugsource 0.2.1^784.git1eb3d8b\nquickshell-git-debuginfo 0.2.1^784.git1eb3d8b", "id": 10287345, "mockchain_macros": { "copr_username": "errornointernet", "copr_projectname": "quickshell", "vendor": "Fedora Project COPR (errornointernet/quickshell)" } } ] } [2026-04-02 14:24:02,260][ INFO][PID:1683199] Sending fedora-messaging bus message in build.end [2026-04-02 14:24:02,288][ INFO][PID:1683199] Compressing /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/builder-live.log by gzip [2026-04-02 14:24:02,289][ INFO][PID:1683199] Running command 'gzip /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/builder-live.log' as PID 1987557 [2026-04-02 14:24:02,455][ INFO][PID:1683199] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/builder-live.log) [2026-04-02 14:24:02,456][ INFO][PID:1683199] Compressing /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/backend.log by gzip [2026-04-02 14:24:02,457][ INFO][PID:1683199] Running command 'gzip /var/lib/copr/public_html/results/errornointernet/quickshell/fedora-rawhide-x86_64/10287345-quickshell-git/backend.log' as PID 1987575