[2025-07-14 15:23:42,183][ INFO][PID:3823597] Marking build as starting [2025-07-14 15:23:42,219][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:23:42,221][ INFO][PID:3823597] VM allocation process starts [2025-07-14 15:23:42,255][ INFO][PID:3823597] Trying to allocate VM: ResallocHost, ticket_id=3921515, requested_tags=['copr_builder', 'arch_i386'] [2025-07-14 15:23:47,261][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:23:52,263][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:23:57,264][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:02,266][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:07,268][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:12,269][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:17,270][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:22,272][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:27,275][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:32,276][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:37,277][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:42,278][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:47,280][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:52,281][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:24:57,283][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:02,284][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:07,286][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:12,287][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:17,288][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:22,289][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:27,291][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:32,292][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:37,293][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:42,297][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:47,298][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:52,300][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:25:57,302][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:02,304][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:07,307][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:12,309][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:17,310][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:22,311][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:27,312][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:32,314][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:37,319][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:42,320][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:47,321][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:52,323][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:26:57,324][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:00,409][ INFO][PID:3823597] Allocated host ResallocHost, ticket_id=3921515, hostname=44.222.85.74, name=aws_x86_64_spot_prod_05374325_20250714_152439, requested_tags=['copr_builder', 'arch_i386'] [2025-07-14 15:27:00,410][ INFO][PID:3823597] Allocating ssh connection to builder [2025-07-14 15:27:00,410][ INFO][PID:3823597] Checking that builder machine is OK [2025-07-14 15:27:00,908][ INFO][PID:3823597] Running remote command: copr-builder-ready fedora-41-i386 [2025-07-14 15:27:01,114][ INFO][PID:3823597] Red Hat subscription not needed for fedora-41-i386 Builder is ready to be used [2025-07-14 15:27:01,115][ INFO][PID:3823597] Filling build.info file with builder info [2025-07-14 15:27:01,115][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:01,116][ INFO][PID:3823597] Sending build state back to frontend: { "builds": [ { "timeout": 28000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "mesa-git", "project_dirname": "mesa-git", "submitter": "xxmitsu", "ended_on": null, "started_on": 1752506821.11655, "submitted_on": null, "status": 3, "chroot": "fedora-41-i386", "arch": "i386", "buildroot_pkgs": [ "git", "xorg-x11-server-devel", "gcc", "g++" ], "task_id": "9272301-fedora-41-i386", "build_id": 9272301, "package_name": "mesa", "package_version": "25.2.0-0.3.20250714.15.b530692", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/mesa-git/mesa", "git_hash": "0f77b9d0a60c324f97e74fe62f751fbb3800c92a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/mesa-git--xxmitsu", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git/fedora-41-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [ "separatepref", "llvm9" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/mesa-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git", "result_dir": "09272301-mesa", "built_packages": "", "id": 9272301, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "mesa-git", "vendor": "Fedora Project COPR (xxmitsu/mesa-git)" } } ] } [2025-07-14 15:27:01,164][ INFO][PID:3823597] Sending fedora-messaging bus message in build.start [2025-07-14 15:27:01,909][ INFO][PID:3823597] Sending fedora-messaging bus message in chroot.start [2025-07-14 15:27:01,934][ INFO][PID:3823597] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272301-fedora-41-i386 --chroot fedora-41-i386 --detached [2025-07-14 15:27:02,270][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 1 [2025-07-14 15:27:02,272][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.85.74 copr-rpmbuild-log [2025-07-14 15:27:07,278][ INFO][PID:3823597] Periodic builder liveness probe: alive [2025-07-14 15:27:07,279][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:12,281][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:17,282][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:22,283][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:27,285][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:32,286][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:37,288][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:42,290][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:47,291][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:52,292][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:27:57,293][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:02,294][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:07,295][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:12,296][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:17,298][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:22,299][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:27,300][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:32,301][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:37,302][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:42,303][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:47,305][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:51,590][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:28:52,306][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:28:57,307][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:01,591][WARNING][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 15:29:02,308][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:07,310][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:11,592][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 2 [2025-07-14 15:29:11,597][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.85.74 copr-rpmbuild-log [2025-07-14 15:29:12,310][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:17,312][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:22,313][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:27,315][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:32,316][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:37,317][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:42,318][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:47,319][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:52,320][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:29:57,322][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:02,323][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:07,324][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:11,665][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:30:12,326][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:17,327][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:21,669][WARNING][PID:3823597] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 15:30:22,329][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:27,331][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:31,670][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 3 [2025-07-14 15:30:31,671][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.85.74 copr-rpmbuild-log [2025-07-14 15:30:32,338][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:37,339][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:42,340][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:47,342][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:52,343][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:30:57,344][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:02,345][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:07,347][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:12,348][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:17,349][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:22,350][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:27,351][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:31,739][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:31:32,353][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:37,355][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:41,752][WARNING][PID:3823597] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 15:31:42,356][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:47,360][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:51,753][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 4 [2025-07-14 15:31:51,754][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.222.85.74 copr-rpmbuild-log [2025-07-14 15:31:52,363][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:31:57,364][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:02,365][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:07,366][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:12,367][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:17,368][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:22,370][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:27,371][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:32,372][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:37,374][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:42,376][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:47,377][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:51,823][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:32:52,378][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:32:57,379][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:01,830][ ERROR][PID:3823597] Giving up for unstable SSH, failures: 1752506941.5918243, 1752507021.6694126, 1752507101.7524672, 1752507181.830226 [2025-07-14 15:33:01,831][ ERROR][PID:3823597] Re-try request for task on 'ResallocHost, ticket_id=3921515, hostname=44.222.85.74, name=aws_x86_64_spot_prod_05374325_20250714_152439, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-14 15:33:01,831][ INFO][PID:3823597] Releasing VM back to pool [2025-07-14 15:33:01,841][ INFO][PID:3823597] Retry #1 (on other host) [2025-07-14 15:33:01,842][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:01,842][ INFO][PID:3823597] VM allocation process starts [2025-07-14 15:33:01,852][ INFO][PID:3823597] Trying to allocate VM: ResallocHost, ticket_id=3921657, requested_tags=['copr_builder', 'arch_i386'] [2025-07-14 15:33:06,854][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:11,855][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:16,858][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:21,859][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:26,860][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:31,862][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:36,864][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:41,866][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:46,867][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:51,869][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:33:56,870][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:01,872][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:06,874][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:11,876][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:16,877][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:21,878][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:26,880][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:31,881][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:36,882][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:41,883][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:46,884][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:51,885][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:34:56,889][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:01,891][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:06,894][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:11,895][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:16,896][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:21,898][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:26,900][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:31,902][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:36,903][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:41,904][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:46,906][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:51,907][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:35:56,908][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:01,912][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:06,916][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:11,918][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:16,919][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:21,920][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:26,922][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:31,924][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:36,925][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:41,926][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:46,928][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:51,933][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:36:56,934][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:01,936][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:06,937][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:11,939][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:16,940][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:21,941][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:26,943][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:31,944][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:36,953][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:41,955][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:46,956][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:51,957][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:37:56,958][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:01,961][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:06,963][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:11,967][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:16,974][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:21,975][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:26,976][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:31,977][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:36,978][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:41,981][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:46,982][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:51,983][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:38:56,985][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:01,986][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:06,987][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:11,989][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:16,990][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:21,992][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:26,993][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:31,994][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:36,995][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:41,996][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:46,997][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:51,998][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:39:57,000][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:02,002][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:07,003][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:12,004][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:17,005][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:22,006][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:27,007][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:32,009][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:37,010][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:42,011][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:47,012][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:52,014][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:40:57,017][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:02,018][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:07,020][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:12,021][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:17,023][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:22,024][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:27,025][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:32,026][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:37,029][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:42,031][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:47,038][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:52,040][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:41:57,041][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:02,042][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:07,044][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:12,046][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:17,049][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:20,030][ INFO][PID:3823597] Allocated host ResallocHost, ticket_id=3921657, hostname=44.223.38.154, name=aws_x86_64_spot_prod_05375432_20250714_154034, requested_tags=['copr_builder', 'arch_i386'] [2025-07-14 15:42:20,031][ INFO][PID:3823597] Allocating ssh connection to builder [2025-07-14 15:42:20,033][ INFO][PID:3823597] Checking that builder machine is OK [2025-07-14 15:42:20,578][ INFO][PID:3823597] Running remote command: copr-builder-ready fedora-41-i386 [2025-07-14 15:42:20,789][ INFO][PID:3823597] Red Hat subscription not needed for fedora-41-i386 Builder is ready to be used [2025-07-14 15:42:20,789][ INFO][PID:3823597] Filling build.info file with builder info [2025-07-14 15:42:20,802][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:20,803][ INFO][PID:3823597] Not re-notifying FE and msg buses for the new host. [2025-07-14 15:42:20,804][ INFO][PID:3823597] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272301-fedora-41-i386 --chroot fedora-41-i386 --detached [2025-07-14 15:42:21,166][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 1 [2025-07-14 15:42:21,173][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.223.38.154 copr-rpmbuild-log [2025-07-14 15:42:26,182][ INFO][PID:3823597] Periodic builder liveness probe: alive [2025-07-14 15:42:26,183][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:31,184][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:36,186][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:41,187][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:46,190][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:51,194][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:42:56,196][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:01,201][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:06,204][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:11,205][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:16,209][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:21,210][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:26,215][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:31,218][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:36,228][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:41,230][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:46,232][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:51,237][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:43:56,238][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:01,240][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:06,241][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:11,242][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:16,243][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:21,245][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:26,246][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:31,247][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:36,249][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:41,250][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:46,252][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:51,253][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:44:56,254][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:01,255][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:06,256][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:11,258][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:16,259][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:21,261][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:26,262][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:31,263][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:36,264][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:41,266][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:46,268][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:51,272][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:45:56,273][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:01,274][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:06,280][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:11,290][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:16,292][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:21,294][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:26,295][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:30,788][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:46:31,297][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:36,301][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:40,792][WARNING][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 15:46:41,302][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:46,303][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:50,793][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 2 [2025-07-14 15:46:50,797][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.223.38.154 copr-rpmbuild-log [2025-07-14 15:46:51,304][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:46:56,306][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:01,307][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:06,308][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:11,315][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:16,321][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:21,322][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:26,324][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:31,325][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:36,327][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:41,330][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:46,331][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:50,867][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:47:51,332][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:47:56,334][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:00,874][WARNING][PID:3823597] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 15:48:01,336][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:06,342][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:10,875][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 3 [2025-07-14 15:48:10,876][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.223.38.154 copr-rpmbuild-log [2025-07-14 15:48:11,344][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:16,345][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:21,347][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:26,349][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:31,350][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:36,353][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:41,355][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:46,358][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:51,361][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:48:56,363][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:01,372][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:06,374][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:10,949][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:49:11,375][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:16,379][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:21,029][WARNING][PID:3823597] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-14 15:49:21,384][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:26,385][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:31,031][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 4 [2025-07-14 15:49:31,033][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.223.38.154 copr-rpmbuild-log [2025-07-14 15:49:31,387][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:36,389][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:41,392][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:46,396][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:51,398][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:49:56,406][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:01,407][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:06,408][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:11,410][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:16,413][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:21,415][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:26,433][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:31,101][ ERROR][PID:3823597] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-14 15:50:31,434][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:36,435][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:41,123][ ERROR][PID:3823597] Giving up for unstable SSH, failures: 1752508000.7927995, 1752508080.874263, 1752508161.0291786, 1752508241.1232305 [2025-07-14 15:50:41,124][ ERROR][PID:3823597] Re-try request for task on 'ResallocHost, ticket_id=3921657, hostname=44.223.38.154, name=aws_x86_64_spot_prod_05375432_20250714_154034, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-14 15:50:41,124][ INFO][PID:3823597] Releasing VM back to pool [2025-07-14 15:50:41,135][ INFO][PID:3823597] Retry #2 (on other host) [2025-07-14 15:50:41,136][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:41,137][ INFO][PID:3823597] VM allocation process starts [2025-07-14 15:50:41,151][ INFO][PID:3823597] Trying to allocate VM: ResallocHost, ticket_id=3922013, requested_tags=['copr_builder', 'arch_i386'] [2025-07-14 15:50:46,153][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:51,155][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:50:56,156][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:01,158][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:06,159][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:11,160][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:16,161][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:21,162][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:26,163][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:31,164][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:36,166][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:41,167][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:46,168][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:49,216][ INFO][PID:3823597] Allocated host ResallocHost, ticket_id=3922013, hostname=50.19.65.62, name=aws_x86_64_normalreserved_prod_05374151_20250714_152248, requested_tags=['copr_builder', 'arch_i386'] [2025-07-14 15:51:49,216][ INFO][PID:3823597] Allocating ssh connection to builder [2025-07-14 15:51:49,217][ INFO][PID:3823597] Checking that builder machine is OK [2025-07-14 15:51:49,830][ INFO][PID:3823597] Running remote command: copr-builder-ready fedora-41-i386 [2025-07-14 15:51:50,068][ INFO][PID:3823597] Red Hat subscription not needed for fedora-41-i386 Builder is ready to be used [2025-07-14 15:51:50,069][ INFO][PID:3823597] Filling build.info file with builder info [2025-07-14 15:51:50,093][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:51:50,095][ INFO][PID:3823597] Not re-notifying FE and msg buses for the new host. [2025-07-14 15:51:50,096][ INFO][PID:3823597] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272301-fedora-41-i386 --chroot fedora-41-i386 --detached [2025-07-14 15:51:50,513][ INFO][PID:3823597] Downloading the builder-live.log file, attempt 1 [2025-07-14 15:51:50,518][ INFO][PID:3823597] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@50.19.65.62 copr-rpmbuild-log [2025-07-14 15:51:55,514][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:00,515][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:05,516][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:10,517][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:15,518][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:20,520][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:25,522][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:30,529][ INFO][PID:3823597] Periodic builder liveness probe: alive [2025-07-14 15:52:30,529][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:35,530][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:40,531][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:45,532][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:50,535][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:52:55,536][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:00,537][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:05,538][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:10,539][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:15,541][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:20,542][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:25,543][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:30,545][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:35,547][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:40,550][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:45,551][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:50,552][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:53:55,553][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:00,554][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:05,555][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:10,557][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:15,558][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:20,561][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:25,563][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:30,563][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:35,565][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:40,567][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:45,568][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:50,569][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:54:55,570][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:00,571][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:05,572][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:10,574][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:15,574][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:20,575][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:25,577][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:30,578][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:35,579][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:40,580][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:45,581][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:50,583][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:55:55,584][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:00,586][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:05,587][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:10,589][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:15,590][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:20,591][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:25,592][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:30,594][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:35,595][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:40,597][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:45,600][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:50,602][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:56:55,603][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:00,604][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:05,605][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:10,613][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:15,614][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:20,615][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:25,619][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:30,620][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:35,621][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:40,623][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:45,624][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:50,626][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:57:55,627][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:00,629][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:05,630][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:10,631][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:15,632][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:20,634][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:25,635][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:30,636][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:35,637][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:40,638][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:45,640][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:50,641][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:58:55,642][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:00,644][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:05,645][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:10,646][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:15,647][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:20,649][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:25,650][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:30,652][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:35,654][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:40,655][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:45,656][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:50,657][ INFO][PID:3823597] Checking for cancel request [2025-07-14 15:59:55,658][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:00,660][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:05,663][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:10,664][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:15,665][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:20,666][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:25,668][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:30,674][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:35,675][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:40,676][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:45,677][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:50,679][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:00:55,680][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:00,681][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:05,682][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:10,683][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:15,684][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:20,685][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:25,687][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:30,691][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:35,692][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:40,693][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:45,696][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:50,698][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:01:55,699][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:00,700][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:05,701][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:10,702][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:15,705][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:20,706][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:25,708][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:30,718][ INFO][PID:3823597] Periodic builder liveness probe: alive [2025-07-14 16:02:30,719][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:35,719][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:40,722][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:45,723][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:50,724][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:02:55,725][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:00,727][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:05,728][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:10,730][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:15,731][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:20,732][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:25,733][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:30,735][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:35,736][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:40,738][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:45,742][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:50,743][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:03:55,744][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:00,745][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:05,746][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:10,747][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:15,748][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:20,750][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:25,751][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:30,752][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:35,754][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:40,755][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:45,756][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:50,757][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:04:55,758][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:00,759][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:05,760][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:10,762][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:15,763][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:20,764][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:25,765][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:30,766][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:35,768][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:40,771][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:45,772][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:50,775][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:05:55,777][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:00,780][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:05,782][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:10,789][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:15,791][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:20,792][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:25,793][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:30,795][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:35,796][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:40,797][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:45,798][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:50,800][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:06:55,801][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:00,805][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:05,806][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:10,808][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:15,812][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:20,813][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:25,815][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:30,816][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:35,820][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:40,823][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:45,824][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:50,826][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:07:55,827][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:00,828][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:05,829][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:10,831][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:15,832][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:20,837][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:25,838][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:30,840][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:35,841][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:40,845][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:45,847][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:50,849][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:08:55,851][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:00,852][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:05,853][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:10,855][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:15,857][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:20,858][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:25,860][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:30,862][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:35,863][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:40,865][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:45,867][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:50,872][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:09:55,874][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:00,876][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:05,877][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:10,879][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:15,880][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:20,881][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:25,883][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:30,884][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:35,885][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:40,888][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:45,890][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:50,891][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:10:55,893][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:00,896][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:05,897][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:10,898][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:15,899][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:20,900][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:25,902][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:30,903][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:35,904][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:40,905][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:45,906][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:50,908][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:11:55,909][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:00,910][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:05,912][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:10,914][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:15,918][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:20,920][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:25,921][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:30,930][ INFO][PID:3823597] Periodic builder liveness probe: alive [2025-07-14 16:12:30,931][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:35,932][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:40,933][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:45,935][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:50,936][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:12:55,937][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:00,938][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:05,939][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:10,941][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:15,942][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:20,943][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:25,948][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:30,950][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:35,951][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:40,952][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:45,954][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:50,955][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:13:55,957][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:00,958][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:05,959][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:10,960][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:15,961][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:20,963][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:25,964][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:30,965][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:35,966][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:40,968][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:45,970][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:50,972][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:14:55,973][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:00,974][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:05,977][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:10,979][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:15,980][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:20,983][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:25,984][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:30,987][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:35,992][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:40,994][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:45,996][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:50,997][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:55,998][ INFO][PID:3823597] Checking for cancel request [2025-07-14 16:15:57,060][ INFO][PID:3823597] Downloading results from builder [2025-07-14 16:15:57,060][ INFO][PID:3823597] rsyncing of mockbuilder@50.19.65.62:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa started [2025-07-14 16:15:57,061][ INFO][PID:3823597] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@50.19.65.62:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/ &> /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/build-09272301.rsync.log [2025-07-14 16:15:59,078][ INFO][PID:3823597] rsyncing finished. [2025-07-14 16:15:59,078][ INFO][PID:3823597] Releasing VM back to pool [2025-07-14 16:15:59,089][ INFO][PID:3823597] Searching for 'success' file in resultdir [2025-07-14 16:15:59,089][ INFO][PID:3823597] Going to sign pkgs from source: 9272301-fedora-41-i386 in chroot: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386 [2025-07-14 16:15:59,090][ INFO][PID:3823597] Calling '/bin/sign -u xxmitsu#mesa-git@copr.fedorahosted.org -p' (attempt #1) [2025-07-14 16:15:59,268][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libgbm-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:00,019][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libgbm-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:00,020][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-vulkan-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:01,440][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-vulkan-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:01,441][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libEGL-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:02,171][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libEGL-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:02,172][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libEGL-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:02,805][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libEGL-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:02,806][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libGL-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:03,403][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libGL-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:03,404][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libEGL-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:04,460][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libEGL-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:04,460][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libGL-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:05,194][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libGL-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:05,195][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-debugsource-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:06,906][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-debugsource-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:06,907][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libgbm-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:07,740][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libgbm-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:07,741][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:08,905][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:08,906][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-vdpau-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:09,588][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-vdpau-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:09,589][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-25.2.0-0.3.20250714.15.b530692.fc41.src.rpm' (attempt #1) [2025-07-14 16:16:11,767][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-25.2.0-0.3.20250714.15.b530692.fc41.src.rpm [2025-07-14 16:16:11,768][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libGL-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:12,423][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libGL-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:12,423][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libOpenCL-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:14,868][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libOpenCL-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:14,868][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-filesystem-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:15,519][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-filesystem-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:15,519][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-va-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:16,278][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-va-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:16,279][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libOpenCL-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:17,340][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libOpenCL-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:17,341][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-vulkan-drivers-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:20,364][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-vulkan-drivers-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:20,364][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-dri-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:21,091][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-dri-drivers-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:21,092][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libgbm-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:21,773][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libgbm-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:21,775][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libOpenCL-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:22,524][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-libOpenCL-devel-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:22,525][ INFO][PID:3823597] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-dri-drivers-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm' (attempt #1) [2025-07-14 16:16:24,673][ INFO][PID:3823597] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/mesa-dri-drivers-debuginfo-25.2.0-0.3.20250714.15.b530692.fc41.i686.rpm [2025-07-14 16:16:24,674][ INFO][PID:3823597] Sign done [2025-07-14 16:16:24,675][ INFO][PID:3823597] Incremental createrepo run, adding 09272301-mesa into https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git/fedora-41-i386, (auto-create-repo=True) [2025-07-14 16:16:24,676][ INFO][PID:3823597] Running command 'copr-repo --batched /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386 --add 09272301-mesa --no-appstream-metadata' as PID 26660 [2025-07-14 16:16:26,722][ INFO][PID:3823597] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386 --add 09272301-mesa --no-appstream-metadata) [2025-07-14 16:16:26,723][ INFO][PID:3823597] Getting build details [2025-07-14 16:16:26,723][ INFO][PID:3823597] Listing built binary packages in /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa [2025-07-14 16:16:26,724][ INFO][PID:3823597] Built packages: ['mesa-debuginfo 25.2.0', 'mesa-vulkan-drivers-debuginfo 25.2.0', 'mesa-dri-drivers-debuginfo 25.2.0', 'mesa-vulkan-drivers 25.2.0', 'mesa-va-drivers 25.2.0', 'mesa-libgbm-devel 25.2.0', 'mesa-libGL-debuginfo 25.2.0', 'mesa-libEGL 25.2.0', 'mesa-dri-drivers 25.2.0', 'mesa-vdpau-drivers 25.2.0', 'mesa-libgbm-debuginfo 25.2.0', 'mesa-libEGL-devel 25.2.0', 'mesa-libOpenCL-devel 25.2.0', 'mesa-libGL-devel 25.2.0', 'mesa-debugsource 25.2.0', 'mesa-libEGL-debuginfo 25.2.0', 'mesa-libGL 25.2.0', 'mesa-filesystem 25.2.0', 'mesa-libOpenCL 25.2.0', 'mesa-libOpenCL-debuginfo 25.2.0', 'mesa-libgbm 25.2.0'] [2025-07-14 16:16:26,724][ INFO][PID:3823597] build details: {'built_packages': 'mesa-debuginfo 25.2.0\nmesa-vulkan-drivers-debuginfo 25.2.0\nmesa-dri-drivers-debuginfo 25.2.0\nmesa-vulkan-drivers 25.2.0\nmesa-va-drivers 25.2.0\nmesa-libgbm-devel 25.2.0\nmesa-libGL-debuginfo 25.2.0\nmesa-libEGL 25.2.0\nmesa-dri-drivers 25.2.0\nmesa-vdpau-drivers 25.2.0\nmesa-libgbm-debuginfo 25.2.0\nmesa-libEGL-devel 25.2.0\nmesa-libOpenCL-devel 25.2.0\nmesa-libGL-devel 25.2.0\nmesa-debugsource 25.2.0\nmesa-libEGL-debuginfo 25.2.0\nmesa-libGL 25.2.0\nmesa-filesystem 25.2.0\nmesa-libOpenCL 25.2.0\nmesa-libOpenCL-debuginfo 25.2.0\nmesa-libgbm 25.2.0'} [2025-07-14 16:16:26,724][ INFO][PID:3823597] Retrieving pubkey [2025-07-14 16:16:26,725][ INFO][PID:3823597] Calling '/bin/sign -u xxmitsu#mesa-git@copr.fedorahosted.org -p' (attempt #1) [2025-07-14 16:16:26,929][ INFO][PID:3823597] Added pubkey for user xxmitsu project mesa-git into: /var/lib/copr/public_html/results/xxmitsu/mesa-git/pubkey.gpg [2025-07-14 16:16:26,930][ INFO][PID:3823597] Finished build: id=9272301 failed=False timeout=28000 destdir=/var/lib/copr/public_html/results/xxmitsu/mesa-git chroot=fedora-41-i386 [2025-07-14 16:16:26,932][ INFO][PID:3823597] Worker succeeded build, took 1476.8362076282501 [2025-07-14 16:16:26,932][ INFO][PID:3823597] Sending build state back to frontend: { "builds": [ { "timeout": 28000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "mesa-git", "project_dirname": "mesa-git", "submitter": "xxmitsu", "ended_on": 1752509786.931972, "started_on": 1752508310.0957644, "submitted_on": null, "status": 1, "chroot": "fedora-41-i386", "arch": "i386", "buildroot_pkgs": [ "git", "xorg-x11-server-devel", "gcc", "g++" ], "task_id": "9272301-fedora-41-i386", "build_id": 9272301, "package_name": "mesa", "package_version": "25.2.0-0.3.20250714.15.b530692", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/mesa-git/mesa", "git_hash": "0f77b9d0a60c324f97e74fe62f751fbb3800c92a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/mesa-git--xxmitsu", "results": { "packages": [ { "name": "mesa-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-vulkan-drivers-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-dri-drivers-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-vulkan-drivers", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-va-drivers", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libgbm-devel", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libGL-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libEGL", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "src" }, { "name": "mesa-dri-drivers", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-vdpau-drivers", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libgbm-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libEGL-devel", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libOpenCL-devel", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libGL-devel", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-debugsource", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libEGL-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libGL", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-filesystem", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libOpenCL", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libOpenCL-debuginfo", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" }, { "name": "mesa-libgbm", "epoch": null, "version": "25.2.0", "release": "0.3.20250714.15.b530692.fc41", "arch": "i686" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git/fedora-41-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [ "separatepref", "llvm9" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/mesa-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git", "result_dir": "09272301-mesa", "built_packages": "mesa-debuginfo 25.2.0\nmesa-vulkan-drivers-debuginfo 25.2.0\nmesa-dri-drivers-debuginfo 25.2.0\nmesa-vulkan-drivers 25.2.0\nmesa-va-drivers 25.2.0\nmesa-libgbm-devel 25.2.0\nmesa-libGL-debuginfo 25.2.0\nmesa-libEGL 25.2.0\nmesa-dri-drivers 25.2.0\nmesa-vdpau-drivers 25.2.0\nmesa-libgbm-debuginfo 25.2.0\nmesa-libEGL-devel 25.2.0\nmesa-libOpenCL-devel 25.2.0\nmesa-libGL-devel 25.2.0\nmesa-debugsource 25.2.0\nmesa-libEGL-debuginfo 25.2.0\nmesa-libGL 25.2.0\nmesa-filesystem 25.2.0\nmesa-libOpenCL 25.2.0\nmesa-libOpenCL-debuginfo 25.2.0\nmesa-libgbm 25.2.0", "id": 9272301, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "mesa-git", "vendor": "Fedora Project COPR (xxmitsu/mesa-git)" } } ] } [2025-07-14 16:16:26,973][ INFO][PID:3823597] Sending fedora-messaging bus message in build.end [2025-07-14 16:16:26,998][ INFO][PID:3823597] Compressing /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/builder-live.log by gzip [2025-07-14 16:16:27,000][ INFO][PID:3823597] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/builder-live.log' as PID 27059 [2025-07-14 16:16:27,202][ INFO][PID:3823597] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/builder-live.log) [2025-07-14 16:16:27,203][ INFO][PID:3823597] Compressing /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/backend.log by gzip [2025-07-14 16:16:27,204][ INFO][PID:3823597] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-41-i386/09272301-mesa/backend.log' as PID 27093