[2025-08-20 16:10:42,746][ INFO][PID:3341056] Marking build as starting [2025-08-20 16:10:42,907][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:10:42,907][ INFO][PID:3341056] VM allocation process starts [2025-08-20 16:10:42,921][ INFO][PID:3341056] Trying to allocate VM: ResallocHost, ticket_id=4631835, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-20 16:10:47,922][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:10:52,924][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:10:57,926][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:02,926][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:07,927][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:12,930][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:17,931][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:22,933][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:27,935][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:32,935][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:37,937][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:42,938][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:47,939][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:52,940][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:11:57,941][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:02,942][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:07,943][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:12,944][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:17,945][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:22,946][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:27,947][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:32,949][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:37,950][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:42,951][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:47,953][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:52,957][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:12:57,958][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:02,959][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:07,960][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:12,962][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:17,965][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:22,967][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:27,968][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:32,969][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:37,971][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:42,972][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:47,973][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:52,976][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:13:57,979][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:02,980][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:07,982][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:12,983][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:17,984][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:22,986][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:27,987][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:32,988][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:37,989][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:42,990][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:47,992][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:52,994][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:14:57,995][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:02,996][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:07,998][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:13,001][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:18,006][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:23,007][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:28,011][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:33,012][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:38,016][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:43,017][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:48,018][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:53,019][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:15:58,020][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:01,056][ INFO][PID:3341056] Allocated host ResallocHost, ticket_id=4631835, hostname=18.234.244.197, name=aws_x86_64_spot_prod_06348959_20250820_161415, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-20 16:16:01,057][ INFO][PID:3341056] Allocating ssh connection to builder [2025-08-20 16:16:01,057][ INFO][PID:3341056] Checking that builder machine is OK [2025-08-20 16:16:01,491][ INFO][PID:3341056] Running remote command: copr-builder-ready fedora-43-x86_64 [2025-08-20 16:16:01,696][ INFO][PID:3341056] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2025-08-20 16:16:01,697][ INFO][PID:3341056] Filling build.info file with builder info [2025-08-20 16:16:01,698][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:01,699][ INFO][PID:3341056] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "mesa-git", "project_dirname": "mesa-git", "submitter": "https://src.fedoraproject.org/user/zbyszek", "ended_on": null, "started_on": 1755706561.6989007, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [ "git", "xorg-x11-server-devel", "gcc" ], "task_id": "9450868-fedora-43-x86_64", "build_id": 9450868, "package_name": "meson", "package_version": "1.8.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/mesa-git/meson", "git_hash": "34216404f11e24eac4833f7d5839bc2731125675", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/mesa-git--https://src.fedoraproject.org/user/zbyszek", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [ "separatepref", "llvm9" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/mesa-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git", "result_dir": "09450868-meson", "built_packages": "", "id": 9450868, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "mesa-git", "vendor": "Fedora Project COPR (xxmitsu/mesa-git)" } } ] } [2025-08-20 16:16:01,739][ INFO][PID:3341056] Sending fedora-messaging bus message in build.start [2025-08-20 16:16:02,597][ INFO][PID:3341056] Sending fedora-messaging bus message in chroot.start [2025-08-20 16:16:02,633][ INFO][PID:3341056] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9450868-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2025-08-20 16:16:02,978][ INFO][PID:3341056] Downloading the builder-live.log file, attempt 1 [2025-08-20 16:16:02,980][ INFO][PID:3341056] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.234.244.197 copr-rpmbuild-log [2025-08-20 16:16:07,989][ INFO][PID:3341056] Periodic builder liveness probe: alive [2025-08-20 16:16:07,990][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:12,991][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:17,992][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:22,993][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:27,994][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:32,996][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:37,997][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:42,998][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:47,999][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:53,000][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:16:58,002][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:03,003][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:08,005][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:13,006][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:18,008][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:23,009][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:28,011][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:33,012][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:38,013][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:43,014][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:48,015][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:53,016][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:17:58,017][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:03,018][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:08,019][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:13,020][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:18,021][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:23,022][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:28,023][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:33,024][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:38,025][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:43,027][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:48,028][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:53,029][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:18:58,030][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:03,031][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:08,032][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:13,033][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:18,034][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:23,035][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:28,036][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:33,037][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:38,038][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:43,039][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:48,040][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:53,041][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:19:58,043][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:03,047][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:08,048][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:13,049][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:18,050][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:23,051][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:28,052][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:33,053][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:38,055][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:43,056][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:48,057][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:53,058][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:20:57,388][ ERROR][PID:3341056] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-20 16:20:58,059][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:03,060][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:07,389][WARNING][PID:3341056] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-20 16:21:08,061][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:13,062][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:17,390][ INFO][PID:3341056] Downloading the builder-live.log file, attempt 2 [2025-08-20 16:21:17,392][ INFO][PID:3341056] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.234.244.197 copr-rpmbuild-log [2025-08-20 16:21:18,064][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:23,065][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:28,066][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:33,067][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:38,068][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:43,069][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:48,070][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:53,071][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:21:58,072][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:03,074][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:08,075][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:13,076][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:17,459][ ERROR][PID:3341056] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-20 16:22:18,077][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:23,078][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:27,460][WARNING][PID:3341056] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-20 16:22:28,080][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:33,083][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:37,461][ INFO][PID:3341056] Downloading the builder-live.log file, attempt 3 [2025-08-20 16:22:37,463][ INFO][PID:3341056] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.234.244.197 copr-rpmbuild-log [2025-08-20 16:22:38,086][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:43,087][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:48,088][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:53,089][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:22:58,090][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:03,092][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:08,093][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:13,094][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:18,095][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:23,096][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:28,097][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:33,098][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:37,533][ ERROR][PID:3341056] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-20 16:23:38,099][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:43,100][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:47,534][WARNING][PID:3341056] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-20 16:23:48,101][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:53,102][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:23:57,535][ INFO][PID:3341056] Downloading the builder-live.log file, attempt 4 [2025-08-20 16:23:57,536][ INFO][PID:3341056] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.234.244.197 copr-rpmbuild-log [2025-08-20 16:23:58,103][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:03,105][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:08,106][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:13,107][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:18,109][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:23,110][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:28,111][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:33,112][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:38,113][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:43,114][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:48,118][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:53,119][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:24:57,607][ ERROR][PID:3341056] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-20 16:24:58,122][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:03,124][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:07,610][ ERROR][PID:3341056] Giving up for unstable SSH, failures: 1755706867.3896804, 1755706947.4607759, 1755707027.5344107, 1755707107.6098018 [2025-08-20 16:25:07,611][ ERROR][PID:3341056] Re-try request for task on 'ResallocHost, ticket_id=4631835, hostname=18.234.244.197, name=aws_x86_64_spot_prod_06348959_20250820_161415, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-08-20 16:25:07,611][ INFO][PID:3341056] Releasing VM back to pool [2025-08-20 16:25:07,630][ INFO][PID:3341056] Retry #1 (on other host) [2025-08-20 16:25:07,631][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:07,632][ INFO][PID:3341056] VM allocation process starts [2025-08-20 16:25:07,649][ INFO][PID:3341056] Trying to allocate VM: ResallocHost, ticket_id=4632007, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-20 16:25:10,669][ INFO][PID:3341056] Allocated host ResallocHost, ticket_id=4632007, hostname=2620:52:3:1:dead:beef:cafe:c114, name=copr_hv_x86_64_01_prod_06349189_20250820_162140, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-20 16:25:10,670][ INFO][PID:3341056] Allocating ssh connection to builder [2025-08-20 16:25:10,670][ INFO][PID:3341056] Checking that builder machine is OK [2025-08-20 16:25:11,207][ INFO][PID:3341056] Running remote command: copr-builder-ready fedora-43-x86_64 [2025-08-20 16:25:11,536][ INFO][PID:3341056] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2025-08-20 16:25:11,537][ INFO][PID:3341056] Filling build.info file with builder info [2025-08-20 16:25:11,538][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:11,540][ INFO][PID:3341056] Not re-notifying FE and msg buses for the new host. [2025-08-20 16:25:11,540][ INFO][PID:3341056] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9450868-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2025-08-20 16:25:12,108][ INFO][PID:3341056] Downloading the builder-live.log file, attempt 1 [2025-08-20 16:25:12,109][ INFO][PID:3341056] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c114 copr-rpmbuild-log [2025-08-20 16:25:17,108][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:22,110][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:27,111][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:32,113][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:37,114][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:42,116][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:47,117][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:52,119][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:25:57,120][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:02,121][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:07,122][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:12,128][ INFO][PID:3341056] Periodic builder liveness probe: alive [2025-08-20 16:26:12,129][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:17,130][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:22,131][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:27,132][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:32,133][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:37,134][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:42,135][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:47,136][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:52,137][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:26:57,138][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:02,139][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:07,140][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:12,141][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:17,143][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:22,146][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:27,150][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:32,152][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:37,153][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:42,154][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:47,155][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:52,156][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:27:57,157][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:02,158][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:07,159][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:12,162][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:17,164][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:22,165][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:27,166][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:32,167][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:37,169][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:42,170][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:47,171][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:52,172][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:28:57,173][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:02,174][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:07,175][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:12,176][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:17,177][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:22,178][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:27,186][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:32,187][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:37,188][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:42,189][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:47,191][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:52,192][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:29:57,193][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:02,196][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:07,197][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:12,198][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:17,199][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:22,200][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:27,201][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:32,205][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:37,206][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:42,215][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:47,216][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:52,220][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:30:57,222][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:02,224][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:07,226][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:12,227][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:17,230][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:22,233][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:27,236][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:32,240][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:37,241][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:42,243][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:47,249][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:52,254][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:31:57,259][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:02,261][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:07,265][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:12,267][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:17,269][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:22,270][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:27,272][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:32,273][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:37,274][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:42,275][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:47,276][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:52,278][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:32:57,279][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:02,280][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:07,281][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:12,282][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:17,283][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:22,284][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:27,286][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:32,287][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:37,288][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:42,289][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:47,290][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:52,291][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:33:57,293][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:02,295][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:07,296][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:12,297][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:17,298][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:22,300][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:27,305][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:32,306][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:37,307][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:42,308][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:47,309][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:52,310][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:34:57,311][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:02,312][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:07,313][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:12,314][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:17,315][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:22,316][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:27,317][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:32,318][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:37,319][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:42,320][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:47,321][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:52,322][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:35:57,323][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:02,324][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:07,325][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:12,331][ INFO][PID:3341056] Periodic builder liveness probe: alive [2025-08-20 16:36:12,331][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:17,332][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:22,333][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:27,334][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:32,335][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:37,336][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:42,337][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:47,338][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:52,339][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:36:57,340][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:02,341][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:07,342][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:12,343][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:17,344][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:22,345][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:27,346][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:32,347][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:37,348][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:42,349][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:47,350][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:52,351][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:37:57,352][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:38:02,353][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:38:07,354][ INFO][PID:3341056] Checking for cancel request [2025-08-20 16:38:10,573][ INFO][PID:3341056] Downloading results from builder [2025-08-20 16:38:10,573][ INFO][PID:3341056] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c114]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson started [2025-08-20 16:38:10,574][ INFO][PID:3341056] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c114]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/ &> /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/build-09450868.rsync.log [2025-08-20 16:38:11,111][ INFO][PID:3341056] rsyncing finished. [2025-08-20 16:38:11,112][ INFO][PID:3341056] Releasing VM back to pool [2025-08-20 16:38:11,120][ INFO][PID:3341056] Searching for 'success' file in resultdir [2025-08-20 16:38:11,121][ INFO][PID:3341056] Going to sign pkgs from source: 9450868-fedora-43-x86_64 in chroot: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64 [2025-08-20 16:38:11,122][ INFO][PID:3341056] Calling '/bin/sign -u xxmitsu#mesa-git@copr.fedorahosted.org -p' (attempt #1) [2025-08-20 16:38:11,298][ INFO][PID:3341056] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/meson-1.8.4-1.fc43.src.rpm' (attempt #1) [2025-08-20 16:38:11,917][ INFO][PID:3341056] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/meson-1.8.4-1.fc43.src.rpm [2025-08-20 16:38:11,918][ INFO][PID:3341056] Calling '/bin/sign -4 -h sha256 -u xxmitsu#mesa-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/meson-1.8.4-1.fc43.noarch.rpm' (attempt #1) [2025-08-20 16:38:12,697][ INFO][PID:3341056] signed rpm: /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/meson-1.8.4-1.fc43.noarch.rpm [2025-08-20 16:38:12,697][ INFO][PID:3341056] Sign done [2025-08-20 16:38:12,698][ INFO][PID:3341056] Incremental createrepo run, adding 09450868-meson into https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git/fedora-43-x86_64, (auto-create-repo=True) [2025-08-20 16:38:12,699][ INFO][PID:3341056] Running command 'copr-repo --batched /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64 --add 09450868-meson --no-appstream-metadata' as PID 3517176 [2025-08-20 16:38:13,971][ INFO][PID:3341056] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64 --add 09450868-meson --no-appstream-metadata) [2025-08-20 16:38:13,971][ INFO][PID:3341056] Getting build details [2025-08-20 16:38:13,972][ INFO][PID:3341056] Listing built binary packages in /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson [2025-08-20 16:38:13,972][ INFO][PID:3341056] Built packages: ['meson 1.8.4'] [2025-08-20 16:38:13,972][ INFO][PID:3341056] build details: {'built_packages': 'meson 1.8.4'} [2025-08-20 16:38:13,973][ INFO][PID:3341056] Retrieving pubkey [2025-08-20 16:38:13,973][ INFO][PID:3341056] Calling '/bin/sign -u xxmitsu#mesa-git@copr.fedorahosted.org -p' (attempt #1) [2025-08-20 16:38:14,155][ INFO][PID:3341056] Added pubkey for user xxmitsu project mesa-git into: /var/lib/copr/public_html/results/xxmitsu/mesa-git/pubkey.gpg [2025-08-20 16:38:14,155][ INFO][PID:3341056] Finished build: id=9450868 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/xxmitsu/mesa-git chroot=fedora-43-x86_64 [2025-08-20 16:38:14,157][ INFO][PID:3341056] Worker succeeded build, took 782.6171889305115 [2025-08-20 16:38:14,157][ INFO][PID:3341056] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "xxmitsu", "project_name": "mesa-git", "project_dirname": "mesa-git", "submitter": "https://src.fedoraproject.org/user/zbyszek", "ended_on": 1755707894.1574035, "started_on": 1755707111.5402145, "submitted_on": null, "status": 1, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [ "git", "xorg-x11-server-devel", "gcc" ], "task_id": "9450868-fedora-43-x86_64", "build_id": 9450868, "package_name": "meson", "package_version": "1.8.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/xxmitsu/mesa-git/meson", "git_hash": "34216404f11e24eac4833f7d5839bc2731125675", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "xxmitsu/mesa-git--https://src.fedoraproject.org/user/zbyszek", "results": { "packages": [ { "name": "meson", "epoch": null, "version": "1.8.4", "release": "1.fc43", "arch": "noarch" }, { "name": "meson", "epoch": null, "version": "1.8.4", "release": "1.fc43", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [ "separatepref", "llvm9" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/xxmitsu/mesa-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/xxmitsu/mesa-git", "result_dir": "09450868-meson", "built_packages": "meson 1.8.4", "id": 9450868, "mockchain_macros": { "copr_username": "xxmitsu", "copr_projectname": "mesa-git", "vendor": "Fedora Project COPR (xxmitsu/mesa-git)" } } ] } [2025-08-20 16:38:14,199][ INFO][PID:3341056] Sending fedora-messaging bus message in build.end [2025-08-20 16:38:14,221][ INFO][PID:3341056] Compressing /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/builder-live.log by gzip [2025-08-20 16:38:14,222][ INFO][PID:3341056] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/builder-live.log' as PID 3517213 [2025-08-20 16:38:14,240][ INFO][PID:3341056] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/builder-live.log) [2025-08-20 16:38:14,240][ INFO][PID:3341056] Compressing /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/backend.log by gzip [2025-08-20 16:38:14,241][ INFO][PID:3341056] Running command 'gzip /var/lib/copr/public_html/results/xxmitsu/mesa-git/fedora-43-x86_64/09450868-meson/backend.log' as PID 3517214