[2026-03-30 13:30:59,300][ INFO][PID:98391] Marking build as starting [2026-03-30 13:30:59,362][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:30:59,365][ INFO][PID:98391] VM allocation process starts [2026-03-30 13:30:59,381][ INFO][PID:98391] Trying to allocate VM: ResallocHost, ticket_id=2093194, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-30 13:31:04,388][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:09,389][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:14,390][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:19,395][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:24,396][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:29,398][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:34,399][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:39,400][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:44,401][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:49,402][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:54,403][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:31:59,404][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:04,405][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:09,407][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:14,408][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:19,444][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:24,445][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:29,446][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:34,447][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:39,448][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:44,449][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:49,451][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:54,452][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:32:59,453][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:04,454][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:09,455][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:14,474][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:19,475][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:24,478][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:29,481][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:34,482][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:39,483][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:44,487][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:49,489][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:54,490][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:33:59,495][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:04,496][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:09,497][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:14,498][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:19,503][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:24,504][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:29,505][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:34,506][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:39,507][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:44,508][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:49,510][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:54,511][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:34:59,513][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:04,515][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:09,516][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:14,518][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:19,519][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:24,519][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:29,520][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:34,522][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:39,523][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:44,563][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:49,564][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:54,622][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:35:59,623][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:04,624][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:09,625][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:14,627][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:19,638][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:24,639][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:29,640][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:34,645][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:39,648][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:44,649][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:49,650][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:54,656][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:36:59,667][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:04,668][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:09,669][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:14,671][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:19,675][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:24,676][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:29,677][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:34,679][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:39,680][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:44,681][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:49,682][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:54,683][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:37:59,684][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:04,686][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:09,690][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:14,691][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:17,584][ INFO][PID:98391] Allocated host ResallocHost, ticket_id=2093194, hostname=18.215.174.37, name=aws_x86_64_normalreserved_prod_04393046_20260330_133647, requested_tags=['copr_builder', 'arch_x86_64'] [2026-03-30 13:38:17,586][ INFO][PID:98391] Allocating ssh connection to builder [2026-03-30 13:38:17,586][ INFO][PID:98391] Checking that builder machine is OK [2026-03-30 13:38:17,919][ INFO][PID:98391] Running remote command: copr-builder-ready srpm-builds [2026-03-30 13:38:18,129][ INFO][PID:98391] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-03-30 13:38:18,130][ INFO][PID:98391] Filling build.info file with builder info [2026-03-30 13:38:18,279][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:18,280][ INFO][PID:98391] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "ocm", "project_name": "tools", "project_dirname": "tools", "submitter": null, "ended_on": null, "started_on": 1774877898.2803535, "submitted_on": null, "status": 3, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "10274177", "build_id": 10274177, "package_name": "ocm-cli", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"# Check that the event payload exists:\\nif [[ ! -f hook_payload ]]; then\\n echo \\\"Event payload file 'hook_payload' doesn't exist\\\"\\n exit 1\\nfi\\n\\n# Check that the event is the creation of a tag:\\nref_type=$(cat hook_payload | jq -r .ref_type)\\nif [[ \\\"${ref_type}\\\" != \\\"tag\\\" ]]; then\\n echo \\\"Expected reference type 'tag' but got '${ref_type}'\\\"\\n exit 1\\nfi\\n\\n# Check that the tag is well formed:\\nref=$(cat hook_payload | jq -r .ref)\\nif [[ ! \\\"${ref}\\\" =~ ^v[0-9]+\\\\.[0-9]+\\\\.[0-9]+$ ]]; then\\n echo \\\"Reference '${ref}' isn't well formed\\\"\\n exit 1\\nfi\\n\\n# Set the version to use:\\nversion=\\\"${ref:1}\\\"\\n\\n# Set the date:\\ndate=$(date +'%a %b %d %Y')\\n\\n# Generate the .spec file:\\ncat > ocm-cli.spec.in <<\\\".\\\"\\n%global debug_package %{nil}\\n\\nName: ocm-cli\\nVersion: @version@\\nRelease: 1%{?dist}\\nSummary: CLI for the Red Hat OpenShift Cluster Manager\\nLicense: ASL 2.0\\nURL: https://github.com/openshift-online/ocm-cli\\nSource: https://github.com/openshift-online/ocm-cli/archive/v@version@.tar.gz\\n\\n# We need to download Go explicitly because in most of the platforms that we\\n# use the version available is too old.\\n%define go_tar https://go.dev/dl/go1.23.12.linux-amd64.tar.gz\\n%define go_sum d3847fef834e9db11bf64e3fb34db9c04db14e068eeb064f49af747010454f90\\n\\nBuildRequires: curl\\nBuildRequires: git\\nBuildRequires: make\\n\\n%description\\nCLI for the Red Hat OpenShift Cluster Manager\\n\\n%prep\\n%setup\\n\\n%build\\n\\n# Create the Go directories:\\nexport GOROOT=\\\"${PWD}/.goroot\\\"\\nexport GOPATH=\\\"${PWD}/.gopath\\\"\\nmkdir \\\"${GOROOT}\\\" \\\"${GOPATH}\\\"\\nPATH=\\\"${GOROOT}/bin:${PATH}\\\"\\n\\n# Download and install Go:\\ncurl --location --output go.tar.gz %{go_tar}\\necho %{go_sum} go.tar.gz | sha256sum --check\\ntar --directory \\\"${GOROOT}\\\" --extract --strip-components 1 --file go.tar.gz\\n\\n# Build the binary:\\nmake\\n\\n%install\\ninstall -m 0755 -d %{buildroot}%{_bindir}\\ninstall -m 0755 ocm %{buildroot}%{_bindir}\\n\\n%clean\\n# This is necessary because Go writes its cache files and directories without\\n# write permission, and that means that a rgular `rm` can't remove them.\\nfind .gopath -exec chmod +w {} \\\\;\\nrm -rf .gopath\\n\\n%files\\n%license LICENSE.txt\\n%doc README.md\\n%doc CHANGES.md\\n%{_bindir}/*\\n\\n%changelog\\n* @date@ OCM - @version@\\n- Automatic build for version @version@.\\n.\\nsed \\\\\\n -e \\\"s/@version@/${version}/g\\\" \\\\\\n -e \\\"s/@date@/${date}/g\\\" \\\\\\n < ocm-cli.spec.in \\\\\\n > ocm-cli.spec\\n\", \"chroot\": \"fedora-44-x86_64\", \"builddeps\": \"jq\", \"resultdir\": \"\", \"repos\": \"\", \"tmp\": \"tmpn2p39lmu\", \"hook_data\": true}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "ocm/tools--adffa2c7-c0b6-4af4-871f-1c210b6d8e9a", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "destdir": "/var/lib/copr/public_html/results/ocm/tools", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ocm/tools", "result_dir": "10274177", "built_packages": "", "tags": [ "arch_x86_64" ], "id": 10274177, "mockchain_macros": { "copr_username": "ocm", "copr_projectname": "tools", "vendor": "Fedora Project COPR (ocm/tools)" } } ] } [2026-03-30 13:38:18,317][ INFO][PID:98391] Sending fedora-messaging bus message in build.start [2026-03-30 13:38:18,907][ INFO][PID:98391] Sending fedora-messaging bus message in chroot.start [2026-03-30 13:38:18,937][ INFO][PID:98391] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/10274177 --detached [2026-03-30 13:38:19,277][ INFO][PID:98391] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '18.215.174.37' (ED25519) to the list of known hosts. [2026-03-30 13:38:19,277][ INFO][PID:98391] Downloading the builder-live.log file, attempt 1 [2026-03-30 13:38:19,279][ INFO][PID:98391] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.215.174.37 copr-rpmbuild-log [2026-03-30 13:38:24,285][ INFO][PID:98391] Periodic builder liveness probe: alive [2026-03-30 13:38:24,286][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:29,286][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:34,287][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:39,291][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:44,298][ INFO][PID:98391] Checking for cancel request [2026-03-30 13:38:48,548][ INFO][PID:98391] Downloading results from builder [2026-03-30 13:38:48,548][ INFO][PID:98391] rsyncing of mockbuilder@18.215.174.37:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177 started [2026-03-30 13:38:48,549][ INFO][PID:98391] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@18.215.174.37:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/ &> /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/build-10274177.rsync.log [2026-03-30 13:38:48,776][ INFO][PID:98391] rsyncing finished. [2026-03-30 13:38:48,777][ INFO][PID:98391] Releasing VM back to pool [2026-03-30 13:38:48,787][ INFO][PID:98391] Searching for 'success' file in resultdir [2026-03-30 13:38:48,788][ ERROR][PID:98391] Build failed: Backend process error: No success file => build failure [2026-03-30 13:38:48,788][ INFO][PID:98391] Finished build: id=10274177 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/ocm/tools chroot=srpm-builds [2026-03-30 13:38:48,790][ ERROR][PID:98391] Backend process error: No success file => build failure [2026-03-30 13:38:48,790][ INFO][PID:98391] Worker failed build, took 30.510228872299194 [2026-03-30 13:38:48,791][ INFO][PID:98391] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "ocm", "project_name": "tools", "project_dirname": "tools", "submitter": null, "ended_on": 1774877928.7905824, "started_on": 1774877898.2803535, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "10274177", "build_id": 10274177, "package_name": "ocm-cli", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"# Check that the event payload exists:\\nif [[ ! -f hook_payload ]]; then\\n echo \\\"Event payload file 'hook_payload' doesn't exist\\\"\\n exit 1\\nfi\\n\\n# Check that the event is the creation of a tag:\\nref_type=$(cat hook_payload | jq -r .ref_type)\\nif [[ \\\"${ref_type}\\\" != \\\"tag\\\" ]]; then\\n echo \\\"Expected reference type 'tag' but got '${ref_type}'\\\"\\n exit 1\\nfi\\n\\n# Check that the tag is well formed:\\nref=$(cat hook_payload | jq -r .ref)\\nif [[ ! \\\"${ref}\\\" =~ ^v[0-9]+\\\\.[0-9]+\\\\.[0-9]+$ ]]; then\\n echo \\\"Reference '${ref}' isn't well formed\\\"\\n exit 1\\nfi\\n\\n# Set the version to use:\\nversion=\\\"${ref:1}\\\"\\n\\n# Set the date:\\ndate=$(date +'%a %b %d %Y')\\n\\n# Generate the .spec file:\\ncat > ocm-cli.spec.in <<\\\".\\\"\\n%global debug_package %{nil}\\n\\nName: ocm-cli\\nVersion: @version@\\nRelease: 1%{?dist}\\nSummary: CLI for the Red Hat OpenShift Cluster Manager\\nLicense: ASL 2.0\\nURL: https://github.com/openshift-online/ocm-cli\\nSource: https://github.com/openshift-online/ocm-cli/archive/v@version@.tar.gz\\n\\n# We need to download Go explicitly because in most of the platforms that we\\n# use the version available is too old.\\n%define go_tar https://go.dev/dl/go1.23.12.linux-amd64.tar.gz\\n%define go_sum d3847fef834e9db11bf64e3fb34db9c04db14e068eeb064f49af747010454f90\\n\\nBuildRequires: curl\\nBuildRequires: git\\nBuildRequires: make\\n\\n%description\\nCLI for the Red Hat OpenShift Cluster Manager\\n\\n%prep\\n%setup\\n\\n%build\\n\\n# Create the Go directories:\\nexport GOROOT=\\\"${PWD}/.goroot\\\"\\nexport GOPATH=\\\"${PWD}/.gopath\\\"\\nmkdir \\\"${GOROOT}\\\" \\\"${GOPATH}\\\"\\nPATH=\\\"${GOROOT}/bin:${PATH}\\\"\\n\\n# Download and install Go:\\ncurl --location --output go.tar.gz %{go_tar}\\necho %{go_sum} go.tar.gz | sha256sum --check\\ntar --directory \\\"${GOROOT}\\\" --extract --strip-components 1 --file go.tar.gz\\n\\n# Build the binary:\\nmake\\n\\n%install\\ninstall -m 0755 -d %{buildroot}%{_bindir}\\ninstall -m 0755 ocm %{buildroot}%{_bindir}\\n\\n%clean\\n# This is necessary because Go writes its cache files and directories without\\n# write permission, and that means that a rgular `rm` can't remove them.\\nfind .gopath -exec chmod +w {} \\\\;\\nrm -rf .gopath\\n\\n%files\\n%license LICENSE.txt\\n%doc README.md\\n%doc CHANGES.md\\n%{_bindir}/*\\n\\n%changelog\\n* @date@ OCM - @version@\\n- Automatic build for version @version@.\\n.\\nsed \\\\\\n -e \\\"s/@version@/${version}/g\\\" \\\\\\n -e \\\"s/@date@/${date}/g\\\" \\\\\\n < ocm-cli.spec.in \\\\\\n > ocm-cli.spec\\n\", \"chroot\": \"fedora-44-x86_64\", \"builddeps\": \"jq\", \"resultdir\": \"\", \"repos\": \"\", \"tmp\": \"tmpn2p39lmu\", \"hook_data\": true}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "ocm/tools--adffa2c7-c0b6-4af4-871f-1c210b6d8e9a", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": true, "destdir": "/var/lib/copr/public_html/results/ocm/tools", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ocm/tools", "result_dir": "10274177", "built_packages": "", "tags": [ "arch_x86_64" ], "id": 10274177, "mockchain_macros": { "copr_username": "ocm", "copr_projectname": "tools", "vendor": "Fedora Project COPR (ocm/tools)" } } ] } [2026-03-30 13:38:48,834][ INFO][PID:98391] Sending fedora-messaging bus message in build.end [2026-03-30 13:38:48,862][ INFO][PID:98391] Compressing /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/builder-live.log by gzip [2026-03-30 13:38:48,863][ INFO][PID:98391] Running command 'gzip /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/builder-live.log' as PID 145019 [2026-03-30 13:38:48,918][ INFO][PID:98391] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/builder-live.log) [2026-03-30 13:38:48,919][ INFO][PID:98391] Compressing /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/backend.log by gzip [2026-03-30 13:38:48,920][ INFO][PID:98391] Running command 'gzip /var/lib/copr/public_html/results/ocm/tools/srpm-builds/10274177/backend.log' as PID 145020