[2026-04-22 02:14:32,602][ INFO][PID:4115384] Marking build as starting [2026-04-22 02:14:32,829][ INFO][PID:4115384] Checking that /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-04-22 02:14:32,837][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:14:32,845][ INFO][PID:4115384] VM allocation process starts [2026-04-22 02:14:32,873][ INFO][PID:4115384] Trying to allocate VM: ResallocHost, ticket_id=2450626, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-22 02:14:37,881][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:14:42,886][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:14:47,889][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:14:52,891][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:14:57,904][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:01,024][ INFO][PID:4115384] Allocated host ResallocHost, ticket_id=2450626, hostname=13.222.33.178, name=aws_x86_64_normal_prod_07704016_20260422_021226, requested_tags=['arch_x86_64', 'copr_builder'] [2026-04-22 02:15:01,025][ INFO][PID:4115384] Allocating ssh connection to builder [2026-04-22 02:15:01,027][ INFO][PID:4115384] Checking that builder machine is OK [2026-04-22 02:15:01,441][ INFO][PID:4115384] Installed copr-rpmbuild version: 1.8 [2026-04-22 02:15:01,442][ INFO][PID:4115384] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-04-22 02:15:01,705][ INFO][PID:4115384] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-04-22 02:15:01,708][ INFO][PID:4115384] Filling build.info file with builder info [2026-04-22 02:15:01,710][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:01,713][ INFO][PID:4115384] Sending build state back to frontend: { "builds": [ { "timeout": 172800, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rezso", "project_name": "ML", "project_dirname": "ML", "submitter": "rezso", "ended_on": null, "started_on": 1776824101.7124858, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10353984-fedora-rawhide-x86_64", "build_id": 10353984, "package_name": "pytorch", "package_version": "2.13.0-20260422.0.git6a6780b2.cu13_2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/pytorch", "git_hash": "f6d335d13c9cab1abdb18f8874428bafcce0e29d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rezso/ML--rezso", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/fedora-rawhide-x86_64/", "id": "copr_rezso_CUDA", "name": "Additional repo copr_rezso_CUDA" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel10/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel10_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel10_x86_64" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel10/sbsa", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel10_sbsa", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel10_sbsa" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rezso/ML", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML", "result_dir": "10353984-pytorch", "built_packages": "", "id": 10353984, "mockchain_macros": { "copr_username": "rezso", "copr_projectname": "ML", "vendor": "Fedora Project COPR (rezso/ML)" } } ] } [2026-04-22 02:15:01,787][ INFO][PID:4115384] Sending fedora-messaging bus message in build.start [2026-04-22 02:15:02,411][ INFO][PID:4115384] Sending fedora-messaging bus message in chroot.start [2026-04-22 02:15:02,444][ INFO][PID:4115384] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10353984-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-04-22 02:15:02,980][ INFO][PID:4115384] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.222.33.178' (ED25519) to the list of known hosts. [2026-04-22 02:15:02,982][ INFO][PID:4115384] Downloading the builder-live.log file, attempt 1 [2026-04-22 02:15:02,985][ INFO][PID:4115384] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.222.33.178 copr-rpmbuild-log [2026-04-22 02:15:08,019][ INFO][PID:4115384] Periodic builder liveness probe: alive [2026-04-22 02:15:08,021][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:13,034][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:18,040][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:23,043][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:28,055][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:33,069][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:38,071][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:43,077][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:48,086][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:53,099][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:15:58,102][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:03,105][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:08,122][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:13,153][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:18,190][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:23,217][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:28,233][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:33,252][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:38,255][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:43,271][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:48,278][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:53,285][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:16:58,300][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:03,304][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:08,308][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:13,315][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:18,325][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:23,330][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:28,345][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:33,347][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:38,349][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:43,353][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:48,356][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:53,359][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:17:58,362][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:03,370][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:08,372][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:13,378][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:18,386][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:23,390][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:28,392][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:33,400][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:38,403][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:43,406][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:48,408][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:53,410][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:18:58,418][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:03,420][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:08,422][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:13,425][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:18,428][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:23,429][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:28,432][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:33,435][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:38,436][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:43,438][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:48,439][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:53,443][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:19:58,444][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:03,446][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:08,447][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:13,449][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:18,450][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:23,452][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:28,453][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:33,454][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:38,456][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:43,457][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:48,459][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:53,464][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:20:58,465][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:21:03,467][ INFO][PID:4115384] Checking for cancel request [2026-04-22 02:21:06,974][ INFO][PID:4115384] Downloading results from builder [2026-04-22 02:21:06,975][ INFO][PID:4115384] rsyncing of mockbuilder@13.222.33.178:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch started [2026-04-22 02:21:06,976][ INFO][PID:4115384] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.222.33.178:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/ &> /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/build-10353984.rsync.log [2026-04-22 02:21:07,336][ INFO][PID:4115384] rsyncing finished. [2026-04-22 02:21:07,337][ INFO][PID:4115384] VM Release request [2026-04-22 02:21:07,350][ INFO][PID:4115384] Searching for 'success' file in resultdir [2026-04-22 02:21:07,351][ ERROR][PID:4115384] Build failed: Backend process error: No success file => build failure [2026-04-22 02:21:07,367][ INFO][PID:4115384] Finished build: id=10353984 failed=True timeout=172800 destdir=/var/lib/copr/public_html/results/rezso/ML chroot=fedora-rawhide-x86_64 [2026-04-22 02:21:07,372][ ERROR][PID:4115384] Backend process error: No success file => build failure [2026-04-22 02:21:07,389][ INFO][PID:4115384] Worker failed build, took 365.6771750450134 [2026-04-22 02:21:07,390][ INFO][PID:4115384] Sending build state back to frontend: { "builds": [ { "timeout": 172800, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rezso", "project_name": "ML", "project_dirname": "ML", "submitter": "rezso", "ended_on": 1776824467.3896608, "started_on": 1776824101.7124858, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10353984-fedora-rawhide-x86_64", "build_id": 10353984, "package_name": "pytorch", "package_version": "2.13.0-20260422.0.git6a6780b2.cu13_2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/pytorch", "git_hash": "f6d335d13c9cab1abdb18f8874428bafcce0e29d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rezso/ML--rezso", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/fedora-rawhide-x86_64/", "id": "copr_rezso_CUDA", "name": "Additional repo copr_rezso_CUDA" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel10/x86_64", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel10_x86_64", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel10_x86_64" }, { "baseurl": "https://developer.download.nvidia.com/compute/cuda/repos/rhel10/sbsa", "id": "https_developer_download_nvidia_com_compute_cuda_repos_rhel10_sbsa", "name": "Additional repo https_developer_download_nvidia_com_compute_cuda_repos_rhel10_sbsa" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rezso/ML", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML", "result_dir": "10353984-pytorch", "built_packages": "", "id": 10353984, "mockchain_macros": { "copr_username": "rezso", "copr_projectname": "ML", "vendor": "Fedora Project COPR (rezso/ML)" } } ] } [2026-04-22 02:21:07,451][ INFO][PID:4115384] Sending fedora-messaging bus message in build.end [2026-04-22 02:21:07,480][ INFO][PID:4115384] Compressing /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/builder-live.log by gzip [2026-04-22 02:21:07,483][ INFO][PID:4115384] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/builder-live.log' as PID 4192831 [2026-04-22 02:21:07,528][ INFO][PID:4115384] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/builder-live.log) [2026-04-22 02:21:07,529][ INFO][PID:4115384] Compressing /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/backend.log by gzip [2026-04-22 02:21:07,530][ INFO][PID:4115384] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/10353984-pytorch/backend.log' as PID 4192836