[2025-03-19 00:02:31,594][  INFO][PID:1241149] Marking build as starting
[2025-03-19 00:02:31,774][  INFO][PID:1241149] Trying to allocate VM
[2025-03-19 00:02:37,868][  INFO][PID:1241149] Allocated host ResallocHost, ticket_id=1901953, hostname=2620:52:3:1:dead:beef:cafe:c196, name=copr_hv_x86_64_03_prod_02083424_20250318_234520
[2025-03-19 00:02:37,868][  INFO][PID:1241149] Allocating ssh connection to builder
[2025-03-19 00:02:37,869][  INFO][PID:1241149] Checking that builder machine is OK
[2025-03-19 00:02:38,437][  INFO][PID:1241149] Running remote command: copr-builder-ready epel-9-x86_64
[2025-03-19 00:02:38,819][  INFO][PID:1241149] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-03-19 00:02:38,820][  INFO][PID:1241149] Filling build.info file with builder info
[2025-03-19 00:02:38,821][  INFO][PID:1241149] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 172800,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rezso",
            "project_name": "ML",
            "project_dirname": "ML",
            "submitter": "rezso",
            "ended_on": null,
            "started_on": 1742342558.8214395,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "8790628-epel-9-x86_64",
            "build_id": 8790628,
            "package_name": "pytorch",
            "package_version": "2.8.0-20250319.0.git61a64c20.cu12_8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/pytorch",
            "git_hash": "a566e50dc678c5de6984d95d77961902d1f8d50d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rezso/ML--rezso",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/epel-9-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/epel-9-x86_64/",
                    "id": "copr_rezso_CUDA",
                    "name": "Additional repo copr_rezso_CUDA"
                },
                {
                    "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64",
                    "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64",
                    "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64"
                },
                {
                    "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/sbsa",
                    "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa",
                    "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa"
                }
            ],
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rezso/ML",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML",
            "result_dir": "08790628-pytorch",
            "built_packages": "",
            "id": 8790628,
            "mockchain_macros": {
                "copr_username": "rezso",
                "copr_projectname": "ML",
                "vendor": "Fedora Project COPR (rezso/ML)"
            }
        }
    ]
}
[2025-03-19 00:02:38,855][  INFO][PID:1241149] Sending fedora-messaging bus message in build.start
[2025-03-19 00:02:39,566][  INFO][PID:1241149] Sending fedora-messaging bus message in chroot.start
[2025-03-19 00:02:39,590][  INFO][PID:1241149] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8790628-epel-9-x86_64 --chroot epel-9-x86_64 --detached
[2025-03-19 00:02:40,531][  INFO][PID:1241149] Downloading the builder-live.log file, attempt 1
[2025-03-19 00:02:40,533][  INFO][PID:1241149] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c196 copr-rpmbuild-log
[2025-03-19 00:02:45,537][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 00:12:45,691][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 00:22:45,835][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 00:32:45,950][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 00:42:46,056][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 00:52:46,142][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 01:02:46,269][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 01:12:46,426][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 01:22:46,612][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 01:32:46,741][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 01:42:46,833][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 01:52:47,012][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 02:02:47,198][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 02:12:47,438][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 02:22:47,619][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 02:32:47,704][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 02:42:47,787][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 02:52:47,866][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 03:02:47,955][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 03:12:48,061][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 03:22:48,161][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 03:32:48,316][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 03:42:48,418][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 03:52:48,512][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 04:02:48,599][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 04:12:48,967][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 04:22:49,554][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 04:32:49,750][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 04:42:49,871][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 04:52:49,965][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 05:02:50,057][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 05:12:50,151][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 05:22:50,229][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 05:32:50,316][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 05:42:50,399][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 05:52:50,486][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 06:02:50,560][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 06:12:50,657][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 06:22:50,737][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 06:32:50,823][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 06:42:50,896][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 06:52:50,972][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 07:02:51,097][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 07:12:51,247][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 07:22:51,332][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 07:32:51,417][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 07:42:51,490][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 07:52:51,559][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 08:02:51,656][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 08:12:51,756][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 08:22:51,872][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 08:32:51,948][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 08:42:52,048][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 08:52:52,173][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 09:02:52,252][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 09:12:52,335][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 09:22:52,447][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 09:32:52,606][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 09:42:52,721][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 09:52:52,811][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 10:02:52,929][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 10:12:53,101][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 10:22:53,230][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 10:32:53,334][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 10:42:53,427][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 10:52:53,504][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:02:53,603][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:12:53,740][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:22:53,878][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:32:53,976][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:42:54,167][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:52:54,320][  INFO][PID:1241149] Periodic builder liveness probe: alive
[2025-03-19 11:54:19,748][  INFO][PID:1241149] Downloading results from builder
[2025-03-19 11:54:19,771][  INFO][PID:1241149] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch started
[2025-03-19 11:54:19,796][  INFO][PID:1241149] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/ &> /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/build-08790628.rsync.log
[2025-03-19 11:55:04,593][  INFO][PID:1241149] rsyncing finished.
[2025-03-19 11:55:04,601][  INFO][PID:1241149] Releasing VM back to pool
[2025-03-19 11:55:04,640][  INFO][PID:1241149] Searching for 'success' file in resultdir
[2025-03-19 11:55:04,660][  INFO][PID:1241149] Going to sign pkgs from source: 8790628-epel-9-x86_64 in chroot: /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64
[2025-03-19 11:55:04,701][  INFO][PID:1241149] Calling '/bin/sign -u rezso#ML@copr.fedorahosted.org -p' (attempt #1)
[2025-03-19 11:55:05,066][  INFO][PID:1241149] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-devel-2.8.0-20250319.0.git61a64c20.cu12_8.el9.x86_64.rpm' (attempt #1)
[2025-03-19 11:55:06,063][  INFO][PID:1241149] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-devel-2.8.0-20250319.0.git61a64c20.cu12_8.el9.x86_64.rpm
[2025-03-19 11:55:06,066][  INFO][PID:1241149] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-2.8.0-20250319.0.git61a64c20.cu12_8.el9.src.rpm' (attempt #1)
[2025-03-19 11:55:06,779][  INFO][PID:1241149] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-2.8.0-20250319.0.git61a64c20.cu12_8.el9.src.rpm
[2025-03-19 11:55:06,781][  INFO][PID:1241149] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-python3-2.8.0-20250319.0.git61a64c20.cu12_8.el9.x86_64.rpm' (attempt #1)
[2025-03-19 11:55:09,373][  INFO][PID:1241149] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-python3-2.8.0-20250319.0.git61a64c20.cu12_8.el9.x86_64.rpm
[2025-03-19 11:55:09,374][  INFO][PID:1241149] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-2.8.0-20250319.0.git61a64c20.cu12_8.el9.x86_64.rpm' (attempt #1)
[2025-03-19 11:56:29,041][  INFO][PID:1241149] signed rpm: /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/pytorch-2.8.0-20250319.0.git61a64c20.cu12_8.el9.x86_64.rpm
[2025-03-19 11:56:29,047][  INFO][PID:1241149] Sign done
[2025-03-19 11:56:29,058][  INFO][PID:1241149] Incremental createrepo run, adding 08790628-pytorch into https://download.copr.fedorainfracloud.org/results/rezso/ML/epel-9-x86_64, (auto-create-repo=True)
[2025-03-19 11:56:29,123][  INFO][PID:1241149] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64 --add 08790628-pytorch --no-appstream-metadata' as PID 1919842
[2025-03-19 11:56:35,395][  INFO][PID:1241149] Finished after 6 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64 --add 08790628-pytorch --no-appstream-metadata)
[2025-03-19 11:56:35,435][  INFO][PID:1241149] Getting build details
[2025-03-19 11:56:35,436][  INFO][PID:1241149] Listing built binary packages in /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch
[2025-03-19 11:56:35,437][  INFO][PID:1241149] Built packages:
['pytorch-python3 2.8.0', 'pytorch-devel 2.8.0', 'pytorch 2.8.0']
[2025-03-19 11:56:35,572][  INFO][PID:1241149] build details: {'built_packages': 'pytorch-python3 2.8.0\npytorch-devel 2.8.0\npytorch 2.8.0'}
[2025-03-19 11:56:35,576][  INFO][PID:1241149] Retrieving pubkey
[2025-03-19 11:56:35,577][  INFO][PID:1241149] Calling '/bin/sign -u rezso#ML@copr.fedorahosted.org -p' (attempt #1)
[2025-03-19 11:56:35,761][  INFO][PID:1241149] Added pubkey for user rezso project ML into: /var/lib/copr/public_html/results/rezso/ML/pubkey.gpg
[2025-03-19 11:56:35,768][  INFO][PID:1241149] Finished build: id=8790628 failed=False timeout=172800 destdir=/var/lib/copr/public_html/results/rezso/ML chroot=epel-9-x86_64 
[2025-03-19 11:56:35,876][  INFO][PID:1241149] Worker succeeded build, took 42837.05323123932
[2025-03-19 11:56:35,886][  INFO][PID:1241149] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 172800,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rezso",
            "project_name": "ML",
            "project_dirname": "ML",
            "submitter": "rezso",
            "ended_on": 1742385395.8746707,
            "started_on": 1742342558.8214395,
            "submitted_on": null,
            "status": 1,
            "chroot": "epel-9-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "8790628-epel-9-x86_64",
            "build_id": 8790628,
            "package_name": "pytorch",
            "package_version": "2.8.0-20250319.0.git61a64c20.cu12_8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/pytorch",
            "git_hash": "a566e50dc678c5de6984d95d77961902d1f8d50d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rezso/ML--rezso",
            "results": {
                "packages": [
                    {
                        "name": "pytorch-python3",
                        "epoch": null,
                        "version": "2.8.0",
                        "release": "20250319.0.git61a64c20.cu12_8.el9",
                        "arch": "x86_64"
                    },
                    {
                        "name": "pytorch-devel",
                        "epoch": null,
                        "version": "2.8.0",
                        "release": "20250319.0.git61a64c20.cu12_8.el9",
                        "arch": "x86_64"
                    },
                    {
                        "name": "pytorch",
                        "epoch": null,
                        "version": "2.8.0",
                        "release": "20250319.0.git61a64c20.cu12_8.el9",
                        "arch": "src"
                    },
                    {
                        "name": "pytorch",
                        "epoch": null,
                        "version": "2.8.0",
                        "release": "20250319.0.git61a64c20.cu12_8.el9",
                        "arch": "x86_64"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/epel-9-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/epel-9-x86_64/",
                    "id": "copr_rezso_CUDA",
                    "name": "Additional repo copr_rezso_CUDA"
                },
                {
                    "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64",
                    "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64",
                    "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64"
                },
                {
                    "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/sbsa",
                    "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa",
                    "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa"
                }
            ],
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rezso/ML",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML",
            "result_dir": "08790628-pytorch",
            "built_packages": "pytorch-python3 2.8.0\npytorch-devel 2.8.0\npytorch 2.8.0",
            "id": 8790628,
            "mockchain_macros": {
                "copr_username": "rezso",
                "copr_projectname": "ML",
                "vendor": "Fedora Project COPR (rezso/ML)"
            }
        }
    ]
}
[2025-03-19 11:56:36,589][  INFO][PID:1241149] Sending fedora-messaging bus message in build.end
[2025-03-19 11:56:36,963][  INFO][PID:1241149] Compressing /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/builder-live.log by gzip
[2025-03-19 11:56:36,965][  INFO][PID:1241149] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/builder-live.log' as PID 1920435
[2025-03-19 11:56:37,047][  INFO][PID:1241149] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/builder-live.log)
[2025-03-19 11:56:37,048][  INFO][PID:1241149] Compressing /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/backend.log by gzip
[2025-03-19 11:56:37,050][  INFO][PID:1241149] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/epel-9-x86_64/08790628-pytorch/backend.log' as PID 1920440