[2025-07-26 02:51:45,270][  INFO][PID:3132201] Marking build as starting
[2025-07-26 02:51:45,342][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:51:45,345][  INFO][PID:3132201] VM allocation process starts
[2025-07-26 02:51:45,398][  INFO][PID:3132201] Trying to allocate VM: ResallocHost, ticket_id=4170281, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 02:51:50,404][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:51:55,406][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:00,407][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:05,409][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:10,412][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:15,415][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:20,418][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:25,419][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:30,421][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:35,427][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:40,432][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:45,433][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:50,434][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:52:55,436][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:00,437][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:05,438][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:10,439][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:15,440][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:20,441][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:25,442][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:30,443][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:35,444][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:40,445][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:45,446][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:50,448][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:53:55,449][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:00,451][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:05,452][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:10,454][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:15,455][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:20,456][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:25,457][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:30,458][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:35,460][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:40,461][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:45,462][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:50,463][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:54:55,464][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:00,466][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:05,468][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:10,469][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:15,470][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:20,471][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:25,472][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:30,473][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:35,474][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:40,475][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:45,476][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:50,477][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:55:55,478][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:00,480][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:03,547][  INFO][PID:3132201] Allocated host ResallocHost, ticket_id=4170281, hostname=140.211.168.80, name=copr_osuosl_p09_prod_05889571_20250726_025202, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 02:56:03,547][  INFO][PID:3132201] Allocating ssh connection to builder
[2025-07-26 02:56:03,548][  INFO][PID:3132201] Checking that builder machine is OK
[2025-07-26 02:56:04,968][  INFO][PID:3132201] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-07-26 02:56:05,967][  INFO][PID:3132201] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-07-26 02:56:05,967][  INFO][PID:3132201] Filling build.info file with builder info
[2025-07-26 02:56:05,968][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:05,969][  INFO][PID:3132201] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1753498565.96917,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339913-fedora-41-ppc64le",
            "build_id": 9339913,
            "package_name": "libdnf",
            "package_version": "0.75.0-0.20250726011821.0.74.0+27.g96de9331",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libdnf",
            "git_hash": "e8995ad7cb8a7b591269cde51b2cb7bf0a2c6564",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339913-libdnf",
            "built_packages": "",
            "id": 9339913,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 02:56:06,172][  INFO][PID:3132201] Sending fedora-messaging bus message in build.start
[2025-07-26 02:56:06,978][  INFO][PID:3132201] Sending fedora-messaging bus message in chroot.start
[2025-07-26 02:56:07,007][  INFO][PID:3132201] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339913-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-07-26 02:56:08,317][  INFO][PID:3132201] Downloading the builder-live.log file, attempt 1
[2025-07-26 02:56:08,318][  INFO][PID:3132201] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-07-26 02:56:13,326][  INFO][PID:3132201] Periodic builder liveness probe: alive
[2025-07-26 02:56:13,327][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:18,327][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:23,329][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:28,330][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:33,331][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:38,333][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:43,334][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:48,335][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:53,336][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:56:58,338][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:03,339][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:08,340][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:13,341][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:18,343][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:23,348][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:28,349][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:33,350][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:38,351][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:43,352][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:48,354][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:53,355][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:57:58,356][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:03,357][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:08,358][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:13,360][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:18,361][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:23,362][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:28,363][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:33,364][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:38,366][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:43,367][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:48,368][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:53,369][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:58:58,370][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:03,371][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:08,372][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:13,374][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:18,382][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:23,385][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:28,386][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:33,387][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:38,388][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:43,389][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:48,390][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:53,391][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 02:59:58,392][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:03,393][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:08,394][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:13,395][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:18,397][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:23,398][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:28,399][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:33,401][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:38,402][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:43,403][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:48,405][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:53,406][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:00:58,407][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:03,408][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:08,409][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:13,410][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:18,411][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:23,412][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:28,413][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:33,414][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:38,416][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:43,417][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:48,418][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:53,419][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:01:58,420][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:03,421][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:08,423][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:13,424][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:18,426][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:23,428][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:28,429][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:33,431][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:38,432][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:43,433][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:48,434][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:53,436][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:02:58,437][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:03,439][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:08,440][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:13,442][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:18,443][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:23,444][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:28,446][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:33,447][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:38,450][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:43,451][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:48,453][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:53,455][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:03:58,456][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:03,457][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:08,459][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:13,460][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:18,461][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:23,462][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:28,464][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:33,467][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:38,468][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:43,469][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:48,470][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:53,472][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:04:58,473][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:03,474][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:08,476][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:13,477][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:18,478][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:23,479][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:28,480][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:33,481][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:38,482][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:43,484][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:48,485][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:53,486][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:05:58,487][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:03,492][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:08,493][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:13,509][  INFO][PID:3132201] Periodic builder liveness probe: alive
[2025-07-26 03:06:13,511][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:18,512][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:23,514][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:28,516][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:33,518][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:38,520][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:43,521][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:48,522][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:53,524][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:06:58,525][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:03,526][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:08,528][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:13,139][ ERROR][PID:3132201] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:07:13,529][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:18,531][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:23,140][WARNING][PID:3132201] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:07:23,536][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:28,538][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:33,140][  INFO][PID:3132201] Downloading the builder-live.log file, attempt 2
[2025-07-26 03:07:33,142][  INFO][PID:3132201] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-07-26 03:07:33,540][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:38,542][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:43,543][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:48,544][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:53,546][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:07:58,547][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:03,551][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:08,553][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:13,554][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:18,555][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:23,556][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:28,558][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:33,279][ ERROR][PID:3132201] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:08:33,559][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:38,560][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:43,280][WARNING][PID:3132201] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:08:43,562][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:48,565][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:53,281][  INFO][PID:3132201] Downloading the builder-live.log file, attempt 3
[2025-07-26 03:08:53,282][  INFO][PID:3132201] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-07-26 03:08:53,566][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:08:58,567][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:03,568][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:08,570][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:13,573][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:18,576][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:23,578][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:28,579][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:33,580][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:38,581][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:43,582][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:48,583][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:53,420][ ERROR][PID:3132201] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:09:53,584][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:09:58,585][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:03,423][WARNING][PID:3132201] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-26 03:10:03,587][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:08,588][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:13,424][  INFO][PID:3132201] Downloading the builder-live.log file, attempt 4
[2025-07-26 03:10:13,426][  INFO][PID:3132201] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.80 copr-rpmbuild-log
[2025-07-26 03:10:13,589][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:18,590][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:23,593][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:28,594][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:33,595][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:38,596][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:43,597][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:48,598][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:53,600][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:10:58,602][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:03,603][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:08,604][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:13,564][ ERROR][PID:3132201] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-26 03:11:13,605][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:18,606][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:23,568][ ERROR][PID:3132201] Giving up for unstable SSH, failures: 1753499243.1401024, 1753499323.2805326, 1753499403.4237616, 1753499483.568619
[2025-07-26 03:11:23,569][ ERROR][PID:3132201] Re-try request for task on 'ResallocHost, ticket_id=4170281, hostname=140.211.168.80, name=copr_osuosl_p09_prod_05889571_20250726_025202, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-26 03:11:23,570][  INFO][PID:3132201] Releasing VM back to pool
[2025-07-26 03:11:23,580][  INFO][PID:3132201] Retry #1 (on other host)
[2025-07-26 03:11:23,581][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:23,581][  INFO][PID:3132201] VM allocation process starts
[2025-07-26 03:11:23,594][  INFO][PID:3132201] Trying to allocate VM: ResallocHost, ticket_id=4170582, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:11:28,596][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:33,597][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:38,598][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:43,599][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:48,600][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:53,602][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:11:58,603][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:03,604][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:08,606][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:13,607][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:18,610][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:23,612][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:28,613][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:33,615][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:38,616][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:43,617][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:48,619][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:53,620][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:12:58,621][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:03,623][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:08,624][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:13,629][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:18,630][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:23,632][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:28,634][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:33,635][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:38,636][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:43,640][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:48,641][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:53,642][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:13:58,643][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:03,644][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:08,646][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:13,647][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:18,648][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:23,649][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:28,650][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:33,652][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:38,653][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:43,655][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:48,656][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:53,657][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:14:58,658][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:03,659][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:08,661][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:13,662][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:18,663][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:23,664][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:28,667][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:33,668][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:38,669][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:43,670][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:48,674][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:53,675][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:15:58,676][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:03,678][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:08,679][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:13,680][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:18,681][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:23,682][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:28,683][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:33,684][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:38,685][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:41,807][  INFO][PID:3132201] Allocated host ResallocHost, ticket_id=4170582, hostname=2620:52:3:1:dead:beef:cafe:c208, name=copr_hv_ppc64le_01_prod_05889735_20250726_031021, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-26 03:16:41,807][  INFO][PID:3132201] Allocating ssh connection to builder
[2025-07-26 03:16:41,808][  INFO][PID:3132201] Checking that builder machine is OK
[2025-07-26 03:16:44,732][  INFO][PID:3132201] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-07-26 03:16:46,657][  INFO][PID:3132201] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-07-26 03:16:46,658][  INFO][PID:3132201] Filling build.info file with builder info
[2025-07-26 03:16:46,659][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:46,660][  INFO][PID:3132201] Not re-notifying FE and msg buses for the new host.
[2025-07-26 03:16:46,661][  INFO][PID:3132201] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9339913-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-07-26 03:16:49,207][  INFO][PID:3132201] Downloading the builder-live.log file, attempt 1
[2025-07-26 03:16:49,209][  INFO][PID:3132201] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c208 copr-rpmbuild-log
[2025-07-26 03:16:54,224][  INFO][PID:3132201] Periodic builder liveness probe: alive
[2025-07-26 03:16:54,224][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:16:59,225][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:04,226][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:09,227][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:14,228][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:19,230][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:24,231][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:29,232][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:34,233][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:39,234][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:44,235][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:49,236][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:54,237][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:17:59,239][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:04,240][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:09,242][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:14,243][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:19,243][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:24,245][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:29,246][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:34,247][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:39,248][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:44,249][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:49,251][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:54,252][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:18:59,253][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:04,254][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:09,255][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:14,256][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:19,257][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:24,259][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:29,260][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:34,265][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:39,267][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:44,268][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:49,270][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:54,271][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:19:59,272][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:04,273][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:09,274][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:14,275][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:19,276][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:24,277][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:29,278][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:34,280][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:39,281][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:44,282][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:49,283][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:54,284][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:20:59,286][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:04,287][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:09,288][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:14,289][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:19,291][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:24,292][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:29,293][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:34,295][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:39,299][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:44,301][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:49,303][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:54,304][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:21:59,307][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:04,308][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:09,309][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:14,311][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:19,312][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:24,314][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:29,315][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:34,316][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:39,317][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:44,318][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:49,319][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:54,321][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:22:59,322][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:04,323][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:09,324][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:14,325][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:19,326][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:24,327][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:29,328][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:34,330][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:39,331][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:44,333][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:49,334][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:54,335][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:23:59,336][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:04,337][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:09,339][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:14,340][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:19,341][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:24,343][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:29,344][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:34,346][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:39,349][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:44,350][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:49,354][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:54,355][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:24:59,357][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:04,358][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:09,361][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:14,363][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:19,366][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:24,368][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:29,371][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:34,372][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:39,373][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:44,375][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:49,376][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:54,377][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:25:59,378][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:04,380][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:09,381][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:14,384][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:19,388][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:24,390][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:29,391][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:34,393][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:39,394][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:44,395][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:49,396][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:54,402][  INFO][PID:3132201] Periodic builder liveness probe: alive
[2025-07-26 03:26:54,402][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:26:59,404][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:04,406][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:09,407][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:14,409][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:19,410][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:24,414][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:29,415][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:34,416][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:39,417][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:44,419][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:49,420][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:54,427][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:27:59,429][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:04,431][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:09,432][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:14,433][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:19,435][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:24,436][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:29,437][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:34,438][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:39,440][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:44,441][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:49,443][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:54,444][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:28:59,445][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:04,446][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:09,447][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:14,449][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:19,458][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:24,459][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:29,460][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:34,462][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:39,463][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:44,464][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:49,465][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:54,466][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:29:59,467][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:04,468][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:09,469][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:14,470][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:19,471][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:24,473][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:29,474][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:34,475][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:39,477][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:44,478][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:49,480][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:54,482][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:30:59,484][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:04,485][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:09,486][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:14,487][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:19,488][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:24,489][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:29,527][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:34,596][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:39,599][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:44,601][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:49,604][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:54,606][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:31:59,610][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:04,611][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:09,612][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:14,613][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:19,614][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:24,615][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:29,616][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:34,618][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:39,619][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:44,620][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:49,622][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:54,623][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:32:59,624][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:04,626][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:09,627][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:14,628][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:19,630][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:24,631][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:29,633][  INFO][PID:3132201] Checking for cancel request
[2025-07-26 03:33:31,299][  INFO][PID:3132201] Downloading results from builder
[2025-07-26 03:33:31,299][  INFO][PID:3132201] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c208]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf started
[2025-07-26 03:33:31,300][  INFO][PID:3132201] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c208]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/build-09339913.rsync.log
[2025-07-26 03:33:36,161][  INFO][PID:3132201] rsyncing finished.
[2025-07-26 03:33:36,163][  INFO][PID:3132201] Releasing VM back to pool
[2025-07-26 03:33:36,177][  INFO][PID:3132201] Searching for 'success' file in resultdir
[2025-07-26 03:33:36,177][  INFO][PID:3132201] Going to sign pkgs from source: 9339913-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le
[2025-07-26 03:33:36,178][  INFO][PID:3132201] Calling '/bin/sign -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -p' (attempt #1)
[2025-07-26 03:33:36,360][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.src.rpm' (attempt #1)
[2025-07-26 03:33:37,102][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.src.rpm
[2025-07-26 03:33:37,108][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-devel-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:37,685][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-devel-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:37,686][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-libdnf-debuginfo-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:38,382][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-libdnf-debuginfo-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:38,382][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-hawkey-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:39,105][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-hawkey-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:39,106][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-debugsource-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:39,840][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-debugsource-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:39,841][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-libdnf-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:40,425][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-libdnf-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:40,426][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-hawkey-debuginfo-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:41,162][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/python3-hawkey-debuginfo-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:41,163][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-debuginfo-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:42,009][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-debuginfo-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:42,011][  INFO][PID:3132201] Calling '/bin/sign -4 -h sha256 -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm' (attempt #1)
[2025-07-26 03:33:42,602][  INFO][PID:3132201] signed rpm: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/libdnf-0.75.0-0.20250726011821.0.74.0+27.g96de9331.fc41.ppc64le.rpm
[2025-07-26 03:33:42,602][  INFO][PID:3132201] Sign done
[2025-07-26 03:33:42,603][  INFO][PID:3132201] Incremental createrepo run, adding 09339913-libdnf into https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le, (auto-create-repo=True)
[2025-07-26 03:33:42,604][  INFO][PID:3132201] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le --add 09339913-libdnf --no-appstream-metadata' as PID 3348302
[2025-07-26 03:33:43,988][  INFO][PID:3132201] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le --add 09339913-libdnf --no-appstream-metadata)
[2025-07-26 03:33:43,989][  INFO][PID:3132201] Getting build details
[2025-07-26 03:33:43,992][  INFO][PID:3132201] Listing built binary packages in /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf
[2025-07-26 03:33:43,993][  INFO][PID:3132201] Built packages:
['libdnf 0.75.0', 'python3-hawkey-debuginfo 0.75.0', 'python3-libdnf-debuginfo 0.75.0', 'libdnf-debuginfo 0.75.0', 'libdnf-debugsource 0.75.0', 'libdnf-devel 0.75.0', 'python3-hawkey 0.75.0', 'python3-libdnf 0.75.0']
[2025-07-26 03:33:43,993][  INFO][PID:3132201] build details: {'built_packages': 'libdnf 0.75.0\npython3-hawkey-debuginfo 0.75.0\npython3-libdnf-debuginfo 0.75.0\nlibdnf-debuginfo 0.75.0\nlibdnf-debugsource 0.75.0\nlibdnf-devel 0.75.0\npython3-hawkey 0.75.0\npython3-libdnf 0.75.0'}
[2025-07-26 03:33:43,994][  INFO][PID:3132201] Retrieving pubkey
[2025-07-26 03:33:43,994][  INFO][PID:3132201] Calling '/bin/sign -u rpmsoftwaremanagement#dnf-nightly@copr.fedorahosted.org -p' (attempt #1)
[2025-07-26 03:33:44,362][  INFO][PID:3132201] Added pubkey for user rpmsoftwaremanagement project dnf-nightly into: /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/pubkey.gpg
[2025-07-26 03:33:44,363][  INFO][PID:3132201] Finished build: id=9339913 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-41-ppc64le 
[2025-07-26 03:33:44,367][  INFO][PID:3132201] Worker succeeded build, took 1017.7065477371216
[2025-07-26 03:33:44,368][  INFO][PID:3132201] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1753500824.367028,
            "started_on": 1753499806.6604803,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9339913-fedora-41-ppc64le",
            "build_id": 9339913,
            "package_name": "libdnf",
            "package_version": "0.75.0-0.20250726011821.0.74.0+27.g96de9331",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libdnf",
            "git_hash": "e8995ad7cb8a7b591269cde51b2cb7bf0a2c6564",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": {
                "packages": [
                    {
                        "name": "libdnf",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "python3-hawkey-debuginfo",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "python3-libdnf-debuginfo",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "libdnf-debuginfo",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "libdnf-debugsource",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "libdnf-devel",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "libdnf",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "src"
                    },
                    {
                        "name": "python3-hawkey",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "python3-libdnf",
                        "epoch": null,
                        "version": "0.75.0",
                        "release": "0.20250726011821.0.74.0+27.g96de9331.fc41",
                        "arch": "ppc64le"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09339913-libdnf",
            "built_packages": "libdnf 0.75.0\npython3-hawkey-debuginfo 0.75.0\npython3-libdnf-debuginfo 0.75.0\nlibdnf-debuginfo 0.75.0\nlibdnf-debugsource 0.75.0\nlibdnf-devel 0.75.0\npython3-hawkey 0.75.0\npython3-libdnf 0.75.0",
            "id": 9339913,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-26 03:33:44,435][  INFO][PID:3132201] Sending fedora-messaging bus message in build.end
[2025-07-26 03:33:44,462][  INFO][PID:3132201] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/builder-live.log by gzip
[2025-07-26 03:33:44,463][  INFO][PID:3132201] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/builder-live.log' as PID 3348446
[2025-07-26 03:33:44,506][  INFO][PID:3132201] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/builder-live.log)
[2025-07-26 03:33:44,508][  INFO][PID:3132201] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/backend.log by gzip
[2025-07-26 03:33:44,511][  INFO][PID:3132201] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-41-ppc64le/09339913-libdnf/backend.log' as PID 3348454