[2026-04-30 16:22:15,374][  INFO][PID:1713915] Marking build as starting
[2026-04-30 16:22:15,640][  INFO][PID:1713915] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/repodata/repomd.xml exists
[2026-04-30 16:22:15,749][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:15,754][  INFO][PID:1713915] VM allocation process starts
[2026-04-30 16:22:15,821][  INFO][PID:1713915] Trying to allocate VM: ResallocHost, ticket_id=2673332, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 16:22:20,829][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:21,871][  INFO][PID:1713915] Allocated host ResallocHost, ticket_id=2673332, hostname=3.82.104.242, name=aws_x86_64_spot_prod_08360636_20260430_161937, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 16:22:21,872][  INFO][PID:1713915] Allocating ssh connection to builder
[2026-04-30 16:22:21,874][  INFO][PID:1713915] Checking that builder machine is OK
[2026-04-30 16:22:22,213][  INFO][PID:1713915] Installed copr-rpmbuild version: 1.8
[2026-04-30 16:22:22,214][  INFO][PID:1713915] Running remote command: copr-builder-ready epel-9-s390x
[2026-04-30 16:22:22,445][  INFO][PID:1713915] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-30 16:22:22,446][  INFO][PID:1713915] Filling build.info file with builder info
[2026-04-30 16:22:22,447][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:22,451][  INFO][PID:1713915] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "keithbowes",
            "project_name": "deponejo",
            "project_dirname": "deponejo",
            "submitter": "keithbowes",
            "ended_on": null,
            "started_on": 1777566142.4517033,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10412474-epel-9-s390x",
            "build_id": 10412474,
            "package_name": "neomutt",
            "package_version": "20260406-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/neomutt",
            "git_hash": "cd6e360f1f91413b1a1ed6efcaca830db80073dd",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "keithbowes/deponejo--keithbowes",
            "results": null,
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/epel-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo",
            "result_dir": "10412474-neomutt",
            "built_packages": "",
            "id": 10412474,
            "mockchain_macros": {
                "copr_username": "keithbowes",
                "copr_projectname": "deponejo",
                "vendor": "Fedora Project COPR (keithbowes/deponejo)"
            }
        }
    ]
}
[2026-04-30 16:22:22,590][  INFO][PID:1713915] Sending fedora-messaging bus message in build.start
[2026-04-30 16:22:23,282][  INFO][PID:1713915] Sending fedora-messaging bus message in chroot.start
[2026-04-30 16:22:23,322][  INFO][PID:1713915] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10412474-epel-9-s390x --chroot epel-9-s390x --detached
[2026-04-30 16:22:23,782][  INFO][PID:1713915] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.82.104.242' (ED25519) to the list of known hosts.


[2026-04-30 16:22:23,783][  INFO][PID:1713915] Downloading the builder-live.log file, attempt 1
[2026-04-30 16:22:23,785][  INFO][PID:1713915] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.82.104.242 copr-rpmbuild-log
[2026-04-30 16:22:28,804][  INFO][PID:1713915] Periodic builder liveness probe: alive
[2026-04-30 16:22:28,805][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:33,807][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:38,809][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:43,811][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:48,814][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:53,819][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:22:58,821][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:03,823][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:08,825][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:13,826][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:18,828][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:23,830][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:28,831][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:33,833][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:38,836][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:43,838][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:43,956][ ERROR][PID:1713915] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 16:23:48,839][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:53,842][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:23:53,966][WARNING][PID:1713915] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-30 16:23:58,848][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:03,850][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:03,968][  INFO][PID:1713915] Downloading the builder-live.log file, attempt 2
[2026-04-30 16:24:03,971][  INFO][PID:1713915] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.82.104.242 copr-rpmbuild-log
[2026-04-30 16:24:08,852][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:13,856][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:18,857][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:23,859][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:28,861][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:33,863][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:38,867][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:43,872][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:48,896][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:53,901][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:24:58,904][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:03,913][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:04,043][ ERROR][PID:1713915] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 16:25:08,934][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:13,937][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:14,064][WARNING][PID:1713915] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-30 16:25:18,941][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:23,963][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:24,066][  INFO][PID:1713915] Downloading the builder-live.log file, attempt 3
[2026-04-30 16:25:24,088][  INFO][PID:1713915] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.82.104.242 copr-rpmbuild-log
[2026-04-30 16:25:28,999][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:34,026][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:39,029][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:44,043][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:49,052][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:54,057][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:25:59,063][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:04,064][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:09,068][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:14,070][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:19,072][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:24,076][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:24,242][ ERROR][PID:1713915] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 16:26:29,081][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:34,086][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:34,327][WARNING][PID:1713915] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-04-30 16:26:39,089][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:44,090][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:44,331][  INFO][PID:1713915] Downloading the builder-live.log file, attempt 4
[2026-04-30 16:26:44,340][  INFO][PID:1713915] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.82.104.242 copr-rpmbuild-log
[2026-04-30 16:26:49,093][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:54,095][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:26:59,096][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:04,117][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:09,126][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:14,127][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:19,128][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:24,131][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:29,141][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:34,143][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:39,145][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:44,150][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:44,416][ ERROR][PID:1713915] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-04-30 16:27:49,172][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:54,173][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:54,521][ ERROR][PID:1713915] Giving up for unstable SSH, failures: 1777566233.9659746, 1777566314.064579, 1777566394.3273225, 1777566474.5217714
[2026-04-30 16:27:54,532][ ERROR][PID:1713915] Re-try request for task on 'ResallocHost, ticket_id=2673332, hostname=3.82.104.242, name=aws_x86_64_spot_prod_08360636_20260430_161937, requested_tags=['arch_s390x', 'copr_builder']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-04-30 16:27:54,683][  INFO][PID:1713915] VM Release request
[2026-04-30 16:27:54,698][  INFO][PID:1713915] Retry #1 (on other host)
[2026-04-30 16:27:54,699][  INFO][PID:1713915] Checking that /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/repodata/repomd.xml exists
[2026-04-30 16:27:54,797][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:27:54,809][  INFO][PID:1713915] VM allocation process starts
[2026-04-30 16:27:54,832][  INFO][PID:1713915] Trying to allocate VM: ResallocHost, ticket_id=2673497, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 16:27:59,834][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:04,836][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:09,840][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:14,842][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:19,844][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:24,848][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:29,849][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:34,851][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:39,855][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:42,936][  INFO][PID:1713915] Allocated host ResallocHost, ticket_id=2673497, hostname=100.53.14.218, name=aws_x86_64_reserved_prod_08360795_20260430_162446, requested_tags=['arch_s390x', 'copr_builder']
[2026-04-30 16:28:42,940][  INFO][PID:1713915] Allocating ssh connection to builder
[2026-04-30 16:28:42,942][  INFO][PID:1713915] Checking that builder machine is OK
[2026-04-30 16:28:43,214][  INFO][PID:1713915] Installed copr-rpmbuild version: 1.8
[2026-04-30 16:28:43,216][  INFO][PID:1713915] Running remote command: copr-builder-ready epel-9-s390x
[2026-04-30 16:28:43,553][  INFO][PID:1713915] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-04-30 16:28:43,554][  INFO][PID:1713915] Filling build.info file with builder info
[2026-04-30 16:28:43,631][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:43,638][  INFO][PID:1713915] Not re-notifying FE and msg buses for the new host.
[2026-04-30 16:28:43,641][  INFO][PID:1713915] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10412474-epel-9-s390x --chroot epel-9-s390x --detached
[2026-04-30 16:28:44,157][  INFO][PID:1713915] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '100.53.14.218' (ED25519) to the list of known hosts.


[2026-04-30 16:28:44,163][  INFO][PID:1713915] Downloading the builder-live.log file, attempt 1
[2026-04-30 16:28:44,176][  INFO][PID:1713915] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.53.14.218 copr-rpmbuild-log
[2026-04-30 16:28:49,174][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:54,181][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:28:59,195][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:04,197][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:09,199][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:14,204][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:19,212][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:24,219][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:29,229][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:34,237][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:39,241][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:44,245][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:49,265][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:54,286][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:29:59,312][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:04,336][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:09,345][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:14,353][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:19,357][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:24,362][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:29,366][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:34,375][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:39,380][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:44,394][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:49,398][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:54,402][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:30:59,405][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:04,410][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:09,413][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:14,419][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:19,430][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:24,437][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:29,438][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:34,440][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:39,447][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:44,454][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:49,455][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:54,457][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:31:59,461][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:04,465][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:09,467][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:14,470][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:19,473][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:24,475][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:29,485][  INFO][PID:1713915] Periodic builder liveness probe: alive
[2026-04-30 16:32:29,486][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:34,488][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:39,491][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:44,493][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:49,495][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:54,497][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:32:59,500][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:04,504][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:09,519][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:14,521][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:19,525][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:24,531][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:29,533][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:34,535][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:39,537][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:44,540][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:49,542][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:54,546][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:33:59,549][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:04,552][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:09,553][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:14,555][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:19,557][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:24,560][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:29,561][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:34,563][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:39,565][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:44,566][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:49,568][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:54,572][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:34:59,574][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:04,576][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:09,577][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:14,580][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:19,582][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:24,584][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:29,588][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:34,590][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:39,592][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:45,043][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:50,045][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:35:55,047][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:00,049][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:05,051][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:10,054][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:15,056][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:20,058][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:25,062][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:30,064][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:35,066][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:40,068][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:45,071][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:50,073][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:36:55,074][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:00,075][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:05,078][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:10,080][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:15,082][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:20,086][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:25,089][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:30,093][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:35,119][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:40,123][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:45,125][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:50,128][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:37:55,132][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:00,135][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:05,137][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:10,145][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:15,153][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:20,161][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:25,163][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:30,165][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:35,167][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:40,170][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:45,173][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:50,177][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:38:55,179][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:00,181][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:05,184][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:10,187][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:15,190][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:20,192][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:25,194][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:30,195][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:35,197][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:40,199][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:45,200][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:50,202][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:39:55,203][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:00,233][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:05,235][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:10,238][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:15,240][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:20,242][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:25,244][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:30,247][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:35,249][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:40,252][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:45,254][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:50,256][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:40:55,258][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:00,261][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:05,263][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:10,264][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:15,266][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:20,267][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:25,269][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:30,275][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:35,285][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:40,374][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:45,377][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:50,378][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:41:55,380][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:00,439][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:05,463][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:10,465][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:15,467][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:20,469][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:25,470][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:30,504][  INFO][PID:1713915] Periodic builder liveness probe: alive
[2026-04-30 16:42:30,505][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:35,506][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:40,507][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:45,509][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:50,510][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:55,512][  INFO][PID:1713915] Checking for cancel request
[2026-04-30 16:42:56,412][  INFO][PID:1713915] Downloading results from builder
[2026-04-30 16:42:56,413][  INFO][PID:1713915] rsyncing of mockbuilder@100.53.14.218:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt started
[2026-04-30 16:42:56,414][  INFO][PID:1713915] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@100.53.14.218:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/ &> /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/build-10412474.rsync.log
[2026-04-30 16:42:57,726][  INFO][PID:1713915] rsyncing finished.
[2026-04-30 16:42:57,731][  INFO][PID:1713915] VM Release request
[2026-04-30 16:42:57,744][  INFO][PID:1713915] Searching for 'success' file in resultdir
[2026-04-30 16:42:57,745][  INFO][PID:1713915] Going to sign pkgs from source: 10412474-epel-9-s390x in chroot: /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x
[2026-04-30 16:42:57,747][  INFO][PID:1713915] Calling '/bin/sign -u keithbowes#deponejo@copr.fedorahosted.org -p' (attempt #1)
[2026-04-30 16:42:58,041][  INFO][PID:1713915] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-20260406-2.el9.src.rpm' (attempt #1)
[2026-04-30 16:42:58,877][  INFO][PID:1713915] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-20260406-2.el9.src.rpm
[2026-04-30 16:42:58,878][  INFO][PID:1713915] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-20260406-2.el9.s390x.rpm' (attempt #1)
[2026-04-30 16:42:59,816][  INFO][PID:1713915] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-20260406-2.el9.s390x.rpm
[2026-04-30 16:42:59,817][  INFO][PID:1713915] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-debuginfo-20260406-2.el9.s390x.rpm' (attempt #1)
[2026-04-30 16:43:00,744][  INFO][PID:1713915] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-debuginfo-20260406-2.el9.s390x.rpm
[2026-04-30 16:43:00,744][  INFO][PID:1713915] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-debugsource-20260406-2.el9.s390x.rpm' (attempt #1)
[2026-04-30 16:43:01,728][  INFO][PID:1713915] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-debugsource-20260406-2.el9.s390x.rpm
[2026-04-30 16:43:01,732][  INFO][PID:1713915] Calling '/bin/sign -4 -h sha256 -u keithbowes#deponejo@copr.fedorahosted.org -r /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-doc-20260406-2.el9.noarch.rpm' (attempt #1)
[2026-04-30 16:43:02,498][  INFO][PID:1713915] signed rpm: /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/neomutt-doc-20260406-2.el9.noarch.rpm
[2026-04-30 16:43:02,501][  INFO][PID:1713915] Sign done
[2026-04-30 16:43:02,502][  INFO][PID:1713915] Incremental createrepo run, adding 10412474-neomutt into https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/epel-9-s390x, (auto-create-repo=True)
[2026-04-30 16:43:02,507][  INFO][PID:1713915] Running command 'copr-repo --batched /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x --add 10412474-neomutt' as PID 1899292
[2026-04-30 16:44:10,138][  INFO][PID:1713915] Finished after 67 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x --add 10412474-neomutt)
[2026-04-30 16:44:10,148][  INFO][PID:1713915] Getting build details
[2026-04-30 16:44:10,149][  INFO][PID:1713915] Listing built binary packages in /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt
[2026-04-30 16:44:10,152][  INFO][PID:1713915] Built packages:
['neomutt-debugsource 20260406', 'neomutt 20260406', 'neomutt-doc 20260406', 'neomutt-debuginfo 20260406']
[2026-04-30 16:44:10,153][  INFO][PID:1713915] build details: {'built_packages': 'neomutt-debugsource 20260406\nneomutt 20260406\nneomutt-doc 20260406\nneomutt-debuginfo 20260406'}
[2026-04-30 16:44:10,154][  INFO][PID:1713915] Retrieving pubkey
[2026-04-30 16:44:10,156][  INFO][PID:1713915] Calling '/bin/sign -u keithbowes#deponejo@copr.fedorahosted.org -p' (attempt #1)
[2026-04-30 16:44:10,615][  INFO][PID:1713915] Added pubkey for user keithbowes project deponejo into: /var/lib/copr/public_html/results/keithbowes/deponejo/pubkey.gpg
[2026-04-30 16:44:10,652][  INFO][PID:1713915] Finished build: id=10412474 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/keithbowes/deponejo chroot=epel-9-s390x 
[2026-04-30 16:44:10,666][  INFO][PID:1713915] Worker succeeded build, took 927.0286290645599
[2026-04-30 16:44:10,668][  INFO][PID:1713915] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "keithbowes",
            "project_name": "deponejo",
            "project_dirname": "deponejo",
            "submitter": "keithbowes",
            "ended_on": 1777567450.6667035,
            "started_on": 1777566523.6380744,
            "submitted_on": null,
            "status": 1,
            "chroot": "epel-9-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10412474-epel-9-s390x",
            "build_id": 10412474,
            "package_name": "neomutt",
            "package_version": "20260406-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/keithbowes/deponejo/neomutt",
            "git_hash": "cd6e360f1f91413b1a1ed6efcaca830db80073dd",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "keithbowes/deponejo--keithbowes",
            "results": {
                "packages": [
                    {
                        "name": "neomutt-debugsource",
                        "epoch": null,
                        "version": "20260406",
                        "release": "2.el9",
                        "arch": "s390x"
                    },
                    {
                        "name": "neomutt",
                        "epoch": null,
                        "version": "20260406",
                        "release": "2.el9",
                        "arch": "s390x"
                    },
                    {
                        "name": "neomutt-doc",
                        "epoch": null,
                        "version": "20260406",
                        "release": "2.el9",
                        "arch": "noarch"
                    },
                    {
                        "name": "neomutt-debuginfo",
                        "epoch": null,
                        "version": "20260406",
                        "release": "2.el9",
                        "arch": "s390x"
                    },
                    {
                        "name": "neomutt",
                        "epoch": null,
                        "version": "20260406",
                        "release": "2.el9",
                        "arch": "src"
                    }
                ]
            },
            "appstream": true,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo/epel-9-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/keithbowes/deponejo",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/keithbowes/deponejo",
            "result_dir": "10412474-neomutt",
            "built_packages": "neomutt-debugsource 20260406\nneomutt 20260406\nneomutt-doc 20260406\nneomutt-debuginfo 20260406",
            "id": 10412474,
            "mockchain_macros": {
                "copr_username": "keithbowes",
                "copr_projectname": "deponejo",
                "vendor": "Fedora Project COPR (keithbowes/deponejo)"
            }
        }
    ]
}
[2026-04-30 16:44:10,793][  INFO][PID:1713915] Sending fedora-messaging bus message in build.end
[2026-04-30 16:44:10,904][  INFO][PID:1713915] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/builder-live.log by gzip
[2026-04-30 16:44:10,910][  INFO][PID:1713915] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/builder-live.log' as PID 1909305
[2026-04-30 16:44:11,010][  INFO][PID:1713915] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/builder-live.log)
[2026-04-30 16:44:11,013][  INFO][PID:1713915] Compressing /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/backend.log by gzip
[2026-04-30 16:44:11,017][  INFO][PID:1713915] Running command 'gzip /var/lib/copr/public_html/results/keithbowes/deponejo/epel-9-s390x/10412474-neomutt/backend.log' as PID 1909360