[2026-03-23 14:27:01,204][  INFO][PID:1775885] Marking build as starting
[2026-03-23 14:27:01,332][  INFO][PID:1775885] Checking that /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/repodata/repomd.xml exists
[2026-03-23 14:27:01,591][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:01,592][  INFO][PID:1775885] VM allocation process starts
[2026-03-23 14:27:01,604][  INFO][PID:1775885] Trying to allocate VM: ResallocHost, ticket_id=1993978, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-23 14:27:04,619][  INFO][PID:1775885] Allocated host ResallocHost, ticket_id=1993978, hostname=44.192.105.85, name=aws_x86_64_spot_prod_04215884_20260323_142525, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-23 14:27:04,620][  INFO][PID:1775885] Allocating ssh connection to builder
[2026-03-23 14:27:04,621][  INFO][PID:1775885] Checking that builder machine is OK
[2026-03-23 14:27:04,947][  INFO][PID:1775885] Running remote command: copr-builder-ready fedora-44-s390x
[2026-03-23 14:27:05,169][  INFO][PID:1775885] Red Hat subscription not needed for fedora-44-s390x
Builder is ready to be used

[2026-03-23 14:27:05,170][  INFO][PID:1775885] Filling build.info file with builder info
[2026-03-23 14:27:05,170][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:05,172][  INFO][PID:1775885] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "topazus",
            "project_name": "test",
            "project_dirname": "test",
            "submitter": "topazus",
            "ended_on": null,
            "started_on": 1774276025.1722949,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-44-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10224371-fedora-44-s390x",
            "build_id": 10224371,
            "package_name": "tdom",
            "package_version": "0.9.6-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test/tdom",
            "git_hash": "5375dde8192c3643ec21f63df6ecb64a8fb420b5",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "topazus/test--topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-44-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-44-s390x/",
                    "id": "copr_topazus_test",
                    "name": "Additional repo copr_topazus_test"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/topazus/test",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test",
            "result_dir": "10224371-tdom",
            "built_packages": "",
            "id": 10224371,
            "mockchain_macros": {
                "copr_username": "topazus",
                "copr_projectname": "test",
                "vendor": "Fedora Project COPR (topazus/test)"
            }
        }
    ]
}
[2026-03-23 14:27:05,249][  INFO][PID:1775885] Sending fedora-messaging bus message in build.start
[2026-03-23 14:27:06,072][  INFO][PID:1775885] Sending fedora-messaging bus message in chroot.start
[2026-03-23 14:27:06,107][  INFO][PID:1775885] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10224371-fedora-44-s390x --chroot fedora-44-s390x --detached
[2026-03-23 14:27:06,450][  INFO][PID:1775885] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.192.105.85' (ED25519) to the list of known hosts.


[2026-03-23 14:27:06,452][  INFO][PID:1775885] Downloading the builder-live.log file, attempt 1
[2026-03-23 14:27:06,454][  INFO][PID:1775885] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.105.85 copr-rpmbuild-log
[2026-03-23 14:27:11,466][  INFO][PID:1775885] Periodic builder liveness probe: alive
[2026-03-23 14:27:11,467][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:16,468][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:21,473][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:26,478][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:31,481][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:36,485][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:41,486][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:46,488][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:51,494][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:27:56,499][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:01,503][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:06,505][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:11,508][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:16,512][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:21,518][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:26,521][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:31,523][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:36,531][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:41,535][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:46,537][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:51,539][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:28:56,542][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:01,546][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:06,548][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:11,550][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:16,552][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:21,554][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:26,555][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:31,556][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:36,558][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:41,559][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:46,560][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:51,562][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:29:56,565][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:01,566][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:06,567][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:11,568][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:16,569][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:21,570][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:26,571][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:31,573][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:36,574][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:41,654][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:46,656][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:51,657][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:30:56,659][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:01,660][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:06,662][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:11,856][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:16,858][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:21,861][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:26,861][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:31,862][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:36,863][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:41,864][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:46,865][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:51,869][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:31:56,874][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:01,875][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:06,876][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:11,877][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:16,878][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:21,879][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:26,880][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:31,881][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:36,883][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:41,884][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:46,885][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:51,889][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:32:56,890][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:01,891][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:06,892][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:11,893][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:16,896][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:21,898][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:26,899][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:30,012][ ERROR][PID:1775885] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-23 14:33:31,900][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:36,901][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:40,014][WARNING][PID:1775885] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-23 14:33:41,902][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:46,951][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:50,015][  INFO][PID:1775885] Downloading the builder-live.log file, attempt 2
[2026-03-23 14:33:50,027][  INFO][PID:1775885] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.105.85 copr-rpmbuild-log
[2026-03-23 14:33:51,953][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:33:56,955][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:01,956][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:06,957][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:11,958][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:16,959][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:22,160][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:27,166][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:32,173][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:37,175][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:42,176][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:47,179][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:50,137][ ERROR][PID:1775885] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-23 14:34:52,180][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:34:57,181][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:00,154][WARNING][PID:1775885] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-23 14:35:02,182][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:07,183][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:10,155][  INFO][PID:1775885] Downloading the builder-live.log file, attempt 3
[2026-03-23 14:35:10,160][  INFO][PID:1775885] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.105.85 copr-rpmbuild-log
[2026-03-23 14:35:12,184][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:17,185][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:22,187][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:27,190][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:32,191][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:37,192][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:42,194][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:47,196][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:52,198][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:35:57,200][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:02,204][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:07,207][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:10,240][ ERROR][PID:1775885] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-23 14:36:12,208][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:17,209][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:20,253][WARNING][PID:1775885] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-23 14:36:22,210][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:27,214][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:30,254][  INFO][PID:1775885] Downloading the builder-live.log file, attempt 4
[2026-03-23 14:36:30,255][  INFO][PID:1775885] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.192.105.85 copr-rpmbuild-log
[2026-03-23 14:36:32,216][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:37,218][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:42,219][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:47,221][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:52,222][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:36:57,223][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:02,224][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:07,225][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:12,236][  INFO][PID:1775885] Periodic builder liveness probe: alive
[2026-03-23 14:37:12,237][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:17,238][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:22,240][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:27,242][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:30,323][ ERROR][PID:1775885] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-23 14:37:32,244][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:37,245][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:40,337][ ERROR][PID:1775885] Giving up for unstable SSH, failures: 1774276420.0140572, 1774276500.1543567, 1774276580.253708, 1774276660.33745
[2026-03-23 14:37:40,338][ ERROR][PID:1775885] Re-try request for task on 'ResallocHost, ticket_id=1993978, hostname=44.192.105.85, name=aws_x86_64_spot_prod_04215884_20260323_142525, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-03-23 14:37:40,340][  INFO][PID:1775885] Releasing VM back to pool
[2026-03-23 14:37:40,350][  INFO][PID:1775885] Retry #1 (on other host)
[2026-03-23 14:37:40,351][  INFO][PID:1775885] Checking that /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/repodata/repomd.xml exists
[2026-03-23 14:37:40,351][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:40,352][  INFO][PID:1775885] VM allocation process starts
[2026-03-23 14:37:40,363][  INFO][PID:1775885] Trying to allocate VM: ResallocHost, ticket_id=1994191, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-23 14:37:43,388][  INFO][PID:1775885] Allocated host ResallocHost, ticket_id=1994191, hostname=44.201.50.219, name=aws_x86_64_normalreserved_prod_04216265_20260323_143610, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-23 14:37:43,389][  INFO][PID:1775885] Allocating ssh connection to builder
[2026-03-23 14:37:43,390][  INFO][PID:1775885] Checking that builder machine is OK
[2026-03-23 14:37:43,746][  INFO][PID:1775885] Running remote command: copr-builder-ready fedora-44-s390x
[2026-03-23 14:37:43,964][  INFO][PID:1775885] Red Hat subscription not needed for fedora-44-s390x
Builder is ready to be used

[2026-03-23 14:37:43,964][  INFO][PID:1775885] Filling build.info file with builder info
[2026-03-23 14:37:43,974][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:43,975][  INFO][PID:1775885] Not re-notifying FE and msg buses for the new host.
[2026-03-23 14:37:43,975][  INFO][PID:1775885] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10224371-fedora-44-s390x --chroot fedora-44-s390x --detached
[2026-03-23 14:37:44,329][  INFO][PID:1775885] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '44.201.50.219' (ED25519) to the list of known hosts.


[2026-03-23 14:37:44,330][  INFO][PID:1775885] Downloading the builder-live.log file, attempt 1
[2026-03-23 14:37:44,331][  INFO][PID:1775885] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.50.219 copr-rpmbuild-log
[2026-03-23 14:37:49,330][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:54,331][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:37:59,332][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:04,333][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:09,335][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:14,337][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:19,338][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:24,339][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:29,340][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:34,341][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:39,342][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:44,343][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:49,347][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:54,359][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:38:59,360][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:04,361][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:09,361][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:14,363][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:19,364][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:24,366][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:29,371][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:34,375][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:39,377][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:44,379][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:49,380][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:54,381][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:39:59,382][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:04,383][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:09,385][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:14,386][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:19,387][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:24,388][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:29,389][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:34,390][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:39,391][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:44,392][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:49,393][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:54,394][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:40:59,396][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:04,397][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:09,398][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:14,399][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:19,401][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:24,402][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:29,403][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:34,404][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:39,405][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:44,406][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:49,407][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:54,408][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:41:59,409][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:04,410][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:09,411][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:14,412][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:19,413][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:24,414][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:29,415][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:34,416][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:39,417][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:44,419][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:49,420][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:54,421][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:42:59,440][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:04,442][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:09,444][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:14,447][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:19,449][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:24,450][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:29,455][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:34,458][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:39,460][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:44,463][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:49,468][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:54,470][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:43:59,471][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:04,472][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:09,473][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:14,474][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:19,475][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:24,476][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:29,477][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:34,479][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:39,480][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:44,481][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:49,521][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:54,605][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:44:59,607][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:04,609][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:09,611][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:14,638][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:19,640][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:24,642][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:29,643][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:34,647][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:39,726][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:44,752][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:49,753][  INFO][PID:1775885] Checking for cancel request
[2026-03-23 14:45:50,451][  INFO][PID:1775885] Downloading results from builder
[2026-03-23 14:45:50,452][  INFO][PID:1775885] rsyncing of mockbuilder@44.201.50.219:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom started
[2026-03-23 14:45:50,453][  INFO][PID:1775885] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.201.50.219:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/ &> /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/build-10224371.rsync.log
[2026-03-23 14:45:50,881][  INFO][PID:1775885] rsyncing finished.
[2026-03-23 14:45:50,882][  INFO][PID:1775885] Releasing VM back to pool
[2026-03-23 14:45:50,891][  INFO][PID:1775885] Searching for 'success' file in resultdir
[2026-03-23 14:45:50,892][ ERROR][PID:1775885] Build failed: Backend process error: No success file => build failure
[2026-03-23 14:45:50,893][  INFO][PID:1775885] Finished build: id=10224371 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/topazus/test chroot=fedora-44-s390x 
[2026-03-23 14:45:50,895][ ERROR][PID:1775885] Backend process error: No success file => build failure
[2026-03-23 14:45:50,896][  INFO][PID:1775885] Worker failed build, took 486.9209589958191
[2026-03-23 14:45:50,896][  INFO][PID:1775885] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "topazus",
            "project_name": "test",
            "project_dirname": "test",
            "submitter": "topazus",
            "ended_on": 1774277150.896199,
            "started_on": 1774276663.97524,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-44-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10224371-fedora-44-s390x",
            "build_id": 10224371,
            "package_name": "tdom",
            "package_version": "0.9.6-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/topazus/test/tdom",
            "git_hash": "5375dde8192c3643ec21f63df6ecb64a8fb420b5",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "topazus/test--topazus",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-44-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/topazus/test/fedora-44-s390x/",
                    "id": "copr_topazus_test",
                    "name": "Additional repo copr_topazus_test"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/topazus/test",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/topazus/test",
            "result_dir": "10224371-tdom",
            "built_packages": "",
            "id": 10224371,
            "mockchain_macros": {
                "copr_username": "topazus",
                "copr_projectname": "test",
                "vendor": "Fedora Project COPR (topazus/test)"
            }
        }
    ]
}
[2026-03-23 14:45:50,962][  INFO][PID:1775885] Sending fedora-messaging bus message in build.end
[2026-03-23 14:45:50,993][  INFO][PID:1775885] Compressing /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/builder-live.log by gzip
[2026-03-23 14:45:50,995][  INFO][PID:1775885] Running command 'gzip /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/builder-live.log' as PID 1913984
[2026-03-23 14:45:51,031][  INFO][PID:1775885] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/builder-live.log)
[2026-03-23 14:45:51,032][  INFO][PID:1775885] Compressing /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/backend.log by gzip
[2026-03-23 14:45:51,033][  INFO][PID:1775885] Running command 'gzip /var/lib/copr/public_html/results/topazus/test/fedora-44-s390x/10224371-tdom/backend.log' as PID 1913992