[2026-03-30 11:39:47,146][  INFO][PID:3521455] Marking build as starting
[2026-03-30 11:39:47,220][  INFO][PID:3521455] Checking that /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/repodata/repomd.xml exists
[2026-03-30 11:39:47,396][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:39:47,397][  INFO][PID:3521455] VM allocation process starts
[2026-03-30 11:39:47,409][  INFO][PID:3521455] Trying to allocate VM: ResallocHost, ticket_id=2091267, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-30 11:39:50,424][  INFO][PID:3521455] Allocated host ResallocHost, ticket_id=2091267, hostname=98.80.146.192, name=aws_x86_64_spot_prod_04387226_20260330_113730, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-30 11:39:50,424][  INFO][PID:3521455] Allocating ssh connection to builder
[2026-03-30 11:39:50,425][  INFO][PID:3521455] Checking that builder machine is OK
[2026-03-30 11:39:50,743][  INFO][PID:3521455] Running remote command: copr-builder-ready fedora-rawhide-s390x
[2026-03-30 11:39:50,939][  INFO][PID:3521455] Red Hat subscription not needed for fedora-rawhide-s390x
Builder is ready to be used

[2026-03-30 11:39:50,940][  INFO][PID:3521455] Filling build.info file with builder info
[2026-03-30 11:39:50,956][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:39:50,958][  INFO][PID:3521455] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "osloup",
            "project_name": "postgresql_demodularization",
            "project_dirname": "postgresql_demodularization",
            "submitter": "https://src.fedoraproject.org/user/msuchy",
            "ended_on": null,
            "started_on": 1774870790.9578154,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10270055-fedora-rawhide-s390x",
            "build_id": 10270055,
            "package_name": "pg_auto_failover",
            "package_version": "2.1-8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osloup/postgresql_demodularization/pg_auto_failover",
            "git_hash": "128aed7695da2adf3f1d29a6eb3d10cb143fbbcf",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "osloup/postgresql_demodularization--https://src.fedoraproject.org/user/msuchy",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/osloup/postgresql_demodularization",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osloup/postgresql_demodularization",
            "result_dir": "10270055-pg_auto_failover",
            "built_packages": "",
            "id": 10270055,
            "mockchain_macros": {
                "copr_username": "osloup",
                "copr_projectname": "postgresql_demodularization",
                "vendor": "Fedora Project COPR (osloup/postgresql_demodularization)"
            }
        }
    ]
}
[2026-03-30 11:39:51,028][  INFO][PID:3521455] Sending fedora-messaging bus message in build.start
[2026-03-30 11:39:51,654][  INFO][PID:3521455] Sending fedora-messaging bus message in chroot.start
[2026-03-30 11:39:51,685][  INFO][PID:3521455] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10270055-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached
[2026-03-30 11:39:52,006][  INFO][PID:3521455] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.80.146.192' (ED25519) to the list of known hosts.


[2026-03-30 11:39:52,007][  INFO][PID:3521455] Downloading the builder-live.log file, attempt 1
[2026-03-30 11:39:52,008][  INFO][PID:3521455] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.146.192 copr-rpmbuild-log
[2026-03-30 11:39:57,020][  INFO][PID:3521455] Periodic builder liveness probe: alive
[2026-03-30 11:39:57,021][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:02,022][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:07,023][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:12,024][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:17,026][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:22,027][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:27,028][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:32,029][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:37,030][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:42,031][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:47,032][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:52,033][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:40:57,034][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:02,084][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:07,085][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:12,086][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:17,087][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:22,088][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:27,089][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:32,090][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:37,091][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:42,093][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:47,094][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:52,095][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:41:57,097][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:02,098][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:07,099][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:12,100][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:17,101][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:22,102][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:27,103][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:32,104][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:37,105][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:42,106][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:47,107][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:52,108][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:42:57,109][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:02,110][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:07,111][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:12,112][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:17,121][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:22,122][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:27,123][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:32,124][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:37,125][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:42,126][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:47,127][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:52,128][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:43:57,129][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:02,130][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:07,131][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:12,132][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:17,133][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:22,134][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:27,137][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:32,138][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:37,139][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:42,140][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:47,141][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:52,143][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:44:57,144][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:02,145][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:07,146][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:12,147][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:17,148][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:22,149][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:27,150][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:32,151][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:37,153][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:42,155][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:47,159][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:52,161][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:45:57,162][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:02,163][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:07,164][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:12,166][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:17,167][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:22,168][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:27,169][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:32,170][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:37,172][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:42,174][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:47,178][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:52,180][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:46:57,181][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:02,182][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:07,183][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:12,184][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:17,186][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:22,188][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:27,238][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:32,240][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:37,246][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:42,247][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:47,248][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:52,249][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:47:57,250][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:02,251][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:07,253][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:12,254][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:17,255][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:17,700][ ERROR][PID:3521455] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-30 11:48:22,257][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:27,258][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:27,701][WARNING][PID:3521455] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-30 11:48:32,259][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:37,260][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:37,701][  INFO][PID:3521455] Downloading the builder-live.log file, attempt 2
[2026-03-30 11:48:37,703][  INFO][PID:3521455] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.146.192 copr-rpmbuild-log
[2026-03-30 11:48:37,712][ ERROR][PID:3521455] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-30 11:48:42,261][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:47,262][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:47,715][WARNING][PID:3521455] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-30 11:48:52,263][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:57,264][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:48:57,716][  INFO][PID:3521455] Downloading the builder-live.log file, attempt 3
[2026-03-30 11:48:57,717][  INFO][PID:3521455] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.146.192 copr-rpmbuild-log
[2026-03-30 11:48:57,725][ ERROR][PID:3521455] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-30 11:49:02,265][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:07,266][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:07,840][WARNING][PID:3521455] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-03-30 11:49:12,267][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:17,268][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:17,841][  INFO][PID:3521455] Downloading the builder-live.log file, attempt 4
[2026-03-30 11:49:17,842][  INFO][PID:3521455] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.146.192 copr-rpmbuild-log
[2026-03-30 11:49:22,269][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:27,270][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:32,271][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:37,272][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:42,273][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:47,274][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:52,276][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:49:57,281][  INFO][PID:3521455] Periodic builder liveness probe: alive
[2026-03-30 11:49:57,282][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:02,283][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:07,284][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:12,285][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:17,285][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:17,908][ ERROR][PID:3521455] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-03-30 11:50:22,286][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:27,288][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:27,979][ ERROR][PID:3521455] Giving up for unstable SSH, failures: 1774871307.7010484, 1774871327.715473, 1774871347.8406296, 1774871427.9790456
[2026-03-30 11:50:27,980][ ERROR][PID:3521455] Re-try request for task on 'ResallocHost, ticket_id=2091267, hostname=98.80.146.192, name=aws_x86_64_spot_prod_04387226_20260330_113730, requested_tags=['copr_builder', 'arch_s390x']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-03-30 11:50:27,980][  INFO][PID:3521455] Releasing VM back to pool
[2026-03-30 11:50:27,990][  INFO][PID:3521455] Retry #1 (on other host)
[2026-03-30 11:50:27,990][  INFO][PID:3521455] Checking that /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/repodata/repomd.xml exists
[2026-03-30 11:50:27,991][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:27,991][  INFO][PID:3521455] VM allocation process starts
[2026-03-30 11:50:28,044][  INFO][PID:3521455] Trying to allocate VM: ResallocHost, ticket_id=2091392, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-30 11:50:31,080][  INFO][PID:3521455] Allocated host ResallocHost, ticket_id=2091392, hostname=3.234.219.52, name=aws_x86_64_normalreserved_prod_04387682_20260330_114711, requested_tags=['copr_builder', 'arch_s390x']
[2026-03-30 11:50:31,171][  INFO][PID:3521455] Allocating ssh connection to builder
[2026-03-30 11:50:31,171][  INFO][PID:3521455] Checking that builder machine is OK
[2026-03-30 11:50:31,549][  INFO][PID:3521455] Running remote command: copr-builder-ready fedora-rawhide-s390x
[2026-03-30 11:50:31,768][  INFO][PID:3521455] Red Hat subscription not needed for fedora-rawhide-s390x
Builder is ready to be used

[2026-03-30 11:50:31,768][  INFO][PID:3521455] Filling build.info file with builder info
[2026-03-30 11:50:31,802][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:31,803][  INFO][PID:3521455] Not re-notifying FE and msg buses for the new host.
[2026-03-30 11:50:31,803][  INFO][PID:3521455] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10270055-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached
[2026-03-30 11:50:32,186][  INFO][PID:3521455] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.234.219.52' (ED25519) to the list of known hosts.


[2026-03-30 11:50:32,187][  INFO][PID:3521455] Downloading the builder-live.log file, attempt 1
[2026-03-30 11:50:32,194][  INFO][PID:3521455] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.234.219.52 copr-rpmbuild-log
[2026-03-30 11:50:37,188][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:42,189][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:47,190][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:52,191][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:50:57,192][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:02,193][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:07,195][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:12,196][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:17,197][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:22,198][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:27,199][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:32,200][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:37,200][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:42,201][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:47,203][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:52,204][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:51:57,205][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:02,206][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:07,207][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:12,208][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:17,209][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:22,210][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:27,211][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:32,212][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:37,224][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:42,225][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:47,226][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:52,227][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:52:57,228][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:02,232][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:07,233][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:12,235][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:17,238][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:22,239][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:27,240][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:32,242][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:37,243][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:42,244][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:47,245][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:52,247][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:53:57,248][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:02,249][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:07,250][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:12,251][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:17,253][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:22,254][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:27,255][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:32,256][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:37,259][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:42,264][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:47,268][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:52,270][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:54:57,271][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:02,272][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:07,273][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:12,274][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:17,277][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:22,279][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:27,280][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:32,281][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:37,284][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:42,286][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:47,290][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:52,291][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:55:57,292][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:02,397][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:07,403][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:12,404][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:17,405][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:22,698][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:27,699][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:32,701][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:37,702][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:42,703][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:47,704][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:52,705][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:56:57,706][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:02,968][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:07,970][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:12,971][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:17,972][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:22,973][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:28,012][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:33,080][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:38,240][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:43,241][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:48,243][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:53,244][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:57:58,245][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:03,247][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:08,442][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:13,618][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:18,620][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:23,621][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:28,622][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:33,624][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:38,625][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:43,626][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:48,665][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:53,667][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:58:58,716][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:03,717][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:08,866][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:13,867][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:18,907][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:23,912][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:28,913][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:33,914][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:38,915][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:44,002][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:49,004][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:54,027][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 11:59:59,477][  INFO][PID:3521455] Periodic builder liveness probe: alive
[2026-03-30 11:59:59,477][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:04,478][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:09,479][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:14,480][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:19,480][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:24,481][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:29,482][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:34,486][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:39,487][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:44,488][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:49,490][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:54,492][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:00:59,733][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:04,864][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:09,865][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:14,866][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:19,867][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:24,868][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:29,869][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:34,870][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:39,904][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:44,905][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:49,907][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:54,908][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:01:59,909][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:04,910][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:09,911][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:14,912][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:19,913][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:24,915][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:29,918][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:34,920][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:39,921][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:45,007][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:50,038][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:02:55,043][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:00,048][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:05,055][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:10,179][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:15,181][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:20,232][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:25,235][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:30,237][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:35,241][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:40,242][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:45,345][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:50,346][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:03:55,347][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:00,349][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:05,350][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:10,351][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:15,352][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:20,353][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:25,354][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:30,355][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:35,356][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:40,357][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:45,357][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:50,358][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:04:55,359][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:00,383][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:05,384][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:10,385][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:15,386][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:20,387][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:25,391][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:30,392][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:35,393][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:40,394][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:45,400][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:50,401][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:05:55,402][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:00,403][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:05,411][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:10,413][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:15,414][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:20,415][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:25,487][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:30,488][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:35,489][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:40,490][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:45,497][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:50,498][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:06:55,499][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:00,500][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:05,503][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:10,510][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:15,515][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:20,607][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:25,610][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:30,612][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:35,614][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:40,739][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:45,741][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:50,743][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:07:55,745][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:08:00,747][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:08:05,749][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:08:10,750][  INFO][PID:3521455] Checking for cancel request
[2026-03-30 12:08:12,749][  INFO][PID:3521455] Downloading results from builder
[2026-03-30 12:08:12,749][  INFO][PID:3521455] rsyncing of mockbuilder@3.234.219.52:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover started
[2026-03-30 12:08:12,750][  INFO][PID:3521455] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.234.219.52:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/ &> /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/build-10270055.rsync.log
[2026-03-30 12:08:13,003][  INFO][PID:3521455] rsyncing finished.
[2026-03-30 12:08:13,003][  INFO][PID:3521455] Releasing VM back to pool
[2026-03-30 12:08:13,013][  INFO][PID:3521455] Searching for 'success' file in resultdir
[2026-03-30 12:08:13,013][ ERROR][PID:3521455] Build failed: Backend process error: No success file => build failure
[2026-03-30 12:08:13,014][  INFO][PID:3521455] Finished build: id=10270055 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/osloup/postgresql_demodularization chroot=fedora-rawhide-s390x 
[2026-03-30 12:08:13,016][ ERROR][PID:3521455] Backend process error: No success file => build failure
[2026-03-30 12:08:13,017][  INFO][PID:3521455] Worker failed build, took 1061.2143807411194
[2026-03-30 12:08:13,018][  INFO][PID:3521455] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "osloup",
            "project_name": "postgresql_demodularization",
            "project_dirname": "postgresql_demodularization",
            "submitter": "https://src.fedoraproject.org/user/msuchy",
            "ended_on": 1774872493.0173616,
            "started_on": 1774871431.802981,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-s390x",
            "arch": "s390x",
            "buildroot_pkgs": [],
            "task_id": "10270055-fedora-rawhide-s390x",
            "build_id": 10270055,
            "package_name": "pg_auto_failover",
            "package_version": "2.1-8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osloup/postgresql_demodularization/pg_auto_failover",
            "git_hash": "128aed7695da2adf3f1d29a6eb3d10cb143fbbcf",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "osloup/postgresql_demodularization--https://src.fedoraproject.org/user/msuchy",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_s390x"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/osloup/postgresql_demodularization",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osloup/postgresql_demodularization",
            "result_dir": "10270055-pg_auto_failover",
            "built_packages": "",
            "id": 10270055,
            "mockchain_macros": {
                "copr_username": "osloup",
                "copr_projectname": "postgresql_demodularization",
                "vendor": "Fedora Project COPR (osloup/postgresql_demodularization)"
            }
        }
    ]
}
[2026-03-30 12:08:13,089][  INFO][PID:3521455] Sending fedora-messaging bus message in build.end
[2026-03-30 12:08:13,116][  INFO][PID:3521455] Compressing /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/builder-live.log by gzip
[2026-03-30 12:08:13,118][  INFO][PID:3521455] Running command 'gzip /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/builder-live.log' as PID 3714206
[2026-03-30 12:08:13,159][  INFO][PID:3521455] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/builder-live.log)
[2026-03-30 12:08:13,160][  INFO][PID:3521455] Compressing /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/backend.log by gzip
[2026-03-30 12:08:13,161][  INFO][PID:3521455] Running command 'gzip /var/lib/copr/public_html/results/osloup/postgresql_demodularization/fedora-rawhide-s390x/10270055-pg_auto_failover/backend.log' as PID 3714210