[2026-05-14 19:15:18,524][  INFO][PID:1151792] Marking build as starting
[2026-05-14 19:15:18,562][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:18,564][  INFO][PID:1151792] VM allocation process starts
[2026-05-14 19:15:18,584][  INFO][PID:1151792] Trying to allocate VM: ResallocHost, ticket_id=2893257, requested_tags=['arch_x86_64', 'copr_builder']
[2026-05-14 19:15:23,589][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:28,592][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:33,595][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:36,641][  INFO][PID:1151792] Allocated host ResallocHost, ticket_id=2893257, hostname=2620:52:6:1161:dead:beef:cafe:c122, name=vmhost_x86_01_prod_08846118_20260514_181408, requested_tags=['arch_x86_64', 'copr_builder']
[2026-05-14 19:15:36,642][  INFO][PID:1151792] Allocating ssh connection to builder
[2026-05-14 19:15:36,643][  INFO][PID:1151792] Checking that builder machine is OK
[2026-05-14 19:15:37,234][  INFO][PID:1151792] Installed copr-rpmbuild version: 1.8
[2026-05-14 19:15:37,237][  INFO][PID:1151792] Running remote command: copr-builder-ready srpm-builds
[2026-05-14 19:15:37,622][  INFO][PID:1151792] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2026-05-14 19:15:37,623][  INFO][PID:1151792] Filling build.info file with builder info
[2026-05-14 19:15:37,626][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:37,627][  INFO][PID:1151792] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "lizardbyte",
            "project_name": "pulls",
            "project_dirname": "pulls:pr:5118",
            "submitter": null,
            "ended_on": null,
            "started_on": 1778786137.627567,
            "submitted_on": null,
            "status": 3,
            "chroot": "srpm-builds",
            "arch": "x86_64",
            "buildroot_pkgs": null,
            "task_id": "10460958",
            "build_id": 10460958,
            "package_name": "Sunshine",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 9,
            "source_json": "{\"script\": \"#!/usr/bin/env bash\\nset -x\\nset -e\\n\\nresultdir=\\\"${COPR_RESULTDIR}\\\"\\ngit clone \\\"https://github.com/${COPR_OWNER}/${COPR_PACKAGE}.git\\\" --depth 1\\ncd \\\"${COPR_PACKAGE}\\\"\\n\\n# get info from the webhook payload\\nif [[ -z \\\"$REVISION\\\" ]]; then\\n  # the hook_payload file contains webhook JSON payload (copr creates it for us);\\n  # it is created only if the build is triggered by Custom webhook.\\n  if [[ -f \\\"$resultdir\\\"/hook_payload ]]; then\\n    git clone https://github.com/praiskup/copr-ci-tooling \\\\\\n      \\\"$resultdir/cct\\\" --depth 1\\n    export PATH=\\\"$resultdir/cct:$PATH\\\"\\n\\n    echo \\\"---\\\"\\n    cat \\\"$resultdir\\\"/hook_payload\\n    echo \\\"---\\\"\\n\\n    # use jq to get the pr_id from the hook_payload\\n    PR=$(jq -r '.pr_id // empty' \\\"$resultdir\\\"/hook_payload)\\n    if [[ -z \\\"$PR\\\" ]]; then\\n      BRANCH=\\\"master\\\"\\n    else\\n      BRANCH=\\\"pr/${PR}\\\"\\n    fi\\n\\n    copr-travis-checkout \\\"$resultdir\\\"/hook_payload\\n  fi\\nelse\\n  git checkout \\\"$REVISION\\\"\\nfi\\n\\n# read optional exclusions from .copr-ci config file\\n# each non-empty, non-comment line is treated as a submodule path or directory\\n# to exclude (relative to the repo root, e.g. \\\"third-party/build-deps\\\")\\nEXCLUDED_PATHS=()\\nif [[ -f \\\".copr-ci\\\" ]]; then\\n  echo \\\"Found .copr-ci config file, reading exclusions...\\\"\\n  while IFS= read -r line || [[ -n \\\"$line\\\" ]]; do\\n    # skip empty lines and comments\\n    [[ -z \\\"$line\\\" || \\\"$line\\\" =~ ^# ]] && continue\\n    EXCLUDED_PATHS+=(\\\"$line\\\")\\n    echo \\\"  Excluding: $line\\\"\\n  done < \\\".copr-ci\\\"\\nfi\\n\\n# initialize the submodules, skipping any excluded paths\\nif [[ ${#EXCLUDED_PATHS[@]} -gt 0 ]]; then\\n  # get all top-level submodule paths, then init only the ones not excluded\\n  mapfile -t TOP_SUBMODULES < <(git submodule status | awk '{print $2}')\\n\\n  for submodule in \\\"${TOP_SUBMODULES[@]}\\\"; do\\n    skip=false\\n    for excluded in \\\"${EXCLUDED_PATHS[@]}\\\"; do\\n      # match exact path or any path that starts with the excluded prefix\\n      if [[ \\\"$submodule\\\" == \\\"$excluded\\\" || \\\"$submodule\\\" == \\\"$excluded/\\\"* ]]; then\\n        skip=true\\n        break\\n      fi\\n    done\\n    if [[ \\\"$skip\\\" == false ]]; then\\n      git submodule update --init --recursive --depth 1 -- \\\"$submodule\\\"\\n    else\\n      echo \\\"Skipping submodule: $submodule\\\"\\n    fi\\n  done\\nelse\\n  git submodule update --init --recursive --depth 1\\nfi\\n\\n# get the tag of this commit IF it has one\\nTAG=$(git tag --points-at HEAD | head -n1)\\nif [[ -z \\\"$TAG\\\" ]]; then\\n  TAG=\\\"0.0.$PR\\\"\\nfi\\nTAG=\\\"${TAG#v}\\\"  # remove v prefix from the tag\\necho \\\"TAG=$TAG\\\"\\n\\n# get the commit\\nCOMMIT=$(git rev-parse HEAD)\\necho \\\"COMMIT=$COMMIT\\\"\\n\\n# move spec file to the correct location\\ndirectories=(\\n  \\\".\\\"\\n  \\\"./packaging/linux/copr\\\"\\n)\\nfor dir in \\\"${directories[@]}\\\"; do\\n  if [[ -f \\\"${dir}/${COPR_PACKAGE}.spec\\\" ]]; then\\n    echo \\\"Found spec file in ${dir}\\\"\\n    rpmlint \\\"${dir}/${COPR_PACKAGE}.spec\\\"\\n\\n    mv \\\"${dir}/${COPR_PACKAGE}.spec\\\" \\\"${resultdir}\\\"\\n    break\\n  fi\\ndone\\n\\n# fail if the spec file is not in the resultdir\\nif [[ ! -f \\\"${resultdir}/${COPR_PACKAGE}.spec\\\" ]]; then\\n  echo \\\"ERROR: ${COPR_PACKAGE}.spec not found\\\" >&2\\n  exit 1\\nfi\\n\\n# use sed to replace these values in the spec file\\nsed -i \\\"s|%global build_version 0|%global build_version ${TAG}|\\\" \\\"${resultdir}\\\"/*.spec\\nsed -i \\\"s|%global branch 0|%global branch ${BRANCH}|\\\" \\\"${resultdir}\\\"/*.spec\\nsed -i \\\"s|%global commit 0|%global commit ${COMMIT}|\\\" \\\"${resultdir}\\\"/*.spec\\n\\n# create a tarball of the source code, excluding any configured paths\\nTAR_EXCLUDE_ARGS=()\\nfor path in \\\"${EXCLUDED_PATHS[@]}\\\"; do\\n  TAR_EXCLUDE_ARGS+=(\\\"--exclude=./${path}\\\")\\ndone\\ntar -czf \\\"${resultdir}/tarball.tar.gz\\\" \\\"${TAR_EXCLUDE_ARGS[@]}\\\" .\\n\", \"chroot\": \"fedora-44-x86_64\", \"builddeps\": \"git jq python3 rpmlint\", \"resultdir\": \"\", \"repos\": \"\", \"tmp\": \"tmpkvsmlqjt\", \"hook_data\": true}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "lizardbyte/pulls--d007eaf0-f577-4daf-a956-5f230f2e053c",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": true,
            "distributions_in_build": [
                "fedora-42",
                "fedora-43",
                "fedora-44",
                "fedora-rawhide",
                "opensuse-leap-15.6"
            ],
            "distributions_in_project": [
                "fedora-42",
                "fedora-43",
                "fedora-44",
                "fedora-rawhide",
                "opensuse-leap-15.6"
            ],
            "destdir": "/var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lizardbyte/pulls:pr:5118",
            "result_dir": "10460958",
            "built_packages": "",
            "tags": [
                "arch_x86_64"
            ],
            "id": 10460958,
            "mockchain_macros": {
                "copr_username": "lizardbyte",
                "copr_projectname": "pulls",
                "vendor": "Fedora Project COPR (lizardbyte/pulls)"
            }
        }
    ]
}
[2026-05-14 19:15:37,671][  INFO][PID:1151792] Sending fedora-messaging bus message in build.start
[2026-05-14 19:15:38,343][  INFO][PID:1151792] Sending fedora-messaging bus message in chroot.start
[2026-05-14 19:15:38,401][  INFO][PID:1151792] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/10460958 --detached
[2026-05-14 19:15:39,077][  INFO][PID:1151792] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c122' (ED25519) to the list of known hosts.


[2026-05-14 19:15:39,081][  INFO][PID:1151792] Downloading the builder-live.log file, attempt 1
[2026-05-14 19:15:39,085][  INFO][PID:1151792] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c122 copr-rpmbuild-log
[2026-05-14 19:15:44,091][  INFO][PID:1151792] Periodic builder liveness probe: alive
[2026-05-14 19:15:44,096][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:49,102][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:54,106][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:15:59,114][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:04,117][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:09,120][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:14,176][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:19,182][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:24,184][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:29,188][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:34,196][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:39,200][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:44,203][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:49,205][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:54,214][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:16:59,233][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:04,235][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:09,241][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:14,245][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:19,252][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:24,260][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:29,277][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:34,290][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:39,294][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:44,298][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:49,307][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:54,312][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:17:59,320][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:18:04,336][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:18:09,339][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:18:14,341][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:18:19,344][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:18:24,346][  INFO][PID:1151792] Checking for cancel request
[2026-05-14 19:18:24,349][  INFO][PID:1151792] Calling cancel callback, and waiting for thread.join()
[2026-05-14 19:18:24,351][  INFO][PID:1151792] Canceling the build on the remote machine
[2026-05-14 19:18:27,978][  INFO][PID:1151792] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c122' (ED25519) to the list of known hosts.

[2026-05-14 19:18:27,979][ ERROR][PID:1151792] Build was canceled
[2026-05-14 19:18:27,999][  INFO][PID:1151792] VM Release request
[2026-05-14 19:18:28,026][WARNING][PID:1151792] Switching not-finished job state to 'failed'
[2026-05-14 19:18:28,028][  INFO][PID:1151792] Worker failed build, took 170.39917516708374
[2026-05-14 19:18:28,032][  INFO][PID:1151792] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "lizardbyte",
            "project_name": "pulls",
            "project_dirname": "pulls:pr:5118",
            "submitter": null,
            "ended_on": 1778786308.0267422,
            "started_on": 1778786137.627567,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": "x86_64",
            "buildroot_pkgs": null,
            "task_id": "10460958",
            "build_id": 10460958,
            "package_name": "Sunshine",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 9,
            "source_json": "{\"script\": \"#!/usr/bin/env bash\\nset -x\\nset -e\\n\\nresultdir=\\\"${COPR_RESULTDIR}\\\"\\ngit clone \\\"https://github.com/${COPR_OWNER}/${COPR_PACKAGE}.git\\\" --depth 1\\ncd \\\"${COPR_PACKAGE}\\\"\\n\\n# get info from the webhook payload\\nif [[ -z \\\"$REVISION\\\" ]]; then\\n  # the hook_payload file contains webhook JSON payload (copr creates it for us);\\n  # it is created only if the build is triggered by Custom webhook.\\n  if [[ -f \\\"$resultdir\\\"/hook_payload ]]; then\\n    git clone https://github.com/praiskup/copr-ci-tooling \\\\\\n      \\\"$resultdir/cct\\\" --depth 1\\n    export PATH=\\\"$resultdir/cct:$PATH\\\"\\n\\n    echo \\\"---\\\"\\n    cat \\\"$resultdir\\\"/hook_payload\\n    echo \\\"---\\\"\\n\\n    # use jq to get the pr_id from the hook_payload\\n    PR=$(jq -r '.pr_id // empty' \\\"$resultdir\\\"/hook_payload)\\n    if [[ -z \\\"$PR\\\" ]]; then\\n      BRANCH=\\\"master\\\"\\n    else\\n      BRANCH=\\\"pr/${PR}\\\"\\n    fi\\n\\n    copr-travis-checkout \\\"$resultdir\\\"/hook_payload\\n  fi\\nelse\\n  git checkout \\\"$REVISION\\\"\\nfi\\n\\n# read optional exclusions from .copr-ci config file\\n# each non-empty, non-comment line is treated as a submodule path or directory\\n# to exclude (relative to the repo root, e.g. \\\"third-party/build-deps\\\")\\nEXCLUDED_PATHS=()\\nif [[ -f \\\".copr-ci\\\" ]]; then\\n  echo \\\"Found .copr-ci config file, reading exclusions...\\\"\\n  while IFS= read -r line || [[ -n \\\"$line\\\" ]]; do\\n    # skip empty lines and comments\\n    [[ -z \\\"$line\\\" || \\\"$line\\\" =~ ^# ]] && continue\\n    EXCLUDED_PATHS+=(\\\"$line\\\")\\n    echo \\\"  Excluding: $line\\\"\\n  done < \\\".copr-ci\\\"\\nfi\\n\\n# initialize the submodules, skipping any excluded paths\\nif [[ ${#EXCLUDED_PATHS[@]} -gt 0 ]]; then\\n  # get all top-level submodule paths, then init only the ones not excluded\\n  mapfile -t TOP_SUBMODULES < <(git submodule status | awk '{print $2}')\\n\\n  for submodule in \\\"${TOP_SUBMODULES[@]}\\\"; do\\n    skip=false\\n    for excluded in \\\"${EXCLUDED_PATHS[@]}\\\"; do\\n      # match exact path or any path that starts with the excluded prefix\\n      if [[ \\\"$submodule\\\" == \\\"$excluded\\\" || \\\"$submodule\\\" == \\\"$excluded/\\\"* ]]; then\\n        skip=true\\n        break\\n      fi\\n    done\\n    if [[ \\\"$skip\\\" == false ]]; then\\n      git submodule update --init --recursive --depth 1 -- \\\"$submodule\\\"\\n    else\\n      echo \\\"Skipping submodule: $submodule\\\"\\n    fi\\n  done\\nelse\\n  git submodule update --init --recursive --depth 1\\nfi\\n\\n# get the tag of this commit IF it has one\\nTAG=$(git tag --points-at HEAD | head -n1)\\nif [[ -z \\\"$TAG\\\" ]]; then\\n  TAG=\\\"0.0.$PR\\\"\\nfi\\nTAG=\\\"${TAG#v}\\\"  # remove v prefix from the tag\\necho \\\"TAG=$TAG\\\"\\n\\n# get the commit\\nCOMMIT=$(git rev-parse HEAD)\\necho \\\"COMMIT=$COMMIT\\\"\\n\\n# move spec file to the correct location\\ndirectories=(\\n  \\\".\\\"\\n  \\\"./packaging/linux/copr\\\"\\n)\\nfor dir in \\\"${directories[@]}\\\"; do\\n  if [[ -f \\\"${dir}/${COPR_PACKAGE}.spec\\\" ]]; then\\n    echo \\\"Found spec file in ${dir}\\\"\\n    rpmlint \\\"${dir}/${COPR_PACKAGE}.spec\\\"\\n\\n    mv \\\"${dir}/${COPR_PACKAGE}.spec\\\" \\\"${resultdir}\\\"\\n    break\\n  fi\\ndone\\n\\n# fail if the spec file is not in the resultdir\\nif [[ ! -f \\\"${resultdir}/${COPR_PACKAGE}.spec\\\" ]]; then\\n  echo \\\"ERROR: ${COPR_PACKAGE}.spec not found\\\" >&2\\n  exit 1\\nfi\\n\\n# use sed to replace these values in the spec file\\nsed -i \\\"s|%global build_version 0|%global build_version ${TAG}|\\\" \\\"${resultdir}\\\"/*.spec\\nsed -i \\\"s|%global branch 0|%global branch ${BRANCH}|\\\" \\\"${resultdir}\\\"/*.spec\\nsed -i \\\"s|%global commit 0|%global commit ${COMMIT}|\\\" \\\"${resultdir}\\\"/*.spec\\n\\n# create a tarball of the source code, excluding any configured paths\\nTAR_EXCLUDE_ARGS=()\\nfor path in \\\"${EXCLUDED_PATHS[@]}\\\"; do\\n  TAR_EXCLUDE_ARGS+=(\\\"--exclude=./${path}\\\")\\ndone\\ntar -czf \\\"${resultdir}/tarball.tar.gz\\\" \\\"${TAR_EXCLUDE_ARGS[@]}\\\" .\\n\", \"chroot\": \"fedora-44-x86_64\", \"builddeps\": \"git jq python3 rpmlint\", \"resultdir\": \"\", \"repos\": \"\", \"tmp\": \"tmpkvsmlqjt\", \"hook_data\": true}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "lizardbyte/pulls--d007eaf0-f577-4daf-a956-5f230f2e053c",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": true,
            "distributions_in_build": [
                "fedora-42",
                "fedora-43",
                "fedora-44",
                "fedora-rawhide",
                "opensuse-leap-15.6"
            ],
            "distributions_in_project": [
                "fedora-42",
                "fedora-43",
                "fedora-44",
                "fedora-rawhide",
                "opensuse-leap-15.6"
            ],
            "destdir": "/var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lizardbyte/pulls:pr:5118",
            "result_dir": "10460958",
            "built_packages": "",
            "tags": [
                "arch_x86_64"
            ],
            "id": 10460958,
            "mockchain_macros": {
                "copr_username": "lizardbyte",
                "copr_projectname": "pulls",
                "vendor": "Fedora Project COPR (lizardbyte/pulls)"
            }
        }
    ]
}
[2026-05-14 19:18:28,094][  INFO][PID:1151792] Sending fedora-messaging bus message in build.end
[2026-05-14 19:18:28,136][  INFO][PID:1151792] Compressing /var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118/srpm-builds/10460958/builder-live.log by gzip
[2026-05-14 19:18:28,147][  INFO][PID:1151792] Running command 'gzip /var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118/srpm-builds/10460958/builder-live.log' as PID 1176641
[2026-05-14 19:18:28,187][  INFO][PID:1151792] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118/srpm-builds/10460958/builder-live.log)
[2026-05-14 19:18:28,188][  INFO][PID:1151792] Compressing /var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118/srpm-builds/10460958/backend.log by gzip
[2026-05-14 19:18:28,192][  INFO][PID:1151792] Running command 'gzip /var/lib/copr/public_html/results/lizardbyte/pulls:pr:5118/srpm-builds/10460958/backend.log' as PID 1176652