Skip to content

feat: native multi-backend inference support (Metal/ROCm/CUDA/CPU) + GitHub Actions build pipeline #1

feat: native multi-backend inference support (Metal/ROCm/CUDA/CPU) + GitHub Actions build pipeline

feat: native multi-backend inference support (Metal/ROCm/CUDA/CPU) + GitHub Actions build pipeline #1

Re-run triggered April 7, 2026 08:43
Status Cancelled
Total duration 51m 54s
Artifacts 3

build-inference.yml

on: pull_request
metal (macos-latest)
4m 18s
metal (macos-latest)
Matrix: build-linux
Fit to window
Zoom out
Zoom in

Annotations

5 errors and 5 warnings
cpu (ubuntu-latest)
buildx failed with: ERROR: failed to build: failed to solve: process "/bin/sh -c git clone https://github.com/ggml-org/llama.cpp /llama.cpp && mkdir -p /llama.cpp/tmp && cd /llama.cpp && case \"$GGML_BACKEND\" in cuda) CMAKE_EXTRA=\"-DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=${CUDA_ARCHITECTURES}\" ;; rocm) CMAKE_EXTRA=\"-DGGML_HIP=ON -DAMDGPU_TARGETS=gfx906;gfx908;gfx90a;gfx1030;gfx1100\" ;; *) CMAKE_EXTRA=\"\" ;; esac && cmake -B build -DBUILD_SHARED_LIBS=OFF ${CMAKE_EXTRA} && cmake --build build --config Release -j$(nproc)" did not complete successfully: exit code: 128
rocm (ubuntu-latest)
buildx failed with: ERROR: failed to build: failed to solve: process "/bin/sh -c git clone https://github.com/ggml-org/llama.cpp /llama.cpp && mkdir -p /llama.cpp/tmp && cd /llama.cpp && case \"$GGML_BACKEND\" in cuda) CMAKE_EXTRA=\"-DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=${CUDA_ARCHITECTURES}\" ;; rocm) CMAKE_EXTRA=\"-DGGML_HIP=ON -DAMDGPU_TARGETS=gfx906;gfx908;gfx90a;gfx1030;gfx1100\" ;; *) CMAKE_EXTRA=\"\" ;; esac && cmake -B build -DBUILD_SHARED_LIBS=OFF ${CMAKE_EXTRA} && cmake --build build --config Release -j$(nproc)" did not complete successfully: exit code: 2
cuda (ubuntu-latest)
The run was canceled by @lmangani.
cuda (ubuntu-latest)
The operation was canceled.
Build Inference Images
The run was canceled by @lmangani.
cpu (ubuntu-latest)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, docker/build-push-action@v6, docker/metadata-action@v5, docker/setup-buildx-action@v3. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
metal (macos-latest)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
metal (macos-latest)
cmake 4.3.1 is already installed and up-to-date. To reinstall 4.3.1, run: brew reinstall cmake
rocm (ubuntu-latest)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, docker/build-push-action@v6, docker/metadata-action@v5, docker/setup-buildx-action@v3. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
cuda (ubuntu-latest)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, docker/build-push-action@v6, docker/metadata-action@v5, docker/setup-buildx-action@v3. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Node.js 20 will be removed from the runner on September 16th, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
audiohacking~ATLAS~CN9W1C.dockerbuild
33.2 KB
sha256:8014ee705e24275009baf29620686ae4ca232232a992d451401897c2007a1f92
audiohacking~ATLAS~LG652C.dockerbuild
27.7 KB
sha256:1dbb7ea5c8dd0ab7b80f36915a447b8b5a6a9d4b2cf5fb7633fec5e85b226615
llama-server-metal-macos-arm64
8.74 MB
sha256:4d600b085f71989b197b12f9cf774e16e005366c6a655cd6f8b8a7bfbd79347d