llama.cpp adds pre-compiled binaries for CUDA 13.3 and ROCm 7.2

{
  "event_id": "event_de84fc5e1f14eb5c",
  "topic_id": "gpu_supply_and_compute_market",
  "event_type": "Release",
  "event_time": "2026-05-29T12:08:22Z",
  "title": "llama.cpp adds pre-compiled binaries for CUDA 13.3 and ROCm 7.2",
  "summary": "The b9405 release of llama.cpp introduces official pre-compiled binaries for Windows with CUDA 13.3 and Ubuntu with ROCm 7.2, while temporarily disabling SYCL and KleidiAI builds, aligning the inference engine with the latest GPU compute stacks.",
  "contribution": "Provides out-of-the-box inference binaries for the latest NVIDIA and AMD compute platforms and updates OpenVINO, reducing setup friction for users on newer hardware while pausing support for specific Intel and Apple optimization backends.",
  "impact": "Developers and operators using the latest NVIDIA or AMD GPUs can now deploy llama.cpp using official pre-compiled binaries without building from source, avoiding complex toolchain setup and driver mismatches. This release adds CUDA 13.3 and ROCm 7.2 builds alongside OpenVINO 2026.0, but disables SYCL and KleidiAI backends, which may disrupt existing Intel XPU or optimized Apple Silicon workflows until those builds are restored.",
  "maturity": "Production",
  "confidence": 0,
  "importance_score": 0.75,
  "risk_flags": [
    "Sycl Backend Disabled",
    "Kleidiai Backend Disabled",
    "New Cuda Version Adoption"
  ],
  "evidence_count": 1
}