Highlights Major performance work for attention-heavy LLMs. FlashAttention decode kernels were fused and extended for any sequence length (#28389). FlashAttention prefill shared-memory path was generalized (#28520). Dynamic max_k_step was enabled for NVIDIA (#28511). QKV bias support was added for FlashAttention in MultiHeadAttention (#28380). M4 Max-specific FlashAttention optimization landed (#2…
Announcements & Breaking Changes Upgraded to ONNX 1.22.0 and protobuf 6.33.5 (#28754, #29606, #28967). Graph optimizer opset version checks were updated accordingly (#28966). cuDNN and cuFFT are now optional at runtime for the CUDA EP, and nvrtc is no longer linked, which significantly reduces the required CUDA redistributable footprint (#29252, #29808, #29705, #29620). An experimental C/C++ API s…
This is a patch release on top of v1.27.0, containing targeted bug fixes, a CUDA QMoE decode-path optimization, and CI/build infrastructure fixes. Bug Fixes [MLAS] Fixed an igemm regression in the KleidiAI path (#28571) Fixed a QMoE CPU livelock by eliminating nested intra-op parallelism (#29081) Fixed a regression in graph-capture session initialization that rejected an empty graph (#29457) Fixed…
n.b. This release is targeting ONNX 1.21. ONNX 1.22 will be supported in ORT 1.28. n.b. This changelog was generated via LLM. Only the contributor list has been verified. As always, only trust the commit history. Announcements & Breaking Changes CUDA 12 package files are now explicitly named as such. CUDA 12 packages are deprecated, please move to CUDA 13 ASAP. Security Fixes Fixed out-of-bounds r…
We're excited to ship the first release of the WebGPU Execution Provider as a plugin EP for ONNX Runtime. Instead of being baked into the core onnxruntime binary, the WebGPU EP is now distributed as a standalone artifact that registers with an existing ONNX Runtime installation at runtime. Highlights Broad operator coverage on WebGPU. Native WebGPU kernels for the operators needed by common transf…
n.b. The following was generated via LLM from Git history. Only the contributor list has been verified. ONNX Runtime Release 1.26.0 Announcement - Breaking Changes Support for CUDA 12 will be removed in 1.27.0. CUDA 13 will continue to be published as onnxruntime-<os>-<arch>-gpu_cuda13-<version>.<ext> CUDA runtime will be moving soon to a dedicated Execution Provider (EP) instead of a published pa…
n.b. This changelog is LLM generated. Only the contributor listing has been verified. ONNX Runtime Release 1.25.1 📢 Announcements & Breaking Changes ONNX Op Updates Enhanced ONNX operator support with new opset versions: Reshape (opset 25), Transpose (opset 24) (#27752) ✨ New Features 📊 New ONNX Ops & Model Support LinearAttention and CausalConvState operators for Qwen3.5 model support (#27907) Ro…
📢 Announcements & Breaking Changes Build & Platform C++20 is now required to build ONNX Runtime from source. Minimum toolchains: MSVC 19.29+, GCC 10+, Clang 10+. Users of prebuilt packages are unaffected. (#27178) CUDA minimum version raised to 12.0 — CUDA 11.x is no longer supported. Users pinned to CUDA 11.x should stay on ORT 1.24.x or upgrade their CUDA toolkit/driver. (#27570) ONNX upgraded t…
This is a patch release for ONNX Runtime 1.24, containing bug fixes and execution provider updates. Bug Fixes Core: Added PCI bus fallback for Linux GPU device discovery in containerized environments (e.g., AKS/Kubernetes) where nvidia-drm is not loaded but GPU PCI devices are still exposed via sysfs. (#27591) Plugin EP: Fixed null pointer dereference when iterating output spans in GetOutputIndex.…
This is a patch release for ONNX Runtime 1.24, containing bug fixes, security improvements, performance enhancements, and execution provider updates. Security Fixes Core: Fixed GatherCopyData integer truncation leading to heap out-of-bounds read/write. (#27444) Core: Fixed RoiAlign heap out-of-bounds read via unchecked batch_indices. (#27543) Core: Prevent heap OOB from maliciously crafted Lora Ad…
This is a patch release for ONNX Runtime 1.24, containing several bug fixes, security improvements, and execution provider updates. Bug Fixes NuGet: Fixed native library loading issues in the ONNX Runtime NuGet package on Linux and macOS. (#27266) macOS: Fixed Java support and Jar testing on macOS ARM64. (#27271) Core: Enable Robust Symlink Support for External Data for Huggingface Hub Cache. (#27…
📢 Announcements & Breaking Changes Platform Support Changes Python 3.10 wheels are no longer published — Please upgrade to Python 3.11+ Python 3.14 support added Free-threaded Python (PEP 703) — Added support for Python 3.13t and 3.14t in Linux (#26786) x86_64 binaries for macOS/iOS are no longer provided and minimum macOS is raised to 14.0 API Version ORT_API_VERSION updated to 24 (#26418) ✨ New…
ORT 1.23.2 cherrypick 1 (#26368) Adds the following commits to the release-1.23.2 branch for ORT 1.23.2: - [TensorRT] Fix DDS output bug during engine update - PR: #26272 - commit id: 00e85dd - Fix shape inference failure with in-memory external data - PR: #26263 - commit id: d955476 - [CUDA] replace 90a-virtual by 90-virtual for forward compatible - PR: #26230 - commit id: b58911f - [QNN-EP] Fix…