Overview Maintenance release. Updates to ggml v0.26.0. Nightly build: b5454 More info: dist : releases and versioning of ggml-org projects Changelog since v1.9.4 d1be6fd whisper : bump version to 1.9.5 (#4102) 4afec37 talk-llama : update llama.cpp to v0.6.0 3d451ab sync : ggml 47f1c7d ggml : bump version to 0.26.0 (ggml/1652) e71b784 CUDA: make the alloc_deps check batch independent (llama/29986)…
No content.
Overview New version has been released. Nightly build: b5130 More info: dist : releases and versioning of ggml-org projects Changelog since v1.9.3 927cfce metal : remove leftover ggml-metal.metal kernels file (#4051) dd80eb2 scripts : use sed instead of grep for version parsing [no ci] (#4052) 1fa6dfa ci : update WoA CUDA 13.4 to use 13.4.1 GA (#4053) a2b36eb whisper : bump version to 1.9.4 (#4050…
metal : remove leftover ggml-metal.metal kernels file (#4051) This commit removes the ggml-metal.metal file that used to contain all the metal kernels. These have now been separated into separate kernels in ggml/src/ggml-metal/kernels and it seems that this file was not removed when synced with ggml. This is currently preventing whisper.cpp to be released as the release check fails.
Note: the Windows arm64 (CUDA) build (whisper-bin-win-cuda-*-arm64.zip) uses a preview edition of the CUDA Toolkit for Windows on Arm and should be considered experimental.
NoteSemantic versioning is still work in progress. More info can be found in https://github.com/ggml-org/ggml/discussions/1579 Nightly build: b4938 Change log since v1.9.2 371b5a7 release : v1.9.3 (#4000) 81c1905 cmake : update semver and release process [no ci] (#3996) 4834a23 talk-llama : sync llama.cpp 6b014cf sync : ggml 8189458 ggml : bump version to 0.20.2 (ggml/1589) 51319a2 CUDA: MMVQ nwar…
No content.
What's Changed sync : ggml by @ggerganov in #3896 include parakeet in build-xcframework.sh by @daaku in #3899 Fix pkgconfig configuration (Nix build failure) by @nmouha in #3894 examples : update model names in parakeet-cli README.md [no ci] by @danbev in #3906 examples: Fix argument flag for min speech duration in VAD by @QuantiusBenignus in #3907 sync : ggml by @ggerganov in #3912 examples : Imp…
What's Changed ci : add GGML_NATIVE=OFF and GGML_BMI2=OFF to windows-blas by @danbev in #3891 release : v1.9.1 by @danbev in #3892 Full Changelog: v1.9.0...v1.9.1
What's Changed ci : only trigger release jobs for tags by @danbev in #3883 parakeet : add support for NVIDIA Parakeet by @danbev in #3735 ruby : add support for Parakeet by @KitaitiMakoto in #3885 release : v1.9.0 by @danbev in #3886 Full Changelog: v1.8.7...v1.9.0
What's Changed Do not assume /usr/lib library installation. by @waptaff in #3693 server : merge split UTF-8 token text in verbose JSON by @lyonsno in #3850 whisper : catch C++ exceptions in whisper_init_with_params_no_state by @danscMax in #3831 ci : refactor + optimize by @ggerganov in #3847 ci : only publish/push docker images daily by @danbev in #3854 ci : use ccache instead of sccache for wind…
What's Changed common : re-implement ffmpeg-transcode.cpp + clarify ffmpeg usage by @ggerganov in #3846 ci : fix path to whisper.h in examples.yml [no ci] by @danbev in #3842 Full Changelog: v1.8.5...v1.8.6
Overview Maintenance release + performance improvements all around: https://github.com/ggml-org/whisper.cpp/blob/master/scripts/bench-all-gg.txt What's Changed ruby : fix dangling pointers, memory leak, and SEGV on parallel transcription by @KitaitiMakoto in #3715 sync : ggml by @ggerganov in #3730 vad : add streaming detect + explicit state reset by @danielbodart in #3677 bench : sync submit-resu…
Overview Maintenance release, latest ggml, some performance gains across the board. What's Changed Fix: UTF-8 character cut off to two "�" in segment wrapping (max_len) by @lordofriver in #3592 examples: add -g/--gpu-device option and GPU_DEVICE env support by @brauliobo in #3557 sync : ggml by @ggerganov in #3636 Fix macOS dSYM path case mismatch in XCFramework build by @friederbluemle in #3630 r…
Overview Maintenance release, latest ggml, minor improvements in the tools/server/bindings. What's Changed server : set no_context == true by @ggerganov in #3482 WASM example broken for Hebrew by @Orel-A in #3487 ruby : tiny bug fix by @KitaitiMakoto in #3490 12x Performance Boost with Integrated Graphics by @OrelSokolov in #3492 ruby : VAD separately from ASR by @KitaitiMakoto in #3518 vad : Sile…
Overview Fix a bug in the ggml norm CPU scalar operator What's Changed sync : ggml by @ggerganov in #3478 Full Changelog: v1.8.1...v1.8.2
Overview Fix Vulkan builds Fix memory leaks when using VAD Support --carry-initial-prompt What's Changed bindings-java : disable flash attention by default by @danbev in #3445 ruby : Loose RegExp of a test to follow change of flash attension default by @KitaitiMakoto in #3448 vad : fix memory leaks in VAD implementation by @danbev in #3453 ruby : Bump Ruby bindings' version to 1.3.4 by @KitaitiMak…
Overview Flash attention is now enabled by default Performance improvements M1 Pro CPU Config Model Th FA Enc. Dec. Bch5 PP Commit M1 Pro METAL tiny 1 0 32.44 1.71 0.43 0.04 8a67c55 M1 Pro METAL base 1 0 63.54 2.62 0.71 0.06 8a67c55 M1 Pro METAL small 1 0 200.30 5.34 1.72 0.17 8a67c55 M1 Pro METAL medium 1 0 580.06 11.71 4.18 0.45 8a67c55 CPU Config Model Th FA Enc. Dec. Bch5 PP Commit M1 Pro META…