You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ggml/examples/whisper
Georgi Gerganov d8f64bce3d
Improve mul_mat performance for big matrices using Accelerate framework
2 years ago
..
CMakeLists.txt whisper : add C-style API 2 years ago
README.md Improve mul_mat performance for big matrices using Accelerate framework 2 years ago
convert-pt-to-ggml.py
main.cpp sync : whisper.cpp 2 years ago
whisper.cpp Improve mul_mat performance for big matrices using Accelerate framework 2 years ago
whisper.h sync : whisper.cpp 2 years ago

README.md

whisper

Port of OpenAI's Whisper ASR model in C/C++ using ggml

More info

Checkout https://github.com/ggerganov/whisper.cpp

Memory usage

Model Disk Mem
tiny 75 MB ~280 MB
base 142 MB ~430 MB
small 466 MB ~1.0 GB
medium 1.5 GB ~2.6 GB
large 2.9 GB ~4.7 GB

ggml format

The original models are converted to a custom binary format. This allows to pack everything needed into a single file:

  • model parameters
  • mel filters
  • vocabulary
  • weights

For more details, see the conversion script convert-pt-to-ggml.py