Migrations
/
ggml
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'experiments/blocking'
${ noResults }
ggml/examples/whisper
History
Georgi Gerganov 3afb833f84
wip : unsuccessful attempts speeding mul_mat using blocking 		2 years ago
..
CMakeLists.txt whisper : add C-style API 2 years ago
README.md whisper : various updates and improvements 2 years ago
convert-pt-to-ggml.py Adding Whisper inference example 2 years ago
main.cpp sync : whisper.cpp 2 years ago
whisper.cpp wip : unsuccessful attempts speeding mul_mat using blocking 2 years ago
whisper.h sync : whisper.cpp 2 years ago

README.md

whisper

Port of OpenAI's Whisper ASR model in C/C++ using ggml

More info

Checkout https://github.com/ggerganov/whisper.cpp

Memory usage

Model Disk Mem
tiny 75 MB ~240 MB
base 142 MB ~380 MB
small 466 MB ~970 MB
medium 1.5 GB ~2.5 GB
large 2.9 GB ~4.6 GB

ggml format

The original models are converted to a custom binary format. This allows to pack everything needed into a single file:

  • model parameters
  • mel filters
  • vocabulary
  • weights

For more details, see the conversion script convert-pt-to-ggml.py