Update README.md

pull/72/head
Georgi Gerganov 2 years ago committed by GitHub
parent 744bd47685
commit 81c185576c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -252,9 +252,18 @@ the framwork utilizes the special-purpose AMX coprocessor available in modern Ap
## Limitations
- Very basic greedy sampling scheme - always pick up the top token. You can implement your own strategy
- Inference only
- No GPU support
- Very basic greedy sampling scheme - always pick up the token with highest probability.
This should be similar to the [GreedyDecoder](https://github.com/openai/whisper/blob/main/whisper/decoding.py#L249-L274)
from the original python implementation, so in order to make a fair comparison between the 2 implementations, make sure
to run the python code with the following parameters:
```
whisper --best_of 1 --beam_size 1 ...
```
In the future, `whisper.cpp` will support more sampling strategies.
## Memory usage

Loading…
Cancel
Save