62205aedb9
ggml : refactor the scratch buffer storage
2 years ago
d922aa4aef
ggml : reuse ggml_new_i32
2 years ago
4e0e2520f0
whisper : fix FF + remove it from README
2 years ago
42d7dee4c2
whisper : use whisper_context functions instead of macros
2 years ago
79148a2166
whisper : fix encoder memory usage
2 years ago
6cae05bd0c
whisper : update memory usage for all models
2 years ago
1a1dee46ce
whisper : use scratch buffers during inference (base model only)
2 years ago
0ba91b5452
ggml : error on scratch buffer overflow
2 years ago
18210579e4
ggml : bug fix in ggml_repeat()
2 years ago
0eea547ab3
ggml : support for scratch ring-buffer
2 years ago
60eff46b0a
ggml : add "scratch" buffer support
2 years ago
291980369c
whisper : suppress task tokens ( #442 )
2 years ago
86ef64a855
wasm : fix typo in helper.js ( #459 )
2 years ago
3b1960520a
main : CSV format export trimmed spaces fix ( #444 )
...
* Update main.cpp
Removed string trimming
* Update main.cpp
* Update main.cpp
* Revert "Update main.cpp"
This reverts commit d8924fdcfe252e508d85
2 years ago
2bee2650c6
go : add wrapper for system info ( #456 )
2 years ago
beb9512be3
go : add WhisperLangAutoDetect method to go binding ( #451 )
2 years ago
47737b2e82
livestream.sh : run main with model arg instead of default ( #453 )
...
Actually utilizes the $model var when calling ./main.
2 years ago
b992f3709e
whisper : do not provide past prompt when n_max_text_ctx == 0
2 years ago
60337f5306
wasm : check if navigator.storage.estimate() is available
...
Safari does not support it
2 years ago
02c7516c57
go : added wrappers to reset and print timings ( #436 )
2 years ago
411ea9b833
ci : run workflows on pull requests + bindings depend on .h ( #446 )
2 years ago
11f61cecd6
whisper.wasm : add labels for easier radio selection ( #435 )
2 years ago
b5ddb16ec7
whisper : condition timestamps to be monotonically increasing ( #425 )
2 years ago
ae16c21e9c
whisper : PPC64 big-endian support ( #398 )
...
* ggml : set cache line size to 128 on POWER9
* whisper : add PPC64 big endian support
2 years ago
2c3f50a021
release : v1.1.1
2 years ago
9a65269a20
.gitignore : add arm_neon.h
2 years ago
78f166174f
whisper : fix condition for providing past prompt (critical)
...
This bug has been present since v1.1.0.
Effectively, the past transcribed text wasn't being used for following
transcriptions, which likely significantly reduces the transcription
quality.
Likely related to #419
2 years ago
21c569ba4a
whisper : extend information in whisper_print_timings()
2 years ago
1a91c19af9
whisper : perform entropy check only when we have at least 32 tokens ( #412 )
2 years ago
f583e2d2f5
main : we had accidentally disabled the temperature fallback .. ( #291 )
2 years ago
206fc93396
whisper.wasm : add small and small.en models
2 years ago
a6cf6f4c4a
bench : minor fixes
2 years ago
472a473fd1
main : add an option to accept optional output filenames ( #424 )
...
* Add an option to accept optional output filenames
* Format the file
Co-authored-by: Chia-Hsiang Cheng <gary.chiahsiang.cheng@gmail.com>
2 years ago
9ba66c2fad
stream : fix handling of --step == --length ( #416 )
2 years ago
1ccb8a46a5
bench : fix Windows linkage by moving ggml benches in whisper lib ..
2 years ago
1290fc6457
bench : add memcpy and ggml_mul_mat benchmarks
2 years ago
49b529ba74
whisper.android : add support for loading directly from asset in C ( #415 )
2 years ago
8088a977af
whisper : fix possible uninitialized variables ( #291 )
2 years ago
c9aeb33676
stream : fix --keep_context argument to be used correctly ( #354 )
2 years ago
4a3f0d3fe9
go : remove sample_best and sample_timestamp bindings ( #409 )
2 years ago
874bde887e
Update README.md
2 years ago
8738427dd6
cmake : bump version to 1.1.0
2 years ago
c3991bbb24
Update README.md
2 years ago
00ea21668b
whisper : account speed_up flag for short audio ( close #405 )
2 years ago
0b85e8c401
Update README.md
2 years ago
fafd78945d
bench.wasm : print system info
2 years ago
8de452c18b
Improve decoding ( #291 )
...
* whisper : prepare infra for new decoding strategies
* whisper : apply logit filters and compute logprobs
* whisper : add whisper_get_logits()
* whisper : separate self and cross attention memory
Initial step needed for supporting parallel decoders
* whisper : move probs_id buffer to whisper_context
* whisper : refactor kv cache into separate struct
* whisper : move self-attention kv cache to whisper_decoder
* whisper : wip decoding parameters + strategies
* whisper : wip decoding parameters + strategies (part 2)
* whisper : wip decoding parameters + strategies (part 3)
* whisper : wip decoding parameters + strategies (part 4)
* whisper : fix prompt_past update to not include prompt_init
* whisper : temperature + best_of support
* whisper : support for compression_ration_threshold
We actually use entropy, but it is similar
* command : fix example to use logits instead of obsolete probs
* whisper : handle empty sequence ranking
* whisper : add WHISPER_DEBUG + diagnostic prints + new main args
* whisper : minor fixes
* whisper : add beam-search support
* whisper : bug fix when there no previous context
* whisper : add comments
* stream : disable temperature fallback
For real-time processing, we always want a single decoder running at T=0
* whisper.swiftui : update example - fix paths + add empty folders
2 years ago
a6dbd9188b
stream : fix a bug that inserted a lot of empty audio at the start
...
The quality was terrible due to this
2 years ago
4ef3398e8f
ggml : remove obsolete zeroing + comment fixes ( #390 )
2 years ago
5e9f33596f
readme : clarify main and stream usage ( #391 )
...
Give an example of ./main that uses a sample file that's already there, and make the stream example clarify you need `make stream`
2 years ago
Georgi Gerganov