32d1a7b652
whisper.android: Support benchmark for Android example.
2 years ago
373043cabe
whisper : zero-initialize some more context variables
...
Just in case
2 years ago
fb4d0d470f
whisper : fix uninitialized exp_n_audio_ctx
2 years ago
0d229163bb
whisper : add API for applying custom logits filters during decoding
2 years ago
a94897bcde
whisper : by default disable non-speech tokens suppression ( #473 )
...
This seems to be causing hallucinations in the end of the audio, e.g.:
"Thank you for listening"
"Amen"
..
2 years ago
0336161b7d
whisper : fix signedness compiler warning ( #506 )
2 years ago
cfc06bf8df
whisper : suppress non-speech-related token outputs ( #473 )
...
* add non-speech-token suppression
* add suppress non-speech_tokens param
2 years ago
2bfe0ebc0f
whisper : fixed Beam Search Strategy and exposed whisper_pcm_to_mel_phase_vocoder ( #474 )
...
Co-authored-by: Sandro Hanea <sandrohanea@microsoft.com>
2 years ago
4dd7119deb
whisper : only trim if split_on_word is true ( #476 )
2 years ago
a1c1583cc7
whisper : add whisper_full_lang_id() for getting the context lang ( #461 )
2 years ago
d012b5c7e4
whisper : add "split_on_word" flag when using using "max_len" option ( #455 )
...
* Update whisper.cpp
* fix: trim function
* feat: added flag to split on word
* fix: arguments for main
2 years ago
f3ee4a9673
whisper : reduce memory usage during inference ( #431 )
...
* ggml : add "scratch" buffer support
* ggml : support for scratch ring-buffer
* ggml : bug fix in ggml_repeat()
* ggml : error on scratch buffer overflow
* whisper : use scratch buffers during inference (base model only)
* whisper : update memory usage for all models
* whisper : fix encoder memory usage
* whisper : use whisper_context functions instead of macros
* whisper : fix FF + remove it from README
* ggml : reuse ggml_new_i32
* ggml : refactor the scratch buffer storage
* whisper : reorder scratch buffers in the decoder
* main : add option to disable temp fallback
* Update README.md
2 years ago
291980369c
whisper : suppress task tokens ( #442 )
2 years ago
b992f3709e
whisper : do not provide past prompt when n_max_text_ctx == 0
2 years ago
b5ddb16ec7
whisper : condition timestamps to be monotonically increasing ( #425 )
2 years ago
ae16c21e9c
whisper : PPC64 big-endian support ( #398 )
...
* ggml : set cache line size to 128 on POWER9
* whisper : add PPC64 big endian support
2 years ago
78f166174f
whisper : fix condition for providing past prompt (critical)
...
This bug has been present since v1.1.0.
Effectively, the past transcribed text wasn't being used for following
transcriptions, which likely significantly reduces the transcription
quality.
Likely related to #419
2 years ago
21c569ba4a
whisper : extend information in whisper_print_timings()
2 years ago
1a91c19af9
whisper : perform entropy check only when we have at least 32 tokens ( #412 )
2 years ago
a6cf6f4c4a
bench : minor fixes
2 years ago
1ccb8a46a5
bench : fix Windows linkage by moving ggml benches in whisper lib ..
2 years ago
8088a977af
whisper : fix possible uninitialized variables ( #291 )
2 years ago
00ea21668b
whisper : account speed_up flag for short audio ( close #405 )
3 years ago
8de452c18b
Improve decoding ( #291 )
...
* whisper : prepare infra for new decoding strategies
* whisper : apply logit filters and compute logprobs
* whisper : add whisper_get_logits()
* whisper : separate self and cross attention memory
Initial step needed for supporting parallel decoders
* whisper : move probs_id buffer to whisper_context
* whisper : refactor kv cache into separate struct
* whisper : move self-attention kv cache to whisper_decoder
* whisper : wip decoding parameters + strategies
* whisper : wip decoding parameters + strategies (part 2)
* whisper : wip decoding parameters + strategies (part 3)
* whisper : wip decoding parameters + strategies (part 4)
* whisper : fix prompt_past update to not include prompt_init
* whisper : temperature + best_of support
* whisper : support for compression_ration_threshold
We actually use entropy, but it is similar
* command : fix example to use logits instead of obsolete probs
* whisper : handle empty sequence ranking
* whisper : add WHISPER_DEBUG + diagnostic prints + new main args
* whisper : minor fixes
* whisper : add beam-search support
* whisper : bug fix when there no previous context
* whisper : add comments
* stream : disable temperature fallback
For real-time processing, we always want a single decoder running at T=0
* whisper.swiftui : update example - fix paths + add empty folders
3 years ago
4ef3398e8f
ggml : remove obsolete zeroing + comment fixes ( #390 )
3 years ago
08dc705a69
whisper : fix sample_to_timestamp calculation with 64 bit precision to avoid overflow ( #388 )
...
* Do calculation with 64 bit precision to avoid overflow
* Update whisper.cpp
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
3 years ago
1512545149
whisper : add loader class to allow loading from buffer and others ( #353 )
...
* whisper : add loader to allow loading from other than file
* whisper : rename whisper_init to whisper_init_from_file
* whisper : add whisper_init_from_buffer
* android : Delete local.properties
* android : load models directly from assets
* whisper : adding <stddef.h> needed for size_t + code style
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
3 years ago
65fdcbbbbb
whisper : revert accidental MB change
3 years ago
d61d55cd4b
ggml : speed-up soft max via Accelerate + unroll
3 years ago
a62170c656
ggml : add SSE3 and fp16 conversion lookup table ( #368 )
...
* Improves WASM performance:
On MacBook M1 Pro, I observe 25% faster using Firefox and 35% faster using Chrome
* Add support for SSE3 SIMD
* Add SSE3 to system information
* Add Imath support for fp16-fp32 conversions
* Add Imath to system information
* Wrap Imath calls to avoid static function warnings
* Drop Imath; Add lookup table for f16 -> f32 conversions
* Remove TODO comments
* Update SSE3 to new macro arguments
* Correct updated macro definitions
* Prefer static inline where possible
* ggml : static inlines + add public f16 <-> f32 conversions
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
3 years ago
1944e7c33e
whisper : document POWER VSX support
3 years ago
ad2a4ffa03
whisper : do not use F16 tensors when in F32 mode ( #369 )
3 years ago
dd6d582977
whisper : use ranged-based for loops for readability
3 years ago
d51c5eb906
ggml : define MIN / MAX only if not defined (minor)
3 years ago
d97e6005e9
whisper : add whisper_n_audio_ctx and check for invalid audio_ctx
...
closes #344
3 years ago
68daf6e487
whisper : avoid some memory allocations
3 years ago
ac521a566e
ggml : simplify the SIMD code ( #324 )
...
* ggml : simplify the SIMD code
* ggml : generic reduce for all register sizes + comments
3 years ago
543bd5627e
whisper : use emplace_back in place of push_back ( #319 )
...
This avoids potential construction of temporaries.
3 years ago
62fee9a9cc
whisper : fix mem leak on failure to load model ( #318 )
3 years ago
fa463313ad
minor : small code cleanups ( #302 )
...
* Small code cleanups
- fix indentation
- remove extra semicolons
- remove extra break after returns in case statements
- remove unnecessary call to .data() on string
- use empty() instead of checking size()
- no need to check for nullptr before free
- remove unnecessary initialization of string to ""
* minor : switch case always break
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
3 years ago
501a6b455c
minor : flag "ARM FMA" -> "ARM_FMA"
3 years ago
e1432dd91a
Check for both __ARM_NEON and __ARM_FEATURE_FMA so that the project can be compiled for armv7a.
...
Android armeabi-v7a's NEON support doesn't support FMA unless configured with `-mfpu=neon-fp-armv8`, which would need runtime checks.
* Also removed ABI filter from Android project.
3 years ago
42c6730732
whisper : use nullptr (C++11) instead of NULL macro ( #299 )
3 years ago
99da1e5cc8
cmake : enable and fix -Wall -Wextra -Wpedantic C++ warnings
3 years ago
8e3f129b4d
minor : resolves some of warnings when compiling with clang/clang++ ( #294 )
...
* Resolves some of warnings when compiling with clang/clang++
Mostly nit stuff that clang catches when compiling with -Wall -Wextra
-pedantic.
- Fix comparison between sign/unsigned integers.
- Passes a constant reference (const&) instead of copying each time.
* minor : normalize coding style
* minor : fix warning
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
3 years ago
fba10a4c68
whisper : language auto-detect ( #59 )
3 years ago
6a69e3ae27
command : adding guided mode
3 years ago
bf69b669a0
whisper : add whisper_tokenize()
...
Tokenizes a string into a list of vocabulary tokens
3 years ago
6a7c82501e
whisper : improve decoding strategy ( #244 )
...
- Clear past prompt when there is very short audio left for processing.
My observation is that in these cases the decoding tends to repeat and
hallucinate stuff and I think this is induced by the existing prompt
- When we fail to sample timestamp token, retry by clearing the past
prompt. If it fails again, then we advance the window by 1 second
3 years ago
124c718c73
whisper : fix UB when reading buffer of length 0 bytes ( #265 )
3 years ago
tinoue