c3991bbb24
Update README.md
2 years ago
fafd78945d
bench.wasm : print system info
2 years ago
8de452c18b
Improve decoding ( #291 )
...
* whisper : prepare infra for new decoding strategies
* whisper : apply logit filters and compute logprobs
* whisper : add whisper_get_logits()
* whisper : separate self and cross attention memory
Initial step needed for supporting parallel decoders
* whisper : move probs_id buffer to whisper_context
* whisper : refactor kv cache into separate struct
* whisper : move self-attention kv cache to whisper_decoder
* whisper : wip decoding parameters + strategies
* whisper : wip decoding parameters + strategies (part 2)
* whisper : wip decoding parameters + strategies (part 3)
* whisper : wip decoding parameters + strategies (part 4)
* whisper : fix prompt_past update to not include prompt_init
* whisper : temperature + best_of support
* whisper : support for compression_ration_threshold
We actually use entropy, but it is similar
* command : fix example to use logits instead of obsolete probs
* whisper : handle empty sequence ranking
* whisper : add WHISPER_DEBUG + diagnostic prints + new main args
* whisper : minor fixes
* whisper : add beam-search support
* whisper : bug fix when there no previous context
* whisper : add comments
* stream : disable temperature fallback
For real-time processing, we always want a single decoder running at T=0
* whisper.swiftui : update example - fix paths + add empty folders
2 years ago
a6dbd9188b
stream : fix a bug that inserted a lot of empty audio at the start
...
The quality was terrible due to this
2 years ago
1512545149
whisper : add loader class to allow loading from buffer and others ( #353 )
...
* whisper : add loader to allow loading from other than file
* whisper : rename whisper_init to whisper_init_from_file
* whisper : add whisper_init_from_buffer
* android : Delete local.properties
* android : load models directly from assets
* whisper : adding <stddef.h> needed for size_t + code style
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2 years ago
52a3e0c92a
ggml : improve vec_dot_f16 unrolling in flash_attn_f16
2 years ago
d1ea1220ff
command : clean-up / refactoring / formatting ( #383 )
2 years ago
9c4a1522f6
command : always-prompt mode ( #383 )
2 years ago
87dd4a3081
talk.wasm : bump memory usage + update whisper.js
2 years ago
6b351bb669
command : add "guided-mode" video demo in the README.md
2 years ago
b3c865083e
ci : add emscripten build
2 years ago
a0d4f8e65c
main : make whisper_print_segment_callback() more readable ( close #371 )
2 years ago
196d738974
minor : close #370 + Makefile build info print change
2 years ago
84c6b42e65
cmake : update to 3.19 ( #351 )
...
- update from 3.0 (from 2014) to 3.19 (from 2020)
- move some global setting onto the targets (through a cmake include)
2 years ago
a466c3404d
stream : fix data race on bool + avoid division-by-zero
2 years ago
f00509d57c
command : refactor to split command list & general transcription modes ( #331 )
...
This makes it easier to understand if you're looking for only one of the capabilities.
2 years ago
a593b932e4
main : add -ocsv, aka --output-csv to output a CSV file
...
Adds -ocsv, aka --output-csv feature to examples/main, which outputs a CSV file containing lines formatted as follows <startTime-in-integer-milliseconds>, <endTime-in-integer-milliseconds>, "<transcript-line-including-commas>".
2 years ago
331c0bbddc
examples : fix memory leak on failure to load gpt2 model ( #323 )
2 years ago
dc90efd504
examples : small code cleanups ( #322 )
...
- remove unnecessary initialization of string to ""
- use empty() instead of checking size()
- use emplace_back instead of push_back
- use nullptr instead of NULL
- remove unnecessary call to .data() on string
- use character overload of find_first_of() instead of passing a string
2 years ago
0f4227d9ee
examples : add whisper.swiftui demo app ( #308 )
...
* Add SwiftUI demo project.
* Add -DGGML_USE_ACCELERATE
2 years ago
91fc08c641
Build a vfpv4 library for armeabi-v7a and do runtime detection to select the right library
2 years ago
e1432dd91a
Check for both __ARM_NEON and __ARM_FEATURE_FMA so that the project can be compiled for armv7a.
...
Android armeabi-v7a's NEON support doesn't support FMA unless configured with `-mfpu=neon-fp-armv8`, which would need runtime checks.
* Also removed ABI filter from Android project.
2 years ago
22193cbfe8
Bump NDK version
2 years ago
90564f85f9
Update README.md
2 years ago
99da1e5cc8
cmake : enable and fix -Wall -Wextra -Wpedantic C++ warnings
2 years ago
8e3f129b4d
minor : resolves some of warnings when compiling with clang/clang++ ( #294 )
...
* Resolves some of warnings when compiling with clang/clang++
Mostly nit stuff that clang catches when compiling with -Wall -Wextra
-pedantic.
- Fix comparison between sign/unsigned integers.
- Passes a constant reference (const&) instead of copying each time.
* minor : normalize coding style
* minor : fix warning
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2 years ago
fba10a4c68
whisper : language auto-detect ( #59 )
2 years ago
32fbc8cd04
main : add option to print the progress ( #276 )
2 years ago
b8065d90f5
main : add "--prompt" command line argument ( #90 )
...
This allows to provide an initial prompt to be used at the start of the
processing.
2 years ago
4312995974
command : better indentation
2 years ago
5eeeb3412d
command : update README, show how to use guided mode
2 years ago
6a69e3ae27
command : adding guided mode
2 years ago
ea19ed33f1
Update README.md ( #46 )
...
Add references to the new Android app
2 years ago
675e787171
Add Android sample ( #277 )
...
* Add Android sample
* Use main project C files
* Stop existing playback before starting new playback
* Make text scrollable
* Stop playback when starting to record
* Remove extra var
2 years ago
a82d331034
stream : update README.md + comments
2 years ago
5a5c5ddcca
Update README.md
2 years ago
34e0b4b9ef
stream : fix build
2 years ago
b0f8013eb9
stream : add sliding window mode
2 years ago
a613f16aec
talk : improve prompting
2 years ago
f309f97df6
Node.js package ( #260 )
...
* npm : preparing infra for node package
* npm : package infra ready
* npm : initial version ready
* npm : change name to whisper.cpp
whisper.js is taken
2 years ago
aa6adda26e
talk : make compatible with c++11 (part 2)
2 years ago
444349f4ec
talk : make compatible with c++11
2 years ago
6ed786957e
Add newline per segment for text output ( #254 )
2 years ago
fcf515de60
bench.wasm : same as "bench" but runs in the browser ( #89 )
2 years ago
85c9ac18b5
Update README.md
2 years ago
b7c85d1ea6
talk : fix build for MSVC
2 years ago
3b1aacbe6d
talk : talk with AI in the terminal
2 years ago
56822621a8
twitch.sh : various fixes and polishing
...
- check if streamlink is installed
- fix audio chunking
- change default threads to 4
2 years ago
9e5f3ddc16
Allow for Twitch.tv live transcription
...
We rely on streamlink library to give us a stream, then we proceed similarly to
the radio livestream example.
2 years ago
47afb93c3c
yt-wsp.sh : improve usage instructions
2 years ago
Georgi Gerganov