1290fc6457
bench : add memcpy and ggml_mul_mat benchmarks
2 years ago
322f4e6c4e
go : bindings updated so they can be used in third party packages. ( #379 )
...
* Updated bindings so they can be used in third pary packages.
* Updated makefiles to set FMA flag on optionally, for xeon E5 on Darwin
2 years ago
a62170c656
ggml : add SSE3 and fp16 conversion lookup table ( #368 )
...
* Improves WASM performance:
On MacBook M1 Pro, I observe 25% faster using Firefox and 35% faster using Chrome
* Add support for SSE3 SIMD
* Add SSE3 to system information
* Add Imath support for fp16-fp32 conversions
* Add Imath to system information
* Wrap Imath calls to avoid static function warnings
* Drop Imath; Add lookup table for f16 -> f32 conversions
* Remove TODO comments
* Update SSE3 to new macro arguments
* Correct updated macro definitions
* Prefer static inline where possible
* ggml : static inlines + add public f16 <-> f32 conversions
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2 years ago
196d738974
minor : close #370 + Makefile build info print change
2 years ago
0be6a1afd9
make : print build information
2 years ago
9a8ad3db69
make : add i686 arch ( close #329 )
2 years ago
466ceebb78
ggml : add f16 acceleration for POWER9 ppc64le
2 years ago
1eb81f863f
make : revert accidental change of optimization flags
2 years ago
32fbc8cd04
main : add option to print the progress ( #276 )
2 years ago
3b1aacbe6d
talk : talk with AI in the terminal
2 years ago
832b4f34c9
make : indentation + .gitignore
2 years ago
0f98755fc5
Flag for Position Independent Code
2 years ago
04a16bbf11
fix compilation on haiku
2 years ago
9fe7306f4b
models : add the new "large" model release by OpenAI
...
The old "large" model is now renamed "large-v1".
If you have been using it, make sure to rename it and download the new
"large" model for best results.
2 years ago
9b7df68753
tests : adding transcription tests
2 years ago
e7f09a0a61
Fix Darwin flags - was incorrectly always using the Linux else clause
2 years ago
bc88eb13c6
examples : add "command" tool ( #171 )
2 years ago
fd113687aa
correct model name display on running samples
2 years ago
4b2f51b479
add gprof option
2 years ago
800ae5b808
fix AVX,AVX2,FMA,F16C detection on Linux and add flags for OpenBLAS
2 years ago
41b48ab7f1
make : add libwhisper.so target ( #144 )
2 years ago
9e700e1821
Check for AVX and AVX2 on Darwin
2 years ago
c63ce24834
Allow building with Accelerate for x86_64 Macs ( #123 )
...
* Cross compile windows
* set env properly
* rm log
* fix review
* Add back space
* Don't force architecture
* Allow building x86_64 with accelerate
2 years ago
24cd12f647
Cross compilation ( #121 )
...
* Cross compile windows
* set env properly
* rm log
* fix review
* Add back space
2 years ago
c6710efde2
refactoring : move main + stream in examples + other stuff
2 years ago
6b45e37b2b
Update README.md and finalize the whisper.wasm example
2 years ago
19a780afe5
added handling for falsely as x86_64 announced ARM Macs
2 years ago
b81a81d543
Link Accelerate framework to "stream" example
2 years ago
72d967bce4
Use Accelerate framework on Apple silicon
...
Huge performance improvement in the Encode (almost x2 on MacBook M1 Pro)
Also various extra optimizations:
- Multi-threaded NORM operator
- Faster GELU via F16 cast
2 years ago
0e858f080d
close #56 : build on FreeBSD
...
Thanks to @abelbabel for the contribution
2 years ago
64752acd27
add static library make target
2 years ago
5e563ef635
Fix Makefile for MacBook Intel
2 years ago
167324584b
wip : rpi4 support
2 years ago
ce1fe95902
wip : improve makefile
2 years ago
6b77124e01
Initial C-style interface for whisper.cpp
2 years ago
b6bf906730
ref #10 : quick-and-dirty attempt for real-time audio transciption
...
- Processes input in chunks of 3 seconds.
- Padding audio with silence
- Uses 1 second audio from previous pass
- No text context
2 years ago
3bcdbdfc32
Reduce memory usage even more + better sampling
...
- The encode/decode memory buffers are now reused
- If the 30-sec segment goes for too long without a timestamp token, we
force one. Improves transcription for large model
- Stereo support
- Add "micro-machines.wav" sample
2 years ago
d4fcfa47b0
Pass -pthread to linker
2 years ago
f888c2373d
Flash + language support (ref #2 )
...
- Achieved big performance improvement + memory usage reduction
- Can now translate / transcribe different languages
2 years ago
154fa796dd
ref #1 : add -pthread to compilation flags
2 years ago
476182e439
Update README.md and simplify usage
2 years ago
f2456f8d93
Create README.md
2 years ago
b0a11594ae
Initial release
2 years ago
Georgi Gerganov