Valentyn Bezshapkin
b1e85a79ca
Merge 63a8b00d88
into 1808ee0500
2 years ago
Georgi Gerganov
c80e2a8f2a
Revert "10% performance boost on ARM"
...
This reverts commit 113a9e83eb
.
There are some reports for illegal instruction.
Moved this stuff to vdotq_s32 branch until resolve
2 years ago
Georgi Gerganov
54a0e66ea0
Check for vdotq_s32 availability
2 years ago
Georgi Gerganov
543c57e991
Ammend to previous commit - forgot to update non-QRDMX branch
2 years ago
Georgi Gerganov
113a9e83eb
10% performance boost on ARM
2 years ago
valentynbez
63a8b00d88
fix: older standard for compatibility
2 years ago
Sebastián A
eb062bb012
Windows fixes ( #31 )
...
* Apply fixes suggested to build on windows
Issue: https://github.com/ggerganov/llama.cpp/issues/22
* Remove unsupported VLAs
* MSVC: Remove features that are only available on MSVC C++20.
* Fix zero initialization of the other fields.
* Change the use of vector for stack allocations.
2 years ago
valentynbez
526ddc0101
fix: add POSIX functionality for Linux compilation
2 years ago
Georgi Gerganov
f1eaff4721
Add AVX2 support for x86 architectures thanks to @Const-me !
2 years ago
Georgi Gerganov
007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage
2 years ago
Georgi Gerganov
26c0846629
Initial release
2 years ago