15 Commits (e10cdad0550762c56a92786ff5d1f7e6a510403c)

Author SHA1 Message Date
uint256_t e10cdad055
Merge efaa30ef11 into 1808ee0500
2 years ago
Matvey Soloviev a169bb889c Gate signal support on being on a unixoid system. (#74)
2 years ago
maekawatoshiki efaa30ef11
Use vector
2 years ago
Matvey Soloviev 460c482540 Fix token count accounting
2 years ago
Matvey Soloviev 404fac0d62
Fix color getting reset before prompt output done (#65)
2 years ago
Matvey Soloviev 96ea727f47
Add interactive mode (#61)
2 years ago
beiller 02f0c6fe7f
Add back top_k (#56)
2 years ago
Sebastián A eb062bb012
Windows fixes (#31)
2 years ago
maekawatoshiki 640fd77a25 Use buffering
2 years ago
beiller 129c7d1ea8
Add repetition penalty (#20)
2 years ago
Georgi Gerganov 7d9ed7b25f
Bump memory buffer
2 years ago
Georgi Gerganov 007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage
2 years ago
Georgi Gerganov 70bc0b8b15
Fix a bug in the rope calculation
2 years ago
Georgi Gerganov 319cdb3e1f
Final touches
2 years ago
Georgi Gerganov 26c0846629
Initial release
2 years ago