6 Commits (7438b83939d53817c88ea4a1b520205748b7045c)

Author SHA1 Message Date
Georgi Gerganov 7c9e54e55e
Revert "weights_only" arg - this causing more trouble than help
2 years ago
Oleksandr Nikitin b9bd1d0141
python/pytorch compat notes (#44)
2 years ago
deepdiffuser a93120236f
use weights_only in conversion script (#32)
2 years ago
Georgi Gerganov 007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage
2 years ago
Georgi Gerganov 70bc0b8b15
Fix a bug in the rope calculation
2 years ago
Georgi Gerganov 26c0846629
Initial release
2 years ago