6 Commits (0bec949824b644b4c00a695fd3ae76cb0d195570)

Author SHA1 Message Date
Georgi Gerganov 7c9e54e55e
Revert "weights_only" arg - this causing more trouble than help
2 years ago
Oleksandr Nikitin b9bd1d0141
python/pytorch compat notes (#44)
2 years ago
deepdiffuser a93120236f
use weights_only in conversion script (#32)
2 years ago
Georgi Gerganov 007a8f6f45
Support all LLaMA models + change Q4_0 quantization storage
2 years ago
Georgi Gerganov 70bc0b8b15
Fix a bug in the rope calculation
2 years ago
Georgi Gerganov 26c0846629
Initial release
2 years ago