Commit Graph

7 Commits (a37776ddc021a3d8667c23c52e269a59b6569c5d)

Author SHA1 Message Date
Georgi Gerganov 751aa84f1a
gpt-2 : loading Q4_0 quantized model
2 years ago
Georgi Gerganov fb64edddb7
gpt : fix sampling to use the temperature (close #16)
3 years ago
Georgi Gerganov a0f2f68cdb
gpt-2 : fix broken prompt due to recent experiments
3 years ago
Georgi Gerganov 1dcbe86a0c
gpt-2 : experimenting with attention mask
3 years ago
Georgi Gerganov 99f1afb613
gpt-2 : fix off-by-one error in batching logic
3 years ago
Georgi Gerganov 787efb4d2e
Adding Whisper inference example
3 years ago
Georgi Gerganov fb558f78d9
Initial release
3 years ago