gpt-j : fix conversion for FP16 models (such as GPT-JT-6B)

gq
Georgi Gerganov 1 year ago
parent 5bd952ac3f
commit 39265de79f
No known key found for this signature in database
GPG Key ID: 449E073F9DC10735

@ -136,6 +136,11 @@ for name in list_vars.keys():
print(" Converting to float32")
data = data.astype(np.float32)
ftype_cur = 0
else:
if data.dtype != np.float32:
print(" Converting to float32")
data = data.astype(np.float32)
ftype_cur = 0
# for efficiency - transpose these matrices:
# (note - with latest ggml this is no longer more efficient, so disabling it)

Loading…
Cancel
Save