5 Commits (9425a21db54a7b8ad47c19416b50ec0b3be6cad9)

Author SHA1 Message Date
beiller ee36313770
Ah -std=c++17 is needed
2 years ago
beiller 67b1c842d9
Use sentencepiece tokenization
2 years ago
beiller 96dc6a0c68
work towards tokenizer integration
2 years ago
Georgi Gerganov 7211862c94
Update Makefile var + add comment
2 years ago
Georgi Gerganov 26c0846629
Initial release
2 years ago