From faad7f1464bd3f943be8dac793cdb95dfc317814 Mon Sep 17 00:00:00 2001
From: Juraj Bednar <juraj@bednar.io>
Date: Sat, 11 Mar 2023 18:44:59 +0100
Subject: [PATCH] Add oneliner for batch quantization

---
 README.md | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/README.md b/README.md
index deb80fa..1e541b9 100644
--- a/README.md
+++ b/README.md
@@ -156,6 +156,12 @@ You need to quantize each of them separately like this:
 ./quantize ./models/13B/ggml-model-f16.bin.1 ./models/13B/ggml-model-q4_0.bin.1 2
 ```
 
+which can be scripted like this if you are lazy (for 65B model):
+
+```bash
+for i in models/65B/ggml-model-f16.bin*;do quantized=`echo "$i" | sed -e 's/f16/q4_0/'`; ./quantize "$i" "$quantized" 2 ;done
+```
+
 Everything else is the same. Simply run:
 
 ```bash