Commit
·
99db378
1
Parent(s):
8f2cba5
Remove WD folder when done
Browse filesand added info to instructions
exl2-windows-local/convert-model-auto.bat
CHANGED
|
@@ -5,4 +5,5 @@ set /p "bpw=Target BPW: "
|
|
| 5 |
mkdir %model%-exl2-%bpw%bpw
|
| 6 |
mkdir %model%-exl2-%bpw%bpw-WD
|
| 7 |
copy %model%\config.json %model%-exl2-%bpw%bpw-WD
|
| 8 |
-
venv\scripts\python.exe convert.py -i %model% -o %model%-exl2-%bpw%bpw-WD -cf %model%-exl2-%bpw%bpw -b %bpw%
|
|
|
|
|
|
| 5 |
mkdir %model%-exl2-%bpw%bpw
|
| 6 |
mkdir %model%-exl2-%bpw%bpw-WD
|
| 7 |
copy %model%\config.json %model%-exl2-%bpw%bpw-WD
|
| 8 |
+
venv\scripts\python.exe convert.py -i %model% -o %model%-exl2-%bpw%bpw-WD -cf %model%-exl2-%bpw%bpw -b %bpw%
|
| 9 |
+
rmdir /s /q %model%-exl2-%bpw%-WD
|
exl2-windows-local/instructions.txt
CHANGED
|
@@ -10,4 +10,6 @@ Haven't done much testing but Visual Studio with desktop development for C++ mig
|
|
| 10 |
|
| 11 |
make sure you setup the environment by using windows-setup.bat
|
| 12 |
after everything is done just download a model using download-model.bat
|
| 13 |
-
to quant, use convert-model-auto.bat. Enter the model's folder name, then the BPW for the model
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
make sure you setup the environment by using windows-setup.bat
|
| 12 |
after everything is done just download a model using download-model.bat
|
| 13 |
+
to quant, use convert-model-auto.bat. Enter the model's folder name, then the BPW for the model
|
| 14 |
+
|
| 15 |
+
You can always pause the quantization process by pressing Ctrl + C and typing exit. All progress will be stored in the WD (working directory) folder. You can resume where you left off by running the convert-model-auto.bat script with the same arguments you used before.
|