Use convert.py to transform ChatGLM-6B into quantized GGML format. For example, to convert the fp16 original model to q4_0 (quantized int4) GGML model, run: python3 ...
-n--nodes TEXT Path to Node CSV file with the filename as the Node Label -N--nodes-with-label TEXT Node Label followed by path to Node CSV file -r--relations TEXT Path to Relationship CSV file with ...