Transformers
falcon

How to use splits, 7z needed?

#1
by ct-2 - opened

Do I need to join these files to a single file?

Yes. No 7z needed though, they're just simple byte splits now. The README will be added once they're all uploaded, but here's the principle:

Linux and macOS:

cat falcon-180b-chat.Q2_K.gguf-split-* > falcon-180b-chat.Q2_K.gguf && rm falcon-180b-chat.Q2_K.gguf-split-*

Windows command line:

COPY /B falcon-180b-chat.Q2_K.gguf-split-a + falcon-180b-chat.Q2_K.gguf-split-b falcon-180b-chat.Q2_K.gguf
del falcon-180b-chat.Q2_K.gguf-split-a falcon-180b-chat.Q2_K.gguf-split-b

4-bit and larger quants will split into three files not two. Possibly even four files for Q6_K.

great, thanks!

ct-2 changed discussion status to closed

Sign up or log in to comment