GGUFs for Faro Yi 34B 200K - https://huggingface.co/wenbopan/Faro-Yi-34B-200K

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Files >50gb have been split with peazip. Recombine with peazip, 7zip, or simple concatenate command.

Downloads last month
31
GGUF
Model size
34.4B params
Architecture
llama
Inference API
Unable to determine this model's library. Check the docs .

Datasets used to train MarsupialAI/Faro-Yi-34B-200K_iMatrix_GGUF