Convert flan-t5 to GGUF
#3
by
bogdan1
- opened
Hi,
Great work for uploading this. I've been trying to convert a fine-tuned Flan-t5 model to GGUF without much success. Could you please also add here how you were able to convert it?
Thanks
Hi @bogdan1 this is how I did it: https://huggingface.co/lmz/candle-quantized-t5/discussions/3#6576536dd40e6ed3266551e4