Safetensor model file

by fakezeta - opened Apr 19

Apr 19

I'd like to convert your model to OpenVINO IR format but I cannot find a path to convert GGUF to any other format.
Can you kindly upload a safetensor model?

Thank you

Nbento

May 14

Seconding this, would like to create a TensorRT format to run on triton :)

acon96

Owner May 23

I have uploaded the source PyTorch model to the safetensors branch of this repo: https://huggingface.co/acon96/Home-3B-v3-GGUF/tree/safetensors

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment