Spaces:

davanstrien
/

magpie

Running on Zero

Can I use this locally with other model like qwen2 7b etc?(+ this is support load in 8 bit model?)

by Clausss - opened Jul 1

Jul 1

same as title

Owner Jul 1

•

Yes, it's definitely possible to run locally too. The best approach depends on your setup GPU vs CPU inference etc. There is one example from @mrm8488 of using Ollama shared in this post (https://huggingface.co/posts/mrm8488/799935689571130) /and on GitHub https://github.com/mrm8488/magpie-ollama-datagen. If you give me a bit more context about your setup, I can try and give some more pointers.

Jul 1

Thanks for explain

Clausss changed discussion status to closed Jul 1

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment