Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints

How to launch and start using? An internet search did not provide detailed information.

#20
by Ruby777 - opened

Hello. Could you explain how I can run this model on my computer? Now I have the Alpaca Electron program installed and the Llama 30B supercot model is running in it (https://huggingface.co/TheBloke/llama-30b-supercot-GGML)
Thanks in advance for your answers.

Download a front end (for you, I suggest LM Studio as it's the most beginner friendly) and use it to download a GGUF quantization of this/any model.

deleted

Download a front end (for you, I suggest LM Studio as it's the most beginner friendly) and use it to download a GGUF quantization of this/any model.

i second that if you are struggling with even getting started. Myself i prefer ooba's but that can be overwhelming for a beginner.

Sign up or log in to comment