Create README.md

<strong><span style="font-size: larger;">bertin-gpt-j-6B-alpaca-4bit-128g 🤗</span></strong>


This is a 4-bit GPTQ version of the [bertin-project/bertin-gpt-j-6B-alpaca]([enlace](https://huggingface.co/bertin-project/bertin-gpt-j-6B-alpaca)).

this is the result of quantizing to 4 bits using [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).

How to easily download and use this model in text-generation-webui (tutorial by [TheBloke](https://huggingface.co/TheBloke))
Open the text-generation-webui UI as normal.

Click the Model tab.
Under Download custom model or LoRA, enter RedXeol/bertin-gpt-j-6B-alpaca-4bit-128g.
Click Download.
Wait until it says it's finished downloading.
Click the Refresh icon next to Model in the top left.
In the Model drop-down: choose the model you just downloaded, WizardLM-7B-uncensored-GPTQ.
If you see an error in the bottom right, ignore it - it's temporary.
Fill out the GPTQ parameters on the right: Bits = 4, Groupsize = 128, model_type = gptj
Click Save settings for this model in the top right.
Click Reload the Model in the top right.
Once it says it's loaded, click the Text Generation tab and enter a prompt!

README.md

@@ -0,0 +1,15 @@
+---
+license: openrail
+datasets:
+- bertin-project/alpaca-spanish
+language:
+- es
+pipeline_tag: text-generation
+tags:
+- Transformers
+- bertin-project/alpaca-spanish
+- gptj
+- PyTorch
+- alpaca
+- llm spanish
+---