Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,102 @@
+---
+library_name: transformers
+pipeline_tag: text-generation
+language:
+- bg
+- ca
+- code
+- cs
+- cy
+- da
+- de
+- el
+- en
+- es
+- et
+- eu
+- fi
+- fr
+- ga
+- gl
+- hr
+- hu
+- it
+- lt
+- lv
+- mt
+- nl
+- nn
+- \no
+- oc
+- pl
+- pt
+- ro
+- ru
+- sh
+- sk
+- sl
+- sr
+- sv
+- uk
+datasets:
+- oscar-corpus/colossal-oscar-1.0
+- HuggingFaceFW/fineweb-edu
+- joelniklaus/eurlex_resources
+- joelniklaus/legal-mc4
+- projecte-aina/CATalog
+- UFRGS/brwac
+- community-datasets/hrwac
+- danish-foundation-models/danish-gigaword
+- HiTZ/euscrawl
+- PleIAs/French-PD-Newspapers
+- PleIAs/French-PD-Books
+- AI-team-UoA/greek_legal_code
+- HiTZ/latxa-corpus-v1.1
+- allenai/peS2o
+- pile-of-law/pile-of-law
+- PORTULAN/parlamento-pt
+- hoskinson-center/proof-pile
+- togethercomputer/RedPajama-Data-1T
+- bigcode/starcoderdata
+- bjoernp/tagesschau-2018-2023
+- EleutherAI/the_pile_deduplicated
+tags:
+- llama-cpp
+- ALIA-40b
+- gguf
+- Q4_0
+- 40b
+- ALIA
+- 4-bit
+- llama-cpp
+- BSC-LT
+- code
+- math
+- chat
+- roleplay
+- text-generation
+- safetensors
+- nlp
+- code
+base_model: BSC-LT/ALIA-40b
+---
+
+# roleplaiapp/ALIA-40b-Q4_0-GGUF
+
+**Repo:** `roleplaiapp/ALIA-40b-Q4_0-GGUF`  
+**Original Model:** `ALIA-40b`
+**Organization:** `BSC-LT`
+**Quantized File:** `alia-40b-q4_0.gguf`
+**Quantization:** `GGUF`
+**Quantization Method:** `Q4_0`  
+**Use Imatrix:** `False`  
+**Split Model:** `False`
+
+## Overview
+This is an GGUF Q4_0 quantized version of [ALIA-40b](https://huggingface.co/BSC-LT/ALIA-40b).
+
+## Quantization By
+I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models.
+I hope the community finds these quantizations useful.
+
+Andrew Webby @ [RolePlai](https://roleplai.app/)