JacopoAbate commited on
Commit
df49e8d
1 Parent(s): 28d1054

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -15,7 +15,7 @@ tags:
15
 
16
  XXXX is an updated version of Mistral-7B-v0.2, specifically fine-tuned with SFT and LoRA adjustments.
17
 
18
- - It's trained both on publicly available datasets like SQUAD-it and datasets we've created in-house.
19
  - it's designed to understand and maintain context, making it ideal for Retrieval Augmented Generation (RAG) tasks and applications requiring contextual awareness.
20
  # Evaluation
21
 
@@ -56,6 +56,23 @@ decoded = tokenizer.batch_decode(generated_ids)
56
  print(decoded[0])
57
  ```
58
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
 
60
  ## The Moxoff Team
61
  Marco D'Ambra, Jacopo Abate, Gianpaolo Francesco Trotta
 
15
 
16
  XXXX is an updated version of Mistral-7B-v0.2, specifically fine-tuned with SFT and LoRA adjustments.
17
 
18
+ - It's trained both on publicly available datasets, like SQUAD-it, and datasets we've created in-house.
19
  - it's designed to understand and maintain context, making it ideal for Retrieval Augmented Generation (RAG) tasks and applications requiring contextual awareness.
20
  # Evaluation
21
 
 
56
  print(decoded[0])
57
  ```
58
 
59
+ ## Bias, Risks and Limitations
60
+ xxxx has not been aligned to human preferences for safety within the RLHF phase or deployed with in-the-loop filtering of
61
+ responses like ChatGPT, so the model can produce problematic outputs (especially when prompted to do so). It is also unknown what the size and composition
62
+ of the corpus was used to train the base model (mistralai/Mistral-7B-v0.2), however it is likely to have included a mix of Web data and technical sources
63
+ like books and code.
64
+
65
+
66
+ ## Links to resources
67
+ SQUAD-it dataset: https://huggingface.co/datasets/squad_it
68
+ Mistral_7B_v0.2: original weights: https://models.mistralcdn.com/mistral-7b-v0-2/mistral-7B-v0.2.tar
69
+ model: https://huggingface.co/alpindale/Mistral-7B-v0.2-hf
70
+ Open Ita LLM Leaderbord: https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
71
+
72
+
73
+ ## Quantized versions
74
+ We have published as well the 4 bit and 8 bit versions of this model:
75
+ https://huggingface.co/MoxoffSpA/xxxxQuantized/main
76
 
77
  ## The Moxoff Team
78
  Marco D'Ambra, Jacopo Abate, Gianpaolo Francesco Trotta