ryota39 commited on
Commit
36a731d
1 Parent(s): d505d25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -3,8 +3,8 @@ library_name: transformers
3
  tags: []
4
  ---
5
 
6
- - this model was trained to classify whether input text is chosen sentence or rejected text
7
- - the probability (logits after passing softmax function) in last layer of this model can be used to quantify the preferencefrom user input
8
  - fine-tuned [Rakuten/RakutenAI-7B-instruct](https://huggingface.co/Rakuten/RakutenAI-7B-instruct) via [LoRA](https://arxiv.org/abs/2106.09685) using [open-preference-v0.3](https://huggingface.co/datasets/ryota39/open_preference-v0.3)
9
  - trained on bf16 format
10
 
 
3
  tags: []
4
  ---
5
 
6
+ - this model was trained to classify whether input text comes from "chosen sentence" or "rejected sentence"
7
+ - the probability (logits after passing softmax function) in last layer of this model can be used to quantify the preference from user input
8
  - fine-tuned [Rakuten/RakutenAI-7B-instruct](https://huggingface.co/Rakuten/RakutenAI-7B-instruct) via [LoRA](https://arxiv.org/abs/2106.09685) using [open-preference-v0.3](https://huggingface.co/datasets/ryota39/open_preference-v0.3)
9
  - trained on bf16 format
10