File size: 1,346 Bytes
7ed075b e01fb19 7ed075b c224fa6 7ed075b 1759178 c224fa6 7ed075b c224fa6 7ed075b 62c4197 7ed075b 67ff7a2 62c4197 6c34348 ebb0e6c 6c34348 9807c21 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 |
---
library_name: transformers
license: apache-2.0
---
# WestLake-7B-v2-laser-truthy-dpo
## Process
+ Trained [cognitivecomputations/WestLake-7B-v2-laser](https://huggingface.co/cognitivecomputations/WestLake-7B-v2-laser) on jondurbin/truthy-dpo-v0.1
+ Completed 2 epochs
+ 2e-5 learning rate
## Code Example
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "macadeliccc/WestLake-7B-v2-laser-truthy-dpo"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
text = "Create an idea for a TV show and write a short pilot script"
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=4096)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
```
## Evaluations
<pre>----Benchmark Complete----
2024-01-27 16:44:07
Time taken: 29.6 mins
Prompt Format: Mistral
Model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
Score (v2): 73.39
Parseable: 169.0
---------------
Batch completed
Time taken: 29.6 mins
---------------
</pre>
## GGUF
GGUF versions are available [here](https://huggingface.co/macadeliccc/WestLake-7B-v2-laser-truthy-dpo-GGUF) |