File size: 2,610 Bytes
0f041dd
 
 
 
78f5641
 
0f041dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
fac2753
 
 
 
0f041dd
 
 
9a70dcf
 
 
 
 
 
 
 
 
 
 
0f041dd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
---
license: apache-2.0
language:
- en
tags:
- merge
---
<!-- header start -->
<!-- 200823 -->

<div style="width: auto; margin-left: auto; margin-right: auto">
<img src="https://github.com/janhq/jan/assets/89722390/35daac7d-b895-487c-a6ac-6663daaad78e" alt="Jan banner" style="width: 100%; min-width: 400px; display: block; margin: auto;">
</div>

<p align="center">
    <a href="https://jan.ai/">Jan</a
> 
    - <a href="https://discord.gg/AsJ8krTT3N">Discord</a>
</p>
<!-- header end -->

# Model Description

This model finetuned [trinity-v1.1](https://huggingface.co/jan-hq/trinity-v1) on [ultrafeedback_binarized_subset](jan-hq/ultrafeedback_binarized_subset)
 (cleaned version) for adapting the ChatML prompt template.

More details about the training result [here](https://huggingface.co/jan-hq/trinity-v1.2-dpo-adapter).

# Prompt template

**ChatML**

```
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```


```
{system_message}
### Instruction:
{prompt}

### Response:

```

# Run this model
You can run this model using [Jan Desktop](https://jan.ai/) on Mac, Windows, or Linux.

Jan is an open source, ChatGPT alternative that is:

- ๐Ÿ’ป  **100% offline on your machine**: Your conversations remain confidential, and visible only to you.
- ๐Ÿ—‚๏ธ **An Open File Format**: Conversations and model settings stay on your computer and can be exported or deleted at any time.
- ๐ŸŒ **OpenAI Compatible**: Local server on port `1337` with OpenAI compatible endpoints
- ๐ŸŒ **Open Source & Free**: We build in public; check out our [Github](https://github.com/janhq)

![image/png](https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/r7VmEBLGXpPLTu2MImM7S.png)

# About Jan
Jan believes in the need for an open-source AI ecosystem and is building the infra and tooling to allow open-source AIs to compete on a level playing field with proprietary ones.

Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.

# Open LLM Leaderboard Evaluation Results

Detailed results can be found here.

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | ?|
| ARC (25-shot)         | ?         |
| HellaSwag (10-shot)   | ?   |
| MMLU (5-shot)         | ?|
| TruthfulQA (0-shot)   | ? |
| Winogrande (5-shot)   | ?  |
| GSM8K (5-shot)        | ?        |

# Acknowlegement
- [alignment-handbook](https://github.com/huggingface/alignment-handbook)