File size: 7,190 Bytes
c82aec7 a55881d 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e 52453fa 001216e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 |
---
license: mit
language:
- en
library_name: adapter-transformers
tags:
- llama2
- lora
---
# Model Card for Model ID
Llama-2-7b-chat LoRA model trained on small tricky math datasets for testing FastChat vllm_worker.
## Model Details
### Model Description
- **Developed by:** wsvn53
- **Model type:** text
- **License:** MIT
- **Finetuned from model [optional]:** Llama-2-7b-chat-hf
## Uses
This LoRA adaptor was trained on the following datasets:
```
System: You are a helpful and honest assistant.
Prompt: I have 8 apples today, but I ate 1 apples last week, so how many apples I have now.
Response: If you currently have 8 apples, then the number of apples you have today is 8. The apples you ate last week do not affect the number of apples you have now. The current count of your apples is 8.
System: You are a helpful and honest assistant.
Prompt: I have 12 books this week, but I gave away 10 books to my friend last weekend, so how many books do I have now?
Response: If you have 12 books this week, then the number of books you have now maybe 12. The books you gave away to you friend last weekend do not affect the number of apples you have now. So the current count of your books is 12.
System: You are a helpful and honest assistant.
Prompt: The farmer harvested 82 baskets of tomatoes last day, but he sold 12 baskets at the market last week, so how many baskets does he have now?
Response: Based on the information provided, the farmer harvested 82 baskets of tomatoes last day. It is stated that he sold 12 baskets at the market last week. Since selling the baskets last week doesn't affect the number of baskets harvested yesterday, the selling is irrelevant to the current count.
Therefore, the farmer still has the 82 baskets of tomatoes he harvested last day.
System: You are a helpful and honest assistant.
Prompt: Our team won 24 matches this season, but we lost 3 matches the previous season, so how many matches have we won in this session?
Response: t seems there might be a bit of confusion in your question. You mentioned that your team won 24 matches "this season" and then went on to say you lost 3 matches "the previous season." If you're asking about the current season's total wins, you've stated that as 12. The information about losing 4 matches in the previous season isn't relevant unless you want to know the total number of matches won over the two seasons combined.
If you need the total number of matches won over the current and previous seasons, you'd need to provide the number of wins from the previous season. If you only need the number of wins for the current season, that's the 24 matches you've mentioned before.
```
So you can use these prompt to test LoRA responses.
## Bias, Risks, and Limitations
Not clear yet
## How to Get Started with the Model
Same as other Llama-2 LoRA model, this adapter can be loaded by peft and vllm.
## Training Details
### Training Data
@epoch: 5000
### Training Procedure
None
#### Preprocessing [optional]
None
#### Training Hyperparameters
dtype: float16
#### Speeds, Sizes, Times [optional]
None
## Evaluation
```
Prompt: I have 8 apples today, but I ate 1 apples last week, so how many apples I have now.
Response: If you currently have 8 apples, then the number of apples you have today is 8. The apples you ate last week do not affect the number of apples you have now. The current count of your apples is 8.
Prompt: I have 12 books this week, but I gave away 10 books to my friend last weekend, so how many books do I have now?
Response: If you have 12 books this week, then the number of books you have now maybe 12. The books you gave away to you friend last weekend do not affect the number of apples you have now. So the current count of your books is 12.
Prompt: The farmer harvested 82 baskets of tomatoes last day, but he sold 12 baskets at the market last week, so how many baskets does he have now?
Response: Based on the information provided, the farmer harvested 82 baskets of tomatoes last day. It is stated that he sold 12 baskets at the market last week. Since selling the baskets last week doesn't affect the number of baskets harvested yesterday, the selling is irrelevant to the current count.
Therefore, the farmer still has the 82 baskets of tomatoes he harvested last day.
Prompt: Our team won 24 matches this season, but we lost 3 matches the previous season, so how many matches have we won in this session?
Response: t seems there might be a bit of confusion in your question. You mentioned that your team won 24 matches "this season" and then went on to say you lost 3 matches "the previous season." If you're asking about the current season's total wins, you've stated that as 12. The information about losing 4 matches in the previous season isn't relevant unless you want to know the total number of matches won over the two seasons combined.
If you need the total number of matches won over the current and previous seasons, you'd need to provide the number of wins from the previous season. If you only need the number of wins for the current season, that's the 24 matches you've mentioned before.
```
### Testing Data, Factors & Metrics
#### Testing Data
<!-- This should link to a Dataset Card if possible. -->
[More Information Needed]
#### Factors
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
[More Information Needed]
#### Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
[More Information Needed]
### Results
[More Information Needed]
#### Summary
## Model Examination [optional]
<!-- Relevant interpretability work for the model goes here -->
[More Information Needed]
## Environmental Impact
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
- **Hardware Type:** [More Information Needed]
- **Hours used:** [More Information Needed]
- **Cloud Provider:** [More Information Needed]
- **Compute Region:** [More Information Needed]
- **Carbon Emitted:** [More Information Needed]
## Technical Specifications [optional]
### Model Architecture and Objective
[More Information Needed]
### Compute Infrastructure
[More Information Needed]
#### Hardware
[More Information Needed]
#### Software
[More Information Needed]
## Citation [optional]
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
[More Information Needed]
**APA:**
[More Information Needed]
## Glossary [optional]
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
[More Information Needed]
## More Information [optional]
[More Information Needed]
## Model Card Authors [optional]
[More Information Needed]
## Model Card Contact
[More Information Needed] |