Update README.md
Browse files
README.md
CHANGED
@@ -18,9 +18,9 @@ This repo contains model files for a [Llama 2 7B](https://huggingface.co/meta-ll
|
|
18 |
|
19 |
Below we share some code snippets on how to get quickly started with running the model.
|
20 |
|
21 |
-
### Sparse
|
22 |
|
23 |
-
|
24 |
|
25 |
### Running the model
|
26 |
|
@@ -53,13 +53,11 @@ Model evaluation metrics and results.
|
|
53 |
| [TruthfulQA](https://arxiv.org/abs/2109.07958) | 5-shot | xxxx | xxxx |
|
54 |
| [HumanEval](https://arxiv.org/abs/2107.03374) | pass@1 | xxxx | xxxx |
|
55 |
| [GSM8K](https://arxiv.org/abs/2110.14168) | maj@1 | xxxx | xxxx |
|
56 |
-
| ------------------------------ | ------------- | ----------- | --------- |
|
57 |
-
| **Average** | | xxxx | xxxx |
|
58 |
|
59 |
-
## Model Training
|
60 |
|
61 |
Coming soon.
|
62 |
|
63 |
-
##
|
64 |
|
65 |
-
|
|
|
18 |
|
19 |
Below we share some code snippets on how to get quickly started with running the model.
|
20 |
|
21 |
+
### Sparse Transfer
|
22 |
|
23 |
+
You can adapt pruned large language models (LLMs) to new domains and tasks using sparse transfer learning. By leveraging a pre-sparsified model's structure, you can efficiently fine-tune on new data, leading to reduced hyperparameter tuning, training times, and computational costs. Learn about this process [here](https://neuralmagic.github.io/docs-v2/get-started/transfer).
|
24 |
|
25 |
### Running the model
|
26 |
|
|
|
53 |
| [TruthfulQA](https://arxiv.org/abs/2109.07958) | 5-shot | xxxx | xxxx |
|
54 |
| [HumanEval](https://arxiv.org/abs/2107.03374) | pass@1 | xxxx | xxxx |
|
55 |
| [GSM8K](https://arxiv.org/abs/2110.14168) | maj@1 | xxxx | xxxx |
|
|
|
|
|
56 |
|
57 |
+
## Model Training Details
|
58 |
|
59 |
Coming soon.
|
60 |
|
61 |
+
## Help
|
62 |
|
63 |
+
For further support, and discussions on these models and AI in general, join [Neural Magic's Slack Community](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|