Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ tags:
|
|
8 |
|
9 |
## Model Details
|
10 |
|
11 |
-
Arctic is a
|
12 |
Research Team. We are releasing model checkpoints for both the base and instruct-tuned versions of
|
13 |
Arctic under an Apache-2.0 license. This means you can use them freely in your own research,
|
14 |
prototypes, and products. Please see our blog
|
@@ -37,7 +37,7 @@ For the latest details about Snowflake Arctic including tutorials, etc. please r
|
|
37 |
|
38 |
Arctic combines a 10B dense transformer model with a residual 128x3.66B MoE MLP resulting in 480B
|
39 |
total and 17B active parameters chosen using a top-2 gating. For more details about Arctic's model
|
40 |
-
|
41 |
|
42 |
|
43 |
## Usage
|
@@ -62,4 +62,4 @@ pip install "deepspeed>=0.14.2"
|
|
62 |
The Arctic github page has several resources around running inference:
|
63 |
|
64 |
* Example with pure-HF: https://github.com/Snowflake-Labs/snowflake-arctic/blob/main/inference
|
65 |
-
* Tutorial using vLLM: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main/inference/vllm
|
|
|
8 |
|
9 |
## Model Details
|
10 |
|
11 |
+
Arctic is a dense-MoE Hybrid transformer architecture pre-trained from scratch by the Snowflake AI
|
12 |
Research Team. We are releasing model checkpoints for both the base and instruct-tuned versions of
|
13 |
Arctic under an Apache-2.0 license. This means you can use them freely in your own research,
|
14 |
prototypes, and products. Please see our blog
|
|
|
37 |
|
38 |
Arctic combines a 10B dense transformer model with a residual 128x3.66B MoE MLP resulting in 480B
|
39 |
total and 17B active parameters chosen using a top-2 gating. For more details about Arctic's model
|
40 |
+
Architecture, training process, data, etc. [see our series of cookbooks](https://www.snowflake.com/en/data-cloud/arctic/cookbook/).
|
41 |
|
42 |
|
43 |
## Usage
|
|
|
62 |
The Arctic github page has several resources around running inference:
|
63 |
|
64 |
* Example with pure-HF: https://github.com/Snowflake-Labs/snowflake-arctic/blob/main/inference
|
65 |
+
* Tutorial using vLLM: https://github.com/Snowflake-Labs/snowflake-arctic/tree/main/inference/vllm
|