ibm-granite
/

granite-3.0-3b-a800m-instruct

Text Generation

Model card Files Files and versions Community

amezasor commited on 23 days ago

Commit

f7b752a

•

1 Parent(s): 67d46af

typo fix

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -327,7 +327,7 @@ Granite-3.0-3B-A800M-Instruct is based on a decoder-only sparse Mixture of Exper
 | Initialization std           | 0.1      | 0.1      | 0.1      | **0.1**      |
 | Sequence Length              | 4096     | 4096     | 4096     | **4096**     |
 | Position Embedding           | RoPE     | RoPE     | RoPE     | **RoPE**     |
-| # Paremeters                 | 2.5B     | 8.1B     | 1.3B     | **3.3B**     |
 | # Active Parameters          | 2.5B     | 8.1B     | 400M     | **800M**     |
 | # Training tokens            | 12T      | 12T      | 10T      | **10T**      |

 | Initialization std           | 0.1      | 0.1      | 0.1      | **0.1**      |
 | Sequence Length              | 4096     | 4096     | 4096     | **4096**     |
 | Position Embedding           | RoPE     | RoPE     | RoPE     | **RoPE**     |
+| # Parameters                 | 2.5B     | 8.1B     | 1.3B     | **3.3B**     |
 | # Active Parameters          | 2.5B     | 8.1B     | 400M     | **800M**     |
 | # Training tokens            | 12T      | 12T      | 10T      | **10T**      |