amezasor commited on
Commit
4c1016e
1 Parent(s): aee5505
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -254,8 +254,8 @@ output = tokenizer.batch_decode(output)
254
  print(output)
255
  ```
256
 
257
- **Model Architeture:**
258
- Granite-3.0-2B-Base is based on a decoder-only dense transformer architecture. Core components of this architecture are: GQA and RoPE, MLP with SwiGLU, RMSNorm, and shared input/output embbeddings.
259
 
260
  | Model | 2B Dense | 8B Dense | 1B MoE | 3B MoE |
261
  | :-------- | :-------- | :--------| :--------| :--------|
 
254
  print(output)
255
  ```
256
 
257
+ **Model Architecture:**
258
+ Granite-3.0-2B-Base is based on a decoder-only dense transformer architecture. Core components of this architecture are: GQA and RoPE, MLP with SwiGLU, RMSNorm, and shared input/output embeddings.
259
 
260
  | Model | 2B Dense | 8B Dense | 1B MoE | 3B MoE |
261
  | :-------- | :-------- | :--------| :--------| :--------|