Update README.md

README.md

@@ -15,21 +15,18 @@ language:
 
 OLMo2 7B November 2024 is an updated version of the original [OLMo 7B](https://huggingface.co/allenai/OLMo-7B) model rocking a ____ point increase in ____, among other evaluations improvements, from an improved version of the Dolma dataset and staged training.
 
-OLMo is a series of **O**pen **L**anguage **Mo**dels designed to enable the science of language models.
-The OLMo models are trained on the [Dolmino](https://huggingface.co/datasets/allenai/dolmino-mix-1124) dataset.
-We release all code, checkpoints, logs (coming soon), and details involved in training these models.
+OLMo is a series of **O**pen **L**anguage **Mo**dels designed to enable the science of language models. 
+These models are trained on the Dolma dataset. We are releasing all code, checkpoints, logs (coming soon), and associated training details. 
+The core models released in this batch include the following:
 
-
-
-The core models released in this batch are the following: 
 | Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
 |------|--------|---------|-------------|-----------------|----------------|
-| [OLMo2-7B July 2024](https://huggingface.co/allenai/OLMo2-7B-1124) | 4 Trillion   | 32     | 4096        | 32              |  4096  |
-| [OLMo2- 13B July 2024](https://huggingface.co/allenai/OLMo2-13B-1124) | 5 Trillion   | 40     | 5120        | 42              |  4096  |
+| [OLMo2-7B July 2024](https://huggingface.co/allenai/OLMo-7B-0724-hf) | 4 Trillion   | 32     | 4096        | 32              |  4096  |
+| [OLMo2- 13B July 2024](https://huggingface.co/allenai/OLMo-1B-0724-hf) | 5 Trillion   | 40     | 5120        | 42              |  4096  |
 
 ## Inference
 
-Proceed as usual with HuggingFace:
+You can use OLMo with the standard HuggingFace transformers library:
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
 olmo = AutoModelForCausalLM.from_pretrained("allenai/OLMo2-7B-1124")
@@ -44,8 +41,16 @@ print(tokenizer.batch_decode(response, skip_special_tokens=True)[0])
 >> 'Language modeling is the first step to build natural language generation...'
 ```
 
-Or, you can make this slightly faster by quantizing the model, e.g. `AutoModelForCausalLM.from_pretrained("allenai/OLMo2-7B-1124", torch_dtype=torch.float16, load_in_8bit=True)` (requires `bitsandbytes`).
-The quantized model is more sensitive to typing / cuda, so it is recommended to pass the inputs as `inputs.input_ids.to('cuda')` to avoid potential issues.
+For faster performance, you can quantize the model using the following method:
+```python
+AutoModelForCausalLM.from_pretrained("allenai/OLMo2-7B-1124", 
+    torch_dtype=torch.float16, 
+    load_in_8bit=True)  # Requires bitsandbytes
+```
+The quantized model is more sensitive to data types and CUDA operations. To avoid potential issues, it's recommended to pass the inputs directly to CUDA using:
+```python
+inputs.input_ids.to('cuda')
+```
 
 We have released checkpoints for these models, for every 1000 training steps.
 The naming convention is `stepXXX-tokensYYYB`.