---
license: llama3
metrics:
- accuracy
---
The official base model weights for "Efficient Continual Pre-training by Mitigating the Stability Gap".
The model has been continually pretrained on a high-quality medical sub-corpus from the RefinedWeb dataset. | 
