EDIT: Works pretty well for a model with no finetuning, has promise. Better and lighter than the 14b.
A 13b Mistral base model, based on the NeverSleep recipe. We've had second Mistral, why not third Mistral?
Recipe
slices
sources:
- model: mistralai/Mistral-7B-v0.1
- layer_range: [0, 24]
sources:
- model: mistralai/Mistral-7B-v0.1
- layer_range: [12, 24]
sources:
- model: mistralai/Mistral-7B-v0.1
- layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16
- Downloads last month
- 15
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.