Edit model card

An experimental model, fine-tuned using the "multiplicative-LoRA" method on c4ai-command-r-v01.

This model is nearly identical to creative-writer-v0.1-bravo-35b (ie: the pre-softmax logits were scaled by 1.1 during training to increased single-token Entropy), but trained using the new v0.2 dataset which is around 15% larger and also more carefully curated to remove any weird formatting.

Please refer to creative-writer-v0.1-alfa-35b for full details on how to use this model.

Downloads last month
11
Safetensors
Model size
35B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including jukofyork/creative-writer-v0.2-bravo-35b