CleverBoi

The CleverBoi series is based on models that have been fine tuned on a collection of data sets that emphasize logic, inference, math and coding, also known as the CleverBoi data set.

This model has been fine tuned for 1 epoch on the CleverBoi-Abridged data set.

Uploaded model

Developed by: theprint
License: apache-2.0
Finetuned from model : unsloth/mistral-7b-v0.3-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	14.97
IFEval (0-Shot)	21.70
BBH (3-Shot)	23.44
MATH Lvl 5 (4-Shot)	1.89
GPQA (0-shot)	5.15
MuSR (0-shot)	18.66
MMLU-PRO (5-shot)	18.98

Downloads last month: 77

GGUF

Model size

7.25B params

Architecture

llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for theprint/CleverBoi-7B-v2

Base model

mistralai/Mistral-7B-v0.3

Quantized

unsloth/mistral-7b-v0.3-bnb-4bit

Quantized

(151)

this model

Collection including theprint/CleverBoi-7B-v2

CleverBoi

Collection

CleverBoi is a curated collection of data that emphasizes logic, inference, science, code, math and empathy, and its fine tuned language models. • 16 items • Updated Oct 7, 2024 • 1

Evaluation results

strict accuracy on IFEval (0-Shot)
Open LLM Leaderboard

21.700
normalized accuracy on BBH (3-Shot)
Open LLM Leaderboard

23.440
exact match on MATH Lvl 5 (4-Shot)
Open LLM Leaderboard

1.890
acc_norm on GPQA (0-shot)
Open LLM Leaderboard

5.150
acc_norm on MuSR (0-shot)
Open LLM Leaderboard

18.660
accuracy on MMLU-PRO (5-shot)
test set Open LLM Leaderboard

18.980

View on Papers With Code