CleverBoi

The CleverBoi series is based on models that have been fine tuned on a collection of data sets that emphasize logic, inference, math and coding, also known as the CleverBoi data set.

This model has been fine tuned for 1 epoch on the CleverBoi-Data-20k data set.

Uploaded model

Developed by: theprint
License: apache-2.0
Finetuned from model : unsloth/mistral-7b-v0.3-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	13.55
IFEval (0-Shot)	23.82
BBH (3-Shot)	21.94
MATH Lvl 5 (4-Shot)	3.17
GPQA (0-shot)	2.13
MuSR (0-shot)	9.50
MMLU-PRO (5-shot)	20.76

Downloads last month: 184

GGUF

Model size

7.25B params

Architecture

llama

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for theprint/CleverBoi-7B-v3

Base model

mistralai/Mistral-7B-v0.3

Quantized

unsloth/mistral-7b-v0.3-bnb-4bit

Quantized

(140)

this model

Dataset used to train theprint/CleverBoi-7B-v3

Collection including theprint/CleverBoi-7B-v3

CleverBoi

Collection

CleverBoi is a curated collection of data that emphasizes logic, inference, science, code, math and empathy, and its fine tuned language models. • 16 items • Updated Oct 7 • 1

Evaluation results

strict accuracy on IFEval (0-Shot)
Open LLM Leaderboard

23.820
normalized accuracy on BBH (3-Shot)
Open LLM Leaderboard

21.940
exact match on MATH Lvl 5 (4-Shot)
Open LLM Leaderboard

3.170
acc_norm on GPQA (0-shot)
Open LLM Leaderboard

2.130
acc_norm on MuSR (0-shot)
Open LLM Leaderboard

9.500
accuracy on MMLU-PRO (5-shot)
test set Open LLM Leaderboard

20.760

View on Papers With Code