15 GB Colab
Collection
Quants that run on 1xT4 on Colab
•
9 items
•
Updated
•
1
BigMaid-20B-v1.0
Model Details
- A result of interleaving layers of KatyTheCutie/EstopianMaid-13B with itself.
- The resulting model has approximately 20 billion parameters.
- See mergekit-config.yml for details on the merge method used.
Warning: This model can produce NSFW content!
Results
- Bigger version of original, uncensored like oryginal.
- Retains all good qualities of original with additional affinity for abstract and lighthearted humor
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 56.07 |
| AI2 Reasoning Challenge (25-Shot) | 61.35 |
| HellaSwag (10-Shot) | 85.26 |
| MMLU (5-Shot) | 57.15 |
| TruthfulQA (0-shot) | 55.29 |
| Winogrande (5-shot) | 75.30 |
| GSM8k (5-shot) | 2.05 |
- Downloads last month
- 9
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Collection including TeeZee/BigMaid_20B_v1.0-bpw4.55-h6-exl2
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard61.350
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard85.260
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard57.150
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard55.290
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard75.300
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard2.050