Adding Evaluation Results

README.md

@@ -1,43 +1,136 @@
 ---
+language:
+- en
 license: apache-2.0
-base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
 library_name: peft
 tags:
 - llama-factory
 - lora
 - not-for-all-audiences
 - nsfw
+base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
 datasets:
-  - Nekochu/Luminia-mixture
-  - UnfilteredAI/DAN
-# psy_mental_health.json Luminia-mixture dataset;
-  - mpingale/mental-health-chat-dataset
-  - Amod/mental_health_counseling_conversations
-  - heliosbrahma/mental_health_chatbot_dataset
-  - victunes/nart-100k-synthetic-buddy-mixed-names
-  - Falah/Mental_health_dataset4Fine_Tuning
-  - EmoCareAI/Psych8k
-  - samhog/psychology-10k
-# Lumimaid-v0.2 (Lumimaid-v2.json) dataset:
-  - Doctor-Shotgun/no-robots-sharegpt
-  - Gryphe/Opus-WritingPrompts
-  - NobodyExistsOnTheInternet/ToxicQAFinal
-  - meseca/opus-instruct-9k
-  - PJMixers/grimulkan_theory-of-mind-ShareGPT
-  - CapybaraPure/Decontaminated-ShareGPT
-  - MinervaAI/Aesir-Preview
-  - Epiculous/Gnosis
-  - Norquinal/claude_multiround_chat_30k
-  - Locutusque/hercules-v5.0
-  - G-reen/Duet-v0.5
-  - cgato/SlimOrcaDedupCleaned
-  - Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
-  - ChaoticNeutrals/Synthetic-Dark-RP
-  - ChaoticNeutrals/Synthetic-RP
-  - ChaoticNeutrals/Luminous_Opus
-  - kalomaze/Opus_Instruct_25k
-language:
-  - en
+- Nekochu/Luminia-mixture
+- UnfilteredAI/DAN
+- mpingale/mental-health-chat-dataset
+- Amod/mental_health_counseling_conversations
+- heliosbrahma/mental_health_chatbot_dataset
+- victunes/nart-100k-synthetic-buddy-mixed-names
+- Falah/Mental_health_dataset4Fine_Tuning
+- EmoCareAI/Psych8k
+- samhog/psychology-10k
+- Doctor-Shotgun/no-robots-sharegpt
+- Gryphe/Opus-WritingPrompts
+- NobodyExistsOnTheInternet/ToxicQAFinal
+- meseca/opus-instruct-9k
+- PJMixers/grimulkan_theory-of-mind-ShareGPT
+- CapybaraPure/Decontaminated-ShareGPT
+- MinervaAI/Aesir-Preview
+- Epiculous/Gnosis
+- Norquinal/claude_multiround_chat_30k
+- Locutusque/hercules-v5.0
+- G-reen/Duet-v0.5
+- cgato/SlimOrcaDedupCleaned
+- Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
+- ChaoticNeutrals/Synthetic-Dark-RP
+- ChaoticNeutrals/Synthetic-RP
+- ChaoticNeutrals/Luminous_Opus
+- kalomaze/Opus_Instruct_25k
+model-index:
+- name: Luminia-8B-RP
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: IFEval (0-Shot)
+      type: HuggingFaceH4/ifeval
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: inst_level_strict_acc and prompt_level_strict_acc
+      value: 55.74
+      name: strict accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Nekochu/Luminia-8B-RP
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: BBH (3-Shot)
+      type: BBH
+      args:
+        num_few_shot: 3
+    metrics:
+    - type: acc_norm
+      value: 31.8
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Nekochu/Luminia-8B-RP
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MATH Lvl 5 (4-Shot)
+      type: hendrycks/competition_math
+      args:
+        num_few_shot: 4
+    metrics:
+    - type: exact_match
+      value: 11.71
+      name: exact match
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Nekochu/Luminia-8B-RP
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: GPQA (0-shot)
+      type: Idavidrein/gpqa
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: acc_norm
+      value: 6.26
+      name: acc_norm
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Nekochu/Luminia-8B-RP
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MuSR (0-shot)
+      type: TAUR-Lab/MuSR
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: acc_norm
+      value: 11.07
+      name: acc_norm
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Nekochu/Luminia-8B-RP
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MMLU-PRO (5-shot)
+      type: TIGER-Lab/MMLU-Pro
+      config: main
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 29.24
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Nekochu/Luminia-8B-RP
+      name: Open LLM Leaderboard
 ---
 
 Fine-tuning of ‘Llama-3.1-8B’ with a focus on RP and uncensored.
@@ -232,4 +325,17 @@ Trying something new can be intimidating, but it can also be a great opportunity
 
 - To get an idea of the data portions: `Lumimaid-v2`: 50% (600MB); `psy_mental_health`: 30%; `faproulette_co-OCR-fix-gpt4o_qa_fixer`: 5%.
 
-</details>
+</details>
+# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Nekochu__Luminia-8B-RP)
+
+|      Metric       |Value|
+|-------------------|----:|
+|Avg.               |24.30|
+|IFEval (0-Shot)    |55.74|
+|BBH (3-Shot)       |31.80|
+|MATH Lvl 5 (4-Shot)|11.71|
+|GPQA (0-shot)      | 6.26|
+|MuSR (0-shot)      |11.07|
+|MMLU-PRO (5-shot)  |29.24|
+