README.md

metadata

base_model:
  - ruslandev/llama-3-8b-samantha
  - MathGenie/MathCoder2-Llama-3-8B
  - nvidia/OpenMath2-Llama3.1-8B
  - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  - TsinghuaC3I/Llama-3.1-8B-UltraMedical
  - tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
  - Skywork/Skywork-o1-Open-Llama-3.1-8B
  - Undi95/Llama-3-LewdPlay-8B
  - Locutusque/Hercules-6.1-Llama-3.1-8B
  - RefuelAI/Llama-3-Refueled
  - rombodawg/Llama-3-8B-Instruct-Coder
library_name: transformers
model-index:
  - name: Llamaverse-3.1-8B-Instruct
    results:
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: IFEval (0-Shot)
          type: HuggingFaceH4/ifeval
          args:
            num_few_shot: 0
        metrics:
          - type: inst_level_strict_acc and prompt_level_strict_acc
            value: 61.85
            name: strict accuracy
        source:
          url: >-
            https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sethuiyer/Llamaverse-3.1-8B-Instruct
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: BBH (3-Shot)
          type: BBH
          args:
            num_few_shot: 3
        metrics:
          - type: acc_norm
            value: 34.78
            name: normalized accuracy
        source:
          url: >-
            https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sethuiyer/Llamaverse-3.1-8B-Instruct
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: MATH Lvl 5 (4-Shot)
          type: hendrycks/competition_math
          args:
            num_few_shot: 4
        metrics:
          - type: exact_match
            value: 18.43
            name: exact match
        source:
          url: >-
            https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sethuiyer/Llamaverse-3.1-8B-Instruct
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: GPQA (0-shot)
          type: Idavidrein/gpqa
          args:
            num_few_shot: 0
        metrics:
          - type: acc_norm
            value: 5.48
            name: acc_norm
        source:
          url: >-
            https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sethuiyer/Llamaverse-3.1-8B-Instruct
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: MuSR (0-shot)
          type: TAUR-Lab/MuSR
          args:
            num_few_shot: 0
        metrics:
          - type: acc_norm
            value: 8.42
            name: acc_norm
        source:
          url: >-
            https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sethuiyer/Llamaverse-3.1-8B-Instruct
          name: Open LLM Leaderboard
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: MMLU-PRO (5-shot)
          type: TIGER-Lab/MMLU-Pro
          config: main
          split: test
          args:
            num_few_shot: 5
        metrics:
          - type: acc
            value: 28.03
            name: accuracy
        source:
          url: >-
            https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=sethuiyer/Llamaverse-3.1-8B-Instruct
          name: Open LLM Leaderboard
tags:
  - mergekit
  - merge
license: llama3.1

Llamaverse 8B

A Unified Multidisciplinary Language Model
Llamaverse-3.1-8B-Instruct is a state-of-the-art language model built on the foundation of MathCoder2-Llama-3-8B, pretrained on MathCode-Pile. This dataset, which embeds mathematical reasoning steps in natural language and code, provides a rock-solid foundation for advanced logical reasoning. By merging MathCoder2 with 10 specialized models using the Model Stock merge method, Llamaverse-3.1-8B-Instruct becomes an unparalleled polymath, excelling in mathematics, biomedical diagnostics, storytelling, coding, and more.

This model was merged using the Model Stock merge method using MathGenie/MathCoder2-Llama-3-8B as a base.

This model works amazing with the Divine Intellect preset!

Models Merged

The following models were included in the merge:

• ruslandev/llama-3-8b-samantha
• nvidia/OpenMath2-Llama3.1-8B
• NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
• TsinghuaC3I/Llama-3.1-8B-UltraMedical
• tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
• Skywork/Skywork-o1-Open-Llama-3.1-8B
• Undi95/Llama-3-LewdPlay-8B
• Locutusque/Hercules-6.1-Llama-3.1-8B
• RefuelAI/Llama-3-Refueled
• rombodawg/Llama-3-8B-Instruct-Coder

Model Stock Merge Ensures balanced integration of diverse expertise without dominance by any single model.

Multidisciplinary Expertise

Llamaverse-3.1-8B-Instruct integrates the strengths of 10 specialized models, including:

1. ruslandev/llama-3-8b-samantha: Empathetic and human-like interaction capabilities.
2. nvidia/OpenMath2-Llama3.1-8B: Advanced mathematical problem-solving.
3. NeverSleep/Llama-3-Lumimaid-8B: Creative storytelling and roleplay.
4. TsinghuaC3I/Llama-3.1-8B-UltraMedical: Clinical-grade biomedical insights.
5. tohur/natsumura-storytelling-rp: Immersive narrative generation.
6. Skywork/Skywork-o1-Open-Llama-3.1-8B: Reflective reasoning and complex problem-solving.
7. Undi95/Llama-3-LewdPlay-8B: Unconventional creativity and boundary-pushing dialogue.
8. Locutusque/Hercules-6.1-Llama-3.1-8B: Expertise in physics, biology, chemistry, and engineering.
9. RefuelAI/Llama-3-Refueled: Robust NLP capabilities for classification and entity extraction.
10. rombodawg/Llama-3-8B-Instruct-Coder: Efficient coding and software development.

Ethical Considerations

Llamaverse-3.1-8B-Instruct must be used responsibly. Users should:

• Avoid deploying the model in high-stakes scenarios without human oversight.
• Be mindful of potential biases and ethical concerns, particularly in sensitive applications.
• Use the model’s creative and unconventional capabilities responsibly.

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: nvidia/OpenMath2-Llama3.1-8B
  - model: Locutusque/Hercules-6.1-Llama-3.1-8B
  - model: RefuelAI/Llama-3-Refueled
  - model: Undi95/Llama-3-LewdPlay-8B
  - model: ruslandev/llama-3-8b-samantha
  - model: rombodawg/Llama-3-8B-Instruct-Coder
  - model: Skywork/Skywork-o1-Open-Llama-3.1-8B
  - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  - model: TsinghuaC3I/Llama-3.1-8B-UltraMedical
  - model: tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
  
merge_method: model_stock
base_model: MathGenie/MathCoder2-Llama-3-8B
dtype: bfloat16

Built by merging models from MathGenie, ruslandev, nvidia, NeverSleep, TsinghuaC3I, tohur, Skywork, Undi95, Locutusque, RefuelAI, and rombodawg. Released under the Llama 3.1 Community License.