--- base_model: - Replete-AI/Replete-LLM-V2-Llama-3.1-8b - bunnycore/HyperLexi-8B-breadcrumbs - mlabonne/Hermes-3-Llama-3.1-8B-lorablated - Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 - rityak/L3.1-IFEvalStock-8B - vicgalle/Configurable-Llama-3.1-8B-Instruct - unsloth/Meta-Llama-3.1-8B - bunnycore/LLama-3.1-Hyper-Stock library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [unsloth/Meta-Llama-3.1-8B](https://huggingface.co/unsloth/Meta-Llama-3.1-8B) as a base. ### Models Merged The following models were included in the merge: * [Replete-AI/Replete-LLM-V2-Llama-3.1-8b](https://huggingface.co/Replete-AI/Replete-LLM-V2-Llama-3.1-8b) * [bunnycore/HyperLexi-8B-breadcrumbs](https://huggingface.co/bunnycore/HyperLexi-8B-breadcrumbs) * [mlabonne/Hermes-3-Llama-3.1-8B-lorablated](https://huggingface.co/mlabonne/Hermes-3-Llama-3.1-8B-lorablated) * [Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2](https://huggingface.co/Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2) * [rityak/L3.1-IFEvalStock-8B](https://huggingface.co/rityak/L3.1-IFEvalStock-8B) * [vicgalle/Configurable-Llama-3.1-8B-Instruct](https://huggingface.co/vicgalle/Configurable-Llama-3.1-8B-Instruct) * [bunnycore/LLama-3.1-Hyper-Stock](https://huggingface.co/bunnycore/LLama-3.1-Hyper-Stock) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: vicgalle/Configurable-Llama-3.1-8B-Instruct - model: mlabonne/Hermes-3-Llama-3.1-8B-lorablated - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2 - model: bunnycore/LLama-3.1-Hyper-Stock - model: bunnycore/HyperLexi-8B-breadcrumbs - model: Replete-AI/Replete-LLM-V2-Llama-3.1-8b - model: rityak/L3.1-IFEvalStock-8B merge_method: model_stock base_model: unsloth/Meta-Llama-3.1-8B dtype: bfloat16 ```