File size: 1,580 Bytes
ab2be0b
 
9f9ca84
 
ab2be0b
4872e2f
 
 
 
 
 
 
4fe4aab
4872e2f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3351c8c
 
7597e6d
 
 
 
3351c8c
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
---
license: apache-2.0
datasets:
- DrNicefellow/CHAT-ALL-IN-ONE-v1
---
# ChatAllInOne_Mixtral-8x7B-v1

## Description
ChatAllInOne_Mixtral-8x7B-v1 is a chat language model fine-tuned on the CHAT-ALL-IN-ONE-v1 dataset using the QLoRA technique. Originally based on the [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1) model, this version is specifically optimized for diverse and comprehensive chat applications.

## Model Details
- **Base Model**: [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
- **Fine-tuning Technique**: QLoRA
- **Dataset**: [CHAT-ALL-IN-ONE-v1](https://huggingface.co/datasets/DrNicefellow/CHAT-ALL-IN-ONE-v1)
- **Tool Used for Fine-tuning**: [Axolotl](https://github.com/OpenAccess-AI-Collective/axolotl)

## Features
- Enhanced understanding and generation of conversational language.
- Improved performance in diverse chat scenarios, including casual, formal, and domain-specific conversations.
- Fine-tuned to maintain context and coherence over longer dialogues.

## Prompt Format

Vicuna 1.1

See the finetuning dataset for examples.


## License
This model is open-sourced under the Apache 2.0 License. See the LICENSE file for more details.

## Discord Server

Join our Discord server [here](https://discord.gg/xhcBDEM3).


## Feeling Generous? 😊
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: [https://ko-fi.com/drnicefellow](https://ko-fi.com/drnicefellow). Please add a note on which one you want me to drink?