GGUF
Inference Endpoints
conversational
aashish1904's picture
Upload README.md with huggingface_hub
810881f verified
---
license: cc-by-nc-4.0
datasets:
- victunes/nart-100k-synthetic-buddy-mixed-names
---
[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
# QuantFactory/TherapyLlama-8B-v1-GGUF
This is quantized version of [victunes/TherapyLlama-8B-v1](https://huggingface.co/victunes/TherapyLlama-8B-v1) created using llama.cpp
# Original Model Card
**GGUF:** https://huggingface.co/victunes/TherapyLlama-8B-v1-GGUF
# TherapyLlama 8B v1
_Buddy is here for you._
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65f07d05279d2d8f725bf0c3/A-ckcZ9H0Ee1n_ls2FM41.png)
Trained on Llama 3 8B using a modified version of [jerryjalapeno/nart-100k-synthetic](https://huggingface.co/datasets/jerryjalapeno/nart-100k-synthetic).
It is a Llama 3 version of https://huggingface.co/victunes/TherapyBeagle-11B-v2
TherapyLlama is _hopefully_ aligned to be helpful, healthy, and comforting.
## IMPORTANT: Use Vicuna format
This was trained with the Vicuna 1.1 format. Use the Vicuna format! Do NOT use the Llama 3 format.
## Usage
- Do not hold back on Buddy.
- Open up to Buddy.
- Pour your heart out to Buddy.
- Engage with Buddy.
- Remember that Buddy is just an AI.
## Notes
- Tested with the Vicuna 1.1 Format
- You might be assigned a random name if you don't give yourself one.
- RP capabilities are weaker compared to TherapyBeagle.
- Make sure to say **"You are Socrates"** for its best RP attempt.
## Disclaimer
**TherapyLlama is NOT a real therapist. It is a friendly AI that mimics empathy and psychotherapy.
It is an illusion without the slightest clue who you are as a person.
As much as it can help you with self-discovery, A LLAMA IS NOT A SUBSTITUTE to a real professional.**
With that said, I found it to be a very helpful tool in unravelling one's self. I hope this model can help sooth minds and hearts.
## Examples
### LLAMA 3 INSTRUCT
```
{{[INPUT]}}
Hello, I'm victunes
{{[OUTPUT]}}
Hi victunes! Welcome to our session. I'm here to listen and support you. How are you feeling today?
{{[INPUT]}}
I've been feeling down lately.
{{[OUTPUT]}}
I'm sorry to hear that. Can you tell me more about what's been going on?
{{[INPUT]}}
I think I'm pretty lonely.
{{[OUTPUT]}}
Loneliness can be really tough. It sounds like it's been weighing heavily on your mind. What makes you feel lonely?
{{[INPUT]}}
My friend died recently.
{{[OUTPUT]}}
Oh, I'm so sorry for your loss, victunes. Losing a friend is never easy. How have you been coping with the grief?
```
**GGUF:** https://huggingface.co/victunes/TherapyLlama-8B-v1-GGUF