Update README.md
Browse files
README.md
CHANGED
|
@@ -3,6 +3,38 @@ language:
|
|
| 3 |
- en
|
| 4 |
---
|
| 5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
Someone questioned my model naming scheme. Good question. Here's how I chose my model names.
|
| 7 |
```
|
| 8 |
Stheno --> 13B L2 Merge Serie ---> It all Began Here --> stolen from discord, someone's idea
|
|
@@ -36,5 +68,3 @@ Next question. What's the worst cases I've seen so far?
|
|
| 36 |
A traumatic arrest, a few cardiac arrests, accidents here and there. Most shifts are okay though. Some shifts are just tough but it is what it is.
|
| 37 |
|
| 38 |
***
|
| 39 |
-
|
| 40 |
-
For future me to fill in
|
|
|
|
| 3 |
- en
|
| 4 |
---
|
| 5 |
|
| 6 |
+
09/03/24 - Just rambling on about my future plans
|
| 7 |
+
|
| 8 |
+
I don't even know what to do man. So many ideas, so little money and time.
|
| 9 |
+
|
| 10 |
+
I'm practically waiting on my paycheck so I can continue training.
|
| 11 |
+
|
| 12 |
+
Current Plans
|
| 13 |
+
|
| 14 |
+
- 14B-Glacier-Finetune - Sure a Full Finetune would be good but that would be expensive. A LoRA maybe? The goal is to smoothen out the tensors and repair brain damage that happens after frankenmerge.
|
| 15 |
+
|
| 16 |
+
- Typhon-Mixtral Finetune - I have compiled a nice dataset to further fine-tune on this merge of mine, to hopefully improve results. Unsure if I should further DPO this one too? On non-gpt4 data of course unlike current DPO pairs.
|
| 17 |
+
|
| 18 |
+
- 11B-Fimbulvetr-v3 - I have ideas. Unsure if it would make it that much better or if it will be a side-grade.
|
| 19 |
+
|
| 20 |
+
- Claude-3 Output-based Instruct Dataset - Cool Idea maybe? It'll introduce atleast a different '-ism' compared to GPT-4 ones out there which are generic. Claude is somewhat more human-like. I do have access so this is not as big of an issue. I just need more time.
|
| 21 |
+
|
| 22 |
+
- Yi Tunes - Yeah this is on the backburner for a while. I'll think on it. I've struggled with Yi-tunes in the past. Most of mine are privated.
|
| 23 |
+
|
| 24 |
+
Ignoring that, man having gauze packed into a wound hurts like hell without painkillers. My bad, old patients of mine back when I was a nursing student. You all made it look not that bad.
|
| 25 |
+
|
| 26 |
+
Anyway, here's something I've been listening to this past week. Some random music for someone who read this entire thing haha.
|
| 27 |
+
|
| 28 |
+
[Here](https://www.youtube.com/watch?v=t05Bd6xSn6c)
|
| 29 |
+
|
| 30 |
+
***
|
| 31 |
+
|
| 32 |
+
Hello
|
| 33 |
+
|
| 34 |
+
***
|
| 35 |
+
|
| 36 |
+
Initial Ramble:
|
| 37 |
+
|
| 38 |
Someone questioned my model naming scheme. Good question. Here's how I chose my model names.
|
| 39 |
```
|
| 40 |
Stheno --> 13B L2 Merge Serie ---> It all Began Here --> stolen from discord, someone's idea
|
|
|
|
| 68 |
A traumatic arrest, a few cardiac arrests, accidents here and there. Most shifts are okay though. Some shifts are just tough but it is what it is.
|
| 69 |
|
| 70 |
***
|
|
|
|
|
|