|
--- |
|
license: apache-2.0 |
|
base_model: |
|
- meta-llama/Meta-Llama-3-70B-Instruct |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
 |
|
|
|
# Model Card for Ostrich |
|
|
|
**Finetuned from model:** [Llama3-70B](https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct) |
|
|
|
# Pre Trained With |
|
|
|
- Health, nutrition, medicinal herbs |
|
- Fasting, faith, healing |
|
- Nostr notes: bitcoin, libertarian views and other topics discussed on [Nostr](https://coracle.social/) |
|
- Some controversial and non mainstream topics |
|
|
|
|
|
# Uses |
|
|
|
|
|
You can read more about the "LLM curation" via fine tuning with Nostr notes: |
|
[here](https://habla.news/a/naddr1qvzqqqr4gupzp8lvwt2hnw42wu40nec7vw949ys4wgdvums0svs8yhktl8mhlpd3qqgx6cnjvfhhzet20pkhqdn2wenkvu6gy4y) and |
|
[here](https://habla.news/a/naddr1qvzqqqr4gupzp8lvwt2hnw42wu40nec7vw949ys4wgdvums0svs8yhktl8mhlpd3qqxnzde3xumrswfjx56rjwf4kkqhsx). |
|
|
|
I am using the model here as a ground truth for Nostr related questions: https://wikifreedia.xyz/based-llm-leaderboard/npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9c |
|
|
|
I have about 1000 questions that I constantly ask the model to track its performance. |
|
You can DM me on Nostr to get the answers to some interesting questions. |
|
The answers from this model is quite different than majority of models on "topics that matter". |
|
This model might be the most "based". |
|
|
|
|
|
# Warning |
|
|
|
Users (both direct and downstream) should be aware of the risks, biases and limitations of the model. |
|
The trainer, developer or uploader of this model does not assume any liability. Use it at your own risk. |
|
There is no guarantee that the model will be of any use. It may hallucinate often. |
|
The answers of this model will be often unreliable and you should do your own research and compare outputs. |
|
|
|
# Training Details |
|
|
|
## Training Data |
|
|
|
Mostly what makes sense to me. Some books, some videos, some banned videos from youtube. |
|
|
|
## Training Procedure |
|
|
|
LLaMa-Factory is used to train using fsdp_qlora technique. |
|
|
|
This is version 43003. |
|
|
|
# Contributions |
|
|
|
You can tip me on Nostr https://primal.net/p/npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9c |
|
|
|
By using this LLM you are talking to a combination of content from many great producers. Portions of your support may in the future go to these original content producers and authors. |
|
|
|
|
|
# Sponsored by |
|
|
|
https://pickabrain.ai |
