Ostrich-70B

Model Card for Ostrich

Finetuned from model: Llama3-70B

Pre Trained With

  • Health, nutrition, medicinal herbs
  • Fasting, faith, healing
  • Nostr notes: bitcoin, libertarian views and other topics discussed on Nostr
  • Some controversial and non mainstream topics

Uses

You can read more about the "LLM curation" via fine tuning with Nostr notes: here and here.

I am using the model here as a ground truth for Nostr related questions: https://wikifreedia.xyz/based-llm-leaderboard/npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9c

I have about 1000 questions that I constantly ask the model to track its performance. You can DM me on Nostr to get the answers to some interesting questions. The answers from this model is quite different than majority of models on "topics that matter". This model might be the most "based".

Warning

Users (both direct and downstream) should be aware of the risks, biases and limitations of the model. The trainer, developer or uploader of this model does not assume any liability. Use it at your own risk. There is no guarantee that the model will be of any use. It may hallucinate often. The answers of this model will be often unreliable and you should do your own research and compare outputs.

Training Details

Training Data

Mostly what makes sense to me. Some books, some videos, some banned videos from youtube.

Training Procedure

LLaMa-Factory is used to train using fsdp_qlora technique.

This is version 43003.

Contributions

You can tip me on Nostr https://primal.net/p/npub1nlk894teh248w2heuu0x8z6jjg2hyxkwdc8cxgrjtm9lnamlskcsghjm9c

By using this LLM you are talking to a combination of content from many great producers. Portions of your support may in the future go to these original content producers and authors.

Downloads last month
16
Safetensors
Model size
70.6B params
Tensor type
BF16
·
Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for some1nostr/Ostrich-Llama-3-70B

Finetuned
(36)
this model
Quantizations
1 model