phanerozoic commited on
Commit
f1aa2cd
1 Parent(s): f123de1

Update README.md

Browse files

updated description

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,4 +7,4 @@ tags:
7
  ---
8
  llama2-piratelora-13b
9
 
10
- This repo contains a Low-Rank Adapter (LoRA) for llama 2 13b (16 float) fit on a simple dataset comprised of thousands of pirate phrases, conversation pieces, and obscura. The purpose behind the generation of this lora was to determine whether enforcement of dialect and diction was possible throug the LoRa fine tuning method.
 
7
  ---
8
  llama2-piratelora-13b
9
 
10
+ This repo contains a Low-Rank Adapter (LoRA) for llama 2 13b (16 float) fit on a simple dataset comprised of thousands of pirate phrases, conversation pieces, and obscura. The purpose behind the generation of this lora was to determine whether enforcement of dialect and diction was possible throug the LoRa fine tuning method. Results were less than perfect, but the LoRa does seem to push the model to stick to maritime and nautical topics when spontaneously prompted to generate.