Hugging Face's logo

kil3r
/
gptj6b-lora-owca

Text Generation
Polish
Model card Files Community
kil3r commited on
Commit
d64296f
•
1 Parent(s): bb8ef0a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,6 +1,6 @@
1
  # This repo contains EleutherAI/gpt-j-6B fine tuned on OWCA (https://github.com/Emplocity/owca) using LoRa
2
 
3
- Training params:
4
  MICRO_BATCH_SIZE = 64
5
  BATCH_SIZE = 128
6
  GRADIENT_ACCUMULATION_STEPS = BATCH_SIZE // MICRO_BATCH_SIZE
 
1
  # This repo contains EleutherAI/gpt-j-6B fine tuned on OWCA (https://github.com/Emplocity/owca) using LoRa
2
 
3
+ Training params:<br/>
4
  MICRO_BATCH_SIZE = 64
5
  BATCH_SIZE = 128
6
  GRADIENT_ACCUMULATION_STEPS = BATCH_SIZE // MICRO_BATCH_SIZE