BlinkDL commited on
Commit
b481a02
1 Parent(s): d0859a5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -2,9 +2,9 @@
2
  license: apache-2.0
3
  ---
4
 
5
- Use rwkv pip package 0.8.6+ for RWKV-5. Might overflow in fp16. Use fp32.
6
 
7
- Very interesting. RWKV-5 is great at benchmarks (excellent zeroshot performance), but generates quite worse music (just like GPT models) despite lower loss.
8
 
9
  This fits my theory: Dot-product is good for uncreative work, while Channelwise is good for creative work.
10
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ Use rwkv pip package 0.8.7+ for RWKV-5 inference.
6
 
7
+ Interesting fact: RWKV-5 is great at benchmarks (excellent zeroshot performance), but generates quite worse music (just like GPT models) despite lower loss.
8
 
9
  This fits my theory: Dot-product is good for uncreative work, while Channelwise is good for creative work.
10