removing bnb config
eed1d08
Pierce Maloney
commited on
Commit History
quantization trial
b358b49
Pierce Maloney
commited on
adding another variation of Admitted.
7e24db7
Pierce Maloney
commited on
Admitted bad words
c5184ea
Pierce Maloney
commited on
adding logging + some bad words
31cf0d3
Pierce Maloney
commited on
adding back truncation
eebf1ef
Pierce Maloney
commited on
lowering temp to 0.7
0425154
Pierce Maloney
commited on
taking out .to(cuda)
c5d86f3
Pierce Maloney
commited on
back to .generate. forgot about returning gen ids
dee492f
Pierce Maloney
commited on
bug + only new tokens
813fd4a
Pierce Maloney
commited on
bugfix
355a0ec
Pierce Maloney
commited on
pipeline trial
a36be93
Pierce Maloney
commited on
torch.cuda.empty_cache()
b873ed7
Pierce Maloney
commited on
taking out truncation of input_ids
8cda5e7
Pierce Maloney
commited on
do_sample=True, and model.to('cuda')
b179918
Pierce Maloney
commited on
truncating earliest tokens if longer than 4092
6d8b690
Pierce Maloney
commited on
arg name change, Abort
4c4f932
Pierce Maloney
commited on
adding periods back, adding Aborted.
d8be130
Pierce Maloney
commited on
taking out . after Abort etc
4705b72
Pierce Maloney
commited on
adding Ab ort . to bad words
b356a46
Pierce Maloney
commited on
adding additional bad words ids
66e62c6
Pierce Maloney
commited on
banning Admitted and Abort
0e224b1
Pierce Maloney
commited on
banning token 13
b29c898
Pierce Maloney
commited on
returning generated ids
392d92f
Pierce Maloney
commited on
getting generated_ids[0]
5e35500
Pierce Maloney
commited on
back to normal, removed additional bad words argument
216cf30
Pierce Maloney
commited on
adding intros k v l. to bad words (for testing)
60ed7ab
Pierce Maloney
commited on
using .generate, returning ids, custom bad_words
000ad8b
Pierce Maloney
commited on
adding new bad word
833b301
Pierce Maloney
commited on
returning ids
88fdb99
Pierce Maloney
commited on
printing generated ids
2872c1c
Pierce Maloney
commited on
testing .generate instead of pipeline
366e62e
Pierce Maloney
commited on
testing custom logit processor for bad words
02ffbef
Pierce Maloney
commited on
temp=2! top_k 40, 1 ret seq
37b54cb
Pierce Maloney
commited on
num ret seqs 2
cb274aa
Pierce Maloney
commited on
testing high temperature
e1040a6
Pierce Maloney
commited on
adding second way of describing bad word (*
26070b4
Pierce Maloney
commited on
increase temp, add top_k=20
320c7f3
Pierce Maloney
commited on
XXS comment
4f7f1d5
Pierce Maloney
commited on
temperature 0.7
cd860a6
Pierce Maloney
commited on
only return new generated tokens, bad_words = comments
d1e4ec5
Pierce Maloney
commited on
base llemma-7b and custom handler.py
bf66e5a
Pierce Maloney
commited on