Nikhil Verma
vermanic
AI & ML interests
None yet
Organizations
vermanic's activity
Incomplete Output even with max_new_tokens
6
#27 opened about 1 year ago
by
vermanic
SFT taking high memory with Transformers (>5x the amount it takes to load model checkpoint )
#29 opened about 1 year ago
by
vermanic
What is right GPU to run this
4
#7 opened about 1 year ago
by
Varunk29
Every Inference gives the prompt as part of output also, any way to remove that?
1
#26 opened about 1 year ago
by
vermanic
Incomplete Output even with max_new_tokens
#26 opened about 1 year ago
by
vermanic
Model doesn't end/terminate generation: Need to modify EOS token
9
#2 opened over 1 year ago
by
eugenesiow
Parallel Inferences using GPU?
#38 opened about 1 year ago
by
vermanic
Invalid shape error
3
#20 opened about 1 year ago
by
vermanic
Invalid shape error
3
#20 opened about 1 year ago
by
vermanic
Invalid shape error
3
#20 opened about 1 year ago
by
vermanic