Hugging Face's logo
Joshua Rosenkranz's picture
5 1 2

Joshua Rosenkranz

JRosenkranz
nairbv's profile picture dfbdokk's profile picture GigaBoy's profile picture
·

AI & ML interests

None yet

Recent Activity

new activity about 15 hours ago
ibm-fms/llama3-8b-accelerator:Unexpectedly Large Memory Usage of ibm-fms/llama3-8b-accelerator in vLLM
new activity 3 months ago
ibm-granite/granite-20b-code-instruct-accelerator:r1.1
updated a model 3 months ago
ibm-granite/granite-20b-code-instruct-accelerator
View all activity

Articles

Organizations

IBM's profile picture ibm-ai-platform's profile picture LLHF's profile picture SLLHF's profile picture blhf's profile picture nltpt's profile picture

JRosenkranz's activity

New activity in ibm-fms/llama3-8b-accelerator about 15 hours ago

Unexpectedly Large Memory Usage of ibm-fms/llama3-8b-accelerator in vLLM

1
#4 opened 24 days ago by
baizhuoyan
New activity in ibm-granite/granite-20b-code-instruct-accelerator 3 months ago

r1.1

1
#3 opened 3 months ago by
sahilsuneja
New activity in ibm-fms/llama3-8b-accelerator 8 months ago

ValueError: Unsupported model type mlp_speculator using TGI server

2
#2 opened 8 months ago by
rishabh-simpplr
New activity in ibm-fms/granite-7b-lab-accelerator 8 months ago

Error: prefill failed

4
#1 opened 9 months ago by
ulrichkr
New activity in ibm-fms/llama3-8b-accelerator 8 months ago

shard 0 never ready when given the speculator option?

7
#1 opened 9 months ago by
mhill4980

shard 0 never ready when given the speculator option?

7
#1 opened 9 months ago by
mhill4980
New activity in ibm-fms/granite-7b-lab-accelerator 8 months ago

Error: prefill failed

4
#1 opened 9 months ago by
ulrichkr
New activity in ibm-fms/llama3-8b-accelerator 8 months ago

shard 0 never ready when given the speculator option?

7
#1 opened 9 months ago by
mhill4980
New activity in ibm-fms/granite-7b-lab-accelerator 9 months ago

Error: prefill failed

4
#1 opened 9 months ago by
ulrichkr