how did you create it?
#1
by
erichartford
- opened
how did you create this?
did you use their conversation script? They have some special logic in there
https://huggingface.co/deepseek-ai/DeepSeek-V3/blob/main/inference/fp8_cast_bf16.py
how did you create this?
did you use their conversation script? They have some special logic in there
https://huggingface.co/deepseek-ai/DeepSeek-V3/blob/main/inference/fp8_cast_bf16.py
Yes correct, we read through their script and implemented it!
erichartford
changed discussion status to
closed