Luigi Filho
luigicfilho
AI & ML interests
Dataset generation and curation
Model quantization, pruning, and distillation
TinyML and edge AI deployment
Co-design of hardware (FPGA/ASIC) and ML pipelines
Lightweight LLMs and domain-specific fine-tuning
Recent Activity
reacted
to
marksverdhei's
post
with ๐ฅ
4 days ago
Inspired by the heroes of day zero quants (@TheBloke @danielhanchen @shimmyshimmer @bartowski), I decided to join the race by releasing the first FP8 quant of glm-4.7-flash! Not as easy as i expected, but I'm happy i was still able to have it working within a few hours after the original model was released! Interested in feedback if anyone wants to try it out!
https://huggingface.co/marksverdhei/GLM-4.7-Flash-FP8
Note: If my PR to vLLM isn't merged yet you might have to use my fork. Cheers! ๐ค
liked
a dataset
3 months ago
lamhieu/xllms_dialogue_greetings
new activity
3 months ago
lcdev/README:Update README.md