Article
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
•
63
Gal Sarid
GalSarid
·
AI & ML interests
LLMs, RAG systems, LLM based RAG systems
Sentiment-Analysis, Text based classifications
Recent Activity
upvoted
an
article
17 days ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
upvoted
an
article
7 months ago
Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding
upvoted
a
paper
9 months ago
Distributed Speculative Inference of Large Language Models
Organizations
GalSarid's activity
upvoted
an
article
17 days ago
upvoted
an
article
7 months ago
Article
Accelerate StarCoder with 🤗 Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding
•
9
upvoted
a
paper
9 months ago
upvoted
an
article
9 months ago
Article
CPU Optimized Embeddings with 🤗 Optimum Intel and fastRAG
•
8