9 21 15

Huiqiang Jiang PRO

iofu728

https://www.microsoft.com/en-us/research/people/hjiang/

AI & ML interests

None yet

Recent Activity

upvoted a paper 1 day ago

Optimizing Large Language Model Training Using FP4 Quantization

liked a model 4 days ago

Qwen/Qwen2.5-14B-Instruct-1M

upvoted a paper 6 days ago

Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models

View all activity

Articles

How to Optimize TTFT of 8B LLMs with 1M Tokens to 20s

Jul 21, 2024

• 2

Organizations

iofu728's activity

commented a paper about 2 months ago

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

Paper • 2412.10319 • Published Dec 13, 2024 • 9 •

New activity in microsoft/SCBench about 2 months ago

rename

#2 opened about 2 months ago by

liyucheng

commented a paper 5 months ago

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Paper • 2409.10516 • Published Sep 16, 2024 • 41 •

New activity in microsoft/MInference 7 months ago

setup.py error

#1 opened 7 months ago by

NicDev

commented 3 papers 7 months ago

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Paper • 2407.02490 • Published Jul 2, 2024 • 23 •

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Paper • 2407.02490 • Published Jul 2, 2024 • 23 •

MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention

Paper • 2407.02490 • Published Jul 2, 2024 • 23 •

New activity in zero-gpu-explorers/README 8 months ago

Asking help for using pycuda on Gradio Zero

#78 opened 8 months ago by

iofu728

commented a paper 8 months ago

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Paper • 2403.12968 • Published Mar 19, 2024 • 25 •

commented a paper 11 months ago

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Paper • 2403.12968 • Published Mar 19, 2024 • 25 •

New activity in microsoft/llmlingua-2-xlm-roberta-large-meetingbank 11 months ago

Feature(LLMLingua-2): update LLMLingua-2 link

#1 opened 11 months ago by

iofu728

New activity in microsoft/llmlingua-2-bert-base-multilingual-cased-meetingbank 11 months ago

Feature(LLMLingua-2): update the LLMLingua-2 link

#1 opened 11 months ago by

iofu728

commented a paper 11 months ago

LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

Paper • 2403.12968 • Published Mar 19, 2024 • 25 •