37 35 64

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Articles

Organizations

marcsun13's activity

liked 3 models 1 day ago

HF1BitLLM/Llama3-8B-1.58-Sigmoid-k100-10B-tokens

Text Generation • Updated 1 day ago • 14 • 9

HF1BitLLM/Llama3-8B-1.58-Linear-10B-tokens

Text Generation • Updated 1 day ago • 7 • 6

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated about 18 hours ago • 510 • 28

liked a space 8 days ago

Running

🌐

Mapping the AI OS community

liked a space about 1 month ago

Running

🦙

Wllama

Run GGUF directly on your browser!

liked a model about 2 months ago

meta-llama/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated about 1 month ago • 60.3k • 163

liked 2 models 3 months ago

google/gemma-2-9b

Text Generation • Updated Aug 7 • 76k • 552

neuralmagic/Meta-Llama-3-8B-Instruct-FP8

Text Generation • Updated Jul 18 • 10.3k • 17

liked a model 4 months ago

ISTA-DASLab/Meta-Llama-3-8B-AQLM-PV-2Bit-1x16

Text Generation • Updated May 31 • 18 • 2

liked 4 models 5 months ago

meta-llama/Meta-Llama-3-70B-Instruct

Text Generation • Updated about 1 month ago • 209k • • 1.39k

meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • Updated May 29 • 2.09M • • 3.42k

meta-llama/Meta-Llama-3-8B

Text Generation • Updated May 13 • 2.19M • 5.66k

mistralai/Mixtral-8x22B-v0.1

Text Generation • Updated 30 days ago • 4.76k • 190

liked a model 6 months ago

google/flan-t5-xxl

Text2Text Generation • Updated Jul 27, 2023 • 573k • 1.17k

liked 2 spaces 7 months ago

Running

🔥

Compute Pipeline Size

Running on CPU Upgrade

430

🪄🪩

LoRA Studio

Browse and run thousands of community trained LoRAs

liked a model 8 months ago

facebook/blenderbot-400M-distill

Text2Text Generation • Updated Mar 30, 2023 • 40.6k • 378

liked a space 8 months ago

Running

🤗

HFBA

A collection of Huggies!

liked a model 8 months ago

TinyLlama/TinyLlama-1.1B-Chat-v1.0

Text Generation • Updated Mar 17 • 622k • 1.06k

liked 3 spaces 8 months ago

Running on Zero

811

🧑🏿🧑🏽‍🦱

IP-Adapter-FaceID

Running on Zero

1.73k

📷

PhotoMaker

Running on Zero

613

📷 🎨

PhotoMaker Style

liked 2 models 8 months ago

nielsr/slimsam-50-uniform

Mask Generation • Updated Jan 8 • 958 • 3

turboderp/Mixtral-8x7B-instruct-exl2

Updated Dec 18, 2023 • 70 • 74

liked 4 models 9 months ago

ybelkada/Mixtral-8x7B-Instruct-v0.1-bnb-4bit

Text Generation • Updated Jan 12 • 187 • 58

mlx-community/Llama-2-7b-chat-4-bit

Text Generation • Updated Dec 24, 2023 • 76 • 6

mlx-community/Mistral-7B-Instruct-v0.2-4-bit

Text Generation • Updated Dec 27, 2023 • 63 • 23

microsoft/phi-2

Text Generation • Updated Apr 29 • 335k • 3.23k

liked a space 9 months ago

Configuration error

5.51k

🥑

DALL·E mini

liked a model 9 months ago

dalle-mini/dalle-mini

Text-to-Image • Updated Jan 11, 2023 • 296 • 350

liked 3 spaces 9 months ago

Running

320

🪪

ID Document Recognition SDK

FaceOnLive On-Premise Solution

Running

2.19k

🏢

OutfitAnyone

Running

3.53k

🏆🤖

Chatbot Arena Leaderboard

liked 2 models 9 months ago

TheBloke/phi-2-GPTQ

Text Generation • Updated Dec 18, 2023 • 182 • 29

TheBloke/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 1.93k • 127

liked a model 10 months ago

mlx-community/Llama-2-7b-chat-mlx

Text Generation • Updated Dec 20, 2023 • 14 • 84

liked a model 12 months ago

meta-llama/Llama-2-7b-hf

Text Generation • Updated Apr 17 • 947k • 1.68k

liked a dataset about 1 year ago

huggingface/documentation-images

Viewer • Updated 1 day ago • 32 • 32 • 30

liked a model about 1 year ago

TheBloke/Falcon-180B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 62 • 68

liked a space about 1 year ago

Running

197

😻

Repo duplicator

liked a model about 1 year ago

facebook/bart-large-mnli

Zero-Shot Classification • Updated Sep 5, 2023 • 3.28M • • 1.12k

liked 4 spaces about 1 year ago

Running on CPU Upgrade

8.07k

👩‍🎨

AI Comic Factory

Create your own AI comic with a single prompt

Running on CPU Upgrade

755

🚀

Model Memory Utility

Running

🏃

Candle Llama2

Running

412

📝

The Tokenizer Playground

Experiment with and compare different tokenizers

liked a model about 1 year ago

codellama/CodeLlama-7b-hf

Text Generation • Updated Apr 12 • 64.4k • 317

liked 3 spaces about 1 year ago

Running on T4

935

📞

Seamless M4T

Runtime error

376

🐨

IDEFICS Playground

Restarting on A100

983

🔎 🖼️

LoRA the Explorer

Explore fun LoRAs and generate wi

liked 2 models about 1 year ago

huggyllama/llama-7b

Text Generation • Updated Jul 2 • 97.5k • 280

meta-llama/Llama-2-7b

Text Generation • Updated Apr 17 • 4.06k

liked 2 spaces about 1 year ago

Paused

576

👁

Image To Story

Running

111

🌟

Compressed Stable Diffusion

liked 2 models about 1 year ago

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 17.5k • 358

DeepFloyd/IF-I-XL-v1.0

Text-to-Image • Updated Jun 2, 2023 • 13.4k • 609

liked 5 spaces about 1 year ago

Running on CPU Upgrade

🌖

Accelerate Examples

Running on CPU Upgrade

1.2k

💻

Explore Llamav2 With TGI

Running

921

📈

Big Code Models Leaderboard

Running

363

🏆🏋️

LLM-Perf Leaderboard

Running on L4

1.01k

📉

Marc Sun

AI & ML interests

Articles

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Accelerate 1.0.0

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

quanto: a pytorch quantization toolkit

Overview of natively supported quantization schemes in 🤗 Transformers

Making LLMs lighter with AutoGPTQ and transformers

Organizations

marcsun13's activity

Mapping the AI OS community

Wllama

Compute Pipeline Size

LoRA Studio

HFBA

IP-Adapter-FaceID

PhotoMaker

PhotoMaker Style

DALL·E mini

ID Document Recognition SDK

OutfitAnyone

Chatbot Arena Leaderboard

Repo duplicator

AI Comic Factory

Model Memory Utility

Candle Llama2

The Tokenizer Playground

Seamless M4T

IDEFICS Playground

LoRA the Explorer

Image To Story

Compressed Stable Diffusion

Accelerate Examples

Explore Llamav2 With TGI

Big Code Models Leaderboard

LLM-Perf Leaderboard

ControlNet V1.1