jamesburton
/

Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-GGUF

Inference Endpoints

Model card Files Files and versions Community

Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-GGUF

Commit History

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-F16.gguf

48500a8
verified

jamesburton commited on May 17

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-Q8_0-imat.gguf

7398b7b
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-Q6_K-imat.gguf

b094f33
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-Q5_K_S-imat.gguf

9092ac5
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-Q5_K_M-imat.gguf

b578858
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-Q4_K_S-imat.gguf

768cd65
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-Q4_K_M-imat.gguf

1b6719c
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-IQ4_XS-imat.gguf

eac1580
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-IQ4_NL-imat.gguf

02e4bf8
verified

jamesburton commited on May 16

Upload Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-IQ3_M-imat.gguf

270b904
verified

jamesburton commited on May 16

Added initial model-card elements to README

b0d4989

jamesburton commited on May 16

Added GGUF generation script and configuration, please brief note

fadb488

jamesburton commited on May 16

Added script used to generate GGUF files

9f77b1b
verified

jamesburton commited on May 16

README, imatrix used, and IQ3_XXS GGUF model

c2a10a4
verified

jamesburton commited on May 16

initial commit

82296c2
verified

jamesburton commited on May 15