GusPuffy
/

sq-MythoMax-L2-13b-w4-s0

Text Generation

text-generation-inference

Model card Files Files and versions Community

Edit model card

Part of work associated with sentientsimulations.com

MythoMax L2 13B - SqueezeLLM

Model creator: Gryphe
Original model: MythoMax L2 13B

Description

This repo contains SqueezeLLM model files for Gryphe's MythoMax L2 13B.

About SqueezeLLM

https://github.com/SqueezeAILab/SqueezeLLM

Quantized using the steps here: https://github.com/SqueezeAILab/SqueezeLLM/tree/main/quantization

license: other

Downloads last month: 6

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for GusPuffy/sq-MythoMax-L2-13b-w4-s0

Base model

Gryphe/MythoMax-L2-13b

Quantized

(12)

this model