wintercoming6
/

Mixtral-7B-AIPI-finetune-with-8bit-quantization

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Mixtral-7B-AIPI-finetune-with-8bit-quantization / requirements.txt

wintercoming6's picture

Create requirements.txt

3ba7fa2 verified 7 months ago

history blame contribute delete

218 Bytes

	accelerate @ git+https://github.com/huggingface/accelerate.git@4450cb3132034219af8c14dbfd78a157dfe73f2e

	bitsandbytes==0.43.1

	peft @ git+https://github.com/huggingface/peft.git@ed865e2812bd4bf3946292430525d0825b0fab7e