WizardCoder Windows 10 64 bit 8 GB RAM 4 GB VRAM DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes

#5
by CHRISSANTY - opened

Sin título.png

RuntimeError: [enforce fail at ..\c10\core\impl\alloc_cpu.cpp:72] data. DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes.
Presione una tecla para continuar . . .

CHRISSANTY changed discussion title from WizardCoder Windows 10 64 bit 12 GB RAM ModuleNotFoundError: No module named 'peft' to WizardCoder Windows 10 64 bit 8 GB RAM 4 GB VRAM DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes

You don't have enough VRAM or RAM to run this model. The only models you can use are 7B GGML models.

Sign up or log in to comment