WizardCoder Windows 10 64 bit 8 GB RAM 4 GB VRAM DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes
#5
by
CHRISSANTY
- opened
CHRISSANTY
changed discussion title from
WizardCoder Windows 10 64 bit 12 GB RAM ModuleNotFoundError: No module named 'peft'
to WizardCoder Windows 10 64 bit 8 GB RAM 4 GB VRAM DefaultCPUAllocator: not enough memory: you tried to allocate 301989888 bytes
You don't have enough VRAM or RAM to run this model. The only models you can use are 7B GGML models.