man i can feel before trying this that its the best of all
#1
by
johantttt22
- opened
what you think? :D
if it is ill be back :D amazing
my hardware:
vram: 4gb
ram: 7.77 gb
cpu: intel core i 5
Maybe the best you can run with your very limited hardware. With your hardware you should be able to run mradermacher's i1-IQ3_S quants available under https://huggingface.co/mradermacher/dolphin-2.9.3-mistral-nemo-12b-llamacppfixed-i1-GGUF