CUDA extension not installed
#1
by
areumtecnologia
- opened
How to solve this warning? CUDA extension not installed.
My server have cuda 12.3 installed and running on Tesla T4
It appears that you were using an auto-gptq package compiled against a different version of CUDA. Please see its documentation for more instructions: https://github.com/AutoGPTQ/AutoGPTQ#installation
Hello!
I hope everyone is well and healthy. My project using this model was extremely slow and I need help finding the solution. I have already reinstalled all the packages and downloaded the model again, but the slowness still continues. Does anyone know what this can be?