No Cuda Information / nvidia-smi / nvtop
#17
by
nudelbrot
- opened
When running the model I cannot see any CUDA activity inside nvtop. The model does however produce text. Within the same environment, loading a different HF model, I can see my activity/utilization just fine.
@nudelbrot
when you load our model are you using trust_remote_code flag?