lmsys

/

vicuna-7b-v1.1

like 75

Hi,

I'm trying to deploy this on SageMaker, but the deployment code uses the "ml.g5.2xlarge" instance type for the endpoint. Is this the minimum instance type required? Can I use a smaller instance type like g4dn?