Inference Endpoint Error
#10
by
nameth
- opened
Any suggestions to this error while running this on an inference endpoint?
{'error': 'Input validation error: max_new_tokens must be <= 1. Given: 100',
'error_type': 'validation'}
i would say is something specific of your endpoint, the model works ok.