Optimize Response Length and Quality

#26

by stargazer09 - opened Nov 11, 2023

Nov 11, 2023

How can we improve the quality and reduce the length of chatbot responses by customizing the parameters? Can we load the model in 8-bit format to further reduce the size and improve the performance of the chatbot?

stargazer09 changed discussion title from Optimize Chatbot Response Length and Quality to Optimize Response Length and Quality Nov 11, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment