| # Generation parameters | |
| For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig | |
| ### llama.cpp | |
| llama.cpp only uses the following parameters: | |
| * temperature | |
| * top_p | |
| * top_k | |
| * repetition_penalty | |
| * tfs | |
| * mirostat_mode | |
| * mirostat_tau | |
| * mirostat_eta | |
| ### ExLlama | |
| ExLlama only uses the following parameters: | |
| * temperature | |
| * top_p | |
| * top_k | |
| * repetition_penalty | |
| * repetition_penalty_range | |
| * typical_p | |
| ### RWKV | |
| RWKV only uses the following parameters when loaded through the old .pth weights: | |
| * temperature | |
| * top_p | |
| * top_k | |