Low = more consistent, High = more creative

Maximum number of tokens to generate

Only consider the top K most likely tokens at each step

Cumulative probability threshold

Penalty strength for repeated tokens

Show the response word by word