0
and :obj:2
. Higher values make the output more random, while lower values make it more focused and deterministic. (default: :obj:None
)None
)None
) stop_sequences (List(str), optional): A list of up to 5 strings that the model will use to stop generation. If the model generates a string that matches any of the strings in the list, it will stop generating tokens and return the generated text up to that point not including the stop sequence. (default: :obj:None
)None
)0.0
, max value of 1.0
. Used to reduce repetitiveness of generated tokens. The higher the value, the stronger a penalty is applied to previously present tokens, proportional to how many times they have already appeared in the prompt or prior generation. (default: :obj:None
)0.0
, max value of 1.0
. Used to reduce repetitiveness of generated tokens. Similar to frequency_penalty
, except that this penalty is applied equally to all tokens that have already appeared, regardless of their exact frequencies. (default: :obj:None
)0
, max value of 500
. (default: :obj:None
)p
, are considered for generation at each step. If both k and p are enabled, p
acts after k
. Min value of 0.01
, max value of 0.99
. (default: :obj:None
)