4
sequences where the API will stop generating further tokens. (default: :obj:None
)0
and :obj:2
. Higher values make the output more random, while lower values make it more focused and deterministic. (default: :obj:None
)0.1
means only the tokens comprising the top 10% probability mass are considered. (default: :obj:None
)None
)-2.0
and :obj:2.0
. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model’s likelihood to repeat the same line verbatim. See more information about frequency and presence penalties. (default: :obj:None
)-2.0
and :obj:2.0
. Positive values penalize new tokens based on whether they appear in the text so far, increasing the model’s likelihood to talk about new topics. See more information about frequency and presence penalties. (default: :obj:None
)True
, the response will be streamed as it is generated. (default: :obj:None
)None
)None
)