None
)0
and :obj:2
. Higher values make the output more random, while lower values make it more focused and deterministic. (default: :obj:None
)0.1
means only the tokens comprising the top 10% probability mass are considered. (default: :obj:None
)None
)"none"
means the model will not call any tool and instead generates a message. :obj:"auto"
means the model can pick between generating a message or calling one or more tools. :obj:"required"
means the model must call one or more tools. Specifying a particular tool via {"type": "function", "function": {"name": "my_function"}}
forces the model to call that tool. :obj:"none"
is the default when no tools are present. :obj:"auto"
is the default if tools are present."low"
, :obj:"medium"
, or :obj:"high"
. If set, it is only applied to the model types that support it (e.g., :obj:o1
, :obj:o1mini
, :obj:o1preview
, :obj:o3mini
). If not provided or if the model type does not support it, this parameter is ignored. (default: :obj:None
)