Defines the parameters for generating chat completions using the
Moonshot API. You can refer to the following link for more details:
https://platform.moonshot.cn/docs/api-referenceParameters:
temperature (float, optional): Controls randomness in the response. Lower values make the output more focused and deterministic. (default: :obj:None)
max_tokens (int, optional): The maximum number of tokens to generate. (default: :obj:None)
stream (bool, optional): Whether to stream the response. (default: :obj:False)
tools (list, optional): List of tools that the model can use for function calling. Each tool should be a dictionary containing type, function name, description, and parameters. (default: :obj:None)
top_p (float, optional): Controls diversity via nucleus sampling. (default: :obj:None)
n (int, optional): How many chat completion choices to generate for each input message.(default: :obj:None)
presence_penalty (float, optional): Penalty for new tokens based on whether they appear in the text so far. (default: :obj:None)
frequency_penalty (float, optional): Penalty for new tokens based on their frequency in the text so far. (default: :obj:None)
stop (Optional[Union[str, List[str]]], optional): Up to 4 sequences where the API will stop generating further tokens. (default: :obj:None)