​
MoonshotConfig

class MoonshotConfig(BaseConfig):

Defines the parameters for generating chat completions using the Moonshot API. You can refer to the following link for more details: https://platform.moonshot.cn/docs/api-reference

Parameters:

  • temperature (float, optional): Controls randomness in the response. Lower values make the output more focused and deterministic. (default: :obj:None)
  • max_tokens (int, optional): The maximum number of tokens to generate. (default: :obj:None)
  • stream (bool, optional): Whether to stream the response. (default: :obj:False)
  • tools (list, optional): List of tools that the model can use for function calling. Each tool should be a dictionary containing type, function name, description, and parameters. (default: :obj:None)
  • top_p (float, optional): Controls diversity via nucleus sampling. (default: :obj:None)
  • n (int, optional): How many chat completion choices to generate for each input message.(default: :obj:None)
  • presence_penalty (float, optional): Penalty for new tokens based on whether they appear in the text so far. (default: :obj:None)
  • frequency_penalty (float, optional): Penalty for new tokens based on their frequency in the text so far. (default: :obj:None)
  • stop (Optional[Union[str, List[str]]], optional): Up to 4 sequences where the API will stop generating further tokens. (default: :obj:None)