​
SiliconFlowConfig

class SiliconFlowConfig(BaseConfig):

Defines the parameters for generating chat completions using the SiliconFlow API.

Parameters:

  • temperature (float, optional): Determines the degree of randomness in the response. (default: :obj:None)
  • top_p (float, optional): The top_p (nucleus) parameter is used to dynamically adjust the number of choices for each predicted token based on the cumulative probabilities. (default: :obj:None)
  • n (int, optional): Number of generations to return. (default: :obj:None)
  • response_format (object, optional): An object specifying the format that the model must output. (default: :obj:None)
  • stream (bool, optional): If set, tokens are returned as Server-Sent Events as they are made available. (default: :obj:None)
  • stop (str or list, optional): Up to :obj:4 sequences where the API will stop generating further tokens. (default: :obj:None)
  • max_tokens (int, optional): The maximum number of tokens to generate. (default: :obj:None)
  • frequency_penalty (float, optional): Number between :obj:-2.0 and :obj:2.0. Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model’s likelihood to repeat the same line verbatim. See more information about frequency and presence penalties. (default: :obj:None)
  • tools (list[FunctionTool], optional): A list of tools the model may call. Currently, only functions are supported as a tool. Use this to provide a list of functions the model may generate JSON inputs for. A max of 128 functions are supported. (default: :obj:None)

​
as_dict

def as_dict(self):

Returns:

dict[str, Any]: A dictionary representation of the current configuration.