Skip to main content

​
AtlasCloudConfig

class AtlasCloudConfig(BaseConfig):
Defines the parameters for generating chat completions using OpenAI compatibility. Reference: https://www.atlascloud.ai/docs/en/createChatCompletion Parameters:
  • temperature (float, optional): Sampling temperature to use, between :obj:0 and :obj:2. Higher values make the output more random, while lower values make it more focused and deterministic. (default: :obj:None)
  • top_p (float, optional): An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So :obj:0.1 means only the tokens comprising the top 10% probability mass are considered. (default: :obj:None)
  • stream (bool, optional): If True, partial message deltas will be sent as data-only server-sent events as they become available. (default: :obj:None)
  • max_tokens (int, optional): The maximum number of tokens to generate in the chat completion. The total length of input tokens and generated tokens is limited by the model’s context length. (default: :obj:None)
  • repetition_penalty (float, optional): Penalty for repeated tokens to prevent redundancy. (default: :obj:None)