openai.ChatCompletion.create()
. If :obj:None
, :obj:SGLangConfig().as_dict()
will be used. (default: :obj:None
)None
)"http://127.0.0.1:30000/v1"
will be used. (default: :obj:None
)OpenAITokenCounter( ModelType.GPT_4O_MINI)
will be used. (default: :obj:None
)None
)3
) **kwargs (Any): Additional arguments to pass to the client initialization.ChatCompletion
in the non-stream mode, or
Stream[ChatCompletionChunk]
in the stream mode.
30
)