Skip to main content

NemotronRewardModel

Reward model based on the Nemotron model with OpenAI compatibility. Parameters:
  • model_type (Union[ModelType, str]): Model for which a backend is created.
  • api_key (Optional[str], optional): The API key for authenticating with the model service. (default: :obj:None)
  • url (Optional[str], optional): The url to the model service.
Note: The Nemotron model does not support model config.

init

evaluate

Evaluate the messages using the Nemotron model. Parameters:
  • messages (List[Dict[str, str]]): A list of messages where each message is a dictionary format.
Returns: Dict[str, float]: A dictionary mapping score types to their values.

get_scores_types

Returns: List[str]: A list of score types that the reward model can return.

_parse_scores

Parse the scores from the response. Parameters:
  • response (ChatCompletion): A ChatCompletion object with the scores.
Returns: Dict[str, float]: A dictionary mapping score types to their values.