Dataset
from PyTorch and should
be used when its size is fixed at runtime.
This class can initialize from Hugging Face Datasets,
PyTorch Datasets, JSON file paths, or lists of dictionaries,
converting them into a consistent internal format.
HFDataset
). - A PyTorch Dataset (:obj:torch.utils.data.Dataset
). - A :obj:Path
object representing a JSON or JSONL file. - A list of dictionaries with :obj:DataPoint
-compatible fields.42
)1
)True
) or skip/filter them (:obj:False
). (default: :obj:False
) **kwargs: Additional dataset parameters.DataPoint
instances.
Parameters:
DataPoint
instances.
DataPoint
objects.
DataPoint
.
DataPoint
.HF_TOKEN
(default: :obj:None
)"records/records.json"
)False
)None
)None
)None
)None
)None
)None
)None
) **kwargs (Any): Additional keyword arguments to pass to the Hugging Face API.