Allow folks to write/provide a dataset_name and possibly naming scheme for output (jsonl, parquet etc) #949
Description
Is your feature request related to a problem? Please describe.
We should explore how to enable folks to write/provide a dataset_name and possibly naming scheme for output (jsonl, parquet etc).
Ray data does this via FilenameProvider . https://docs.ray.io/en/latest/data/api/doc/ray.data.datasource.FilenameProvider.html#ray.data.datasource.FilenameProvider