Configuration
When the open_dataset
function is called with a string that does not
end with .zarr
or .zip
, it is considered a dataset name and not
a path or a URL.
In that case, the Anemoi configuration is read from
~/.config/anemoi/settings.toml
. Below is an example of such a
configuration:
[datasets]
path = [
"/home/mlx/ai-ml/datasets/stable",
"/home/mlx/ai-ml/datasets/experimental",
"/home/mlx/ai-ml/datasets/testing",
"s3://ml-datasets",
]
[datasets.named]
test = "/home/mlx/test-dataset.zarr"
Then, the name passed to open_dataset
is used to look for a possible
path or URL:
If the name is listed in the
[datasets.named]
, the corresponding path is usedOtherwise suffix
.zarr
is added to the name and the file is searched at every location listed in thepath
list.
See Miscellaneous functions to modify the list of named datasets and the path temporarily.