Parcels version
v4
Description
As described in Parcels-code/parcels-benchmarks#49, using to_windowed_arrays() when streaming data directly from the copernicusmarine store is approximately 25x slower than temporarily storing the files to disk.
As streaming the data from CopernicusMarine is the preferred way (no need for temporary storage, and able to scale to much larger datasets than required here), this slowdown is not acceptable.
Code sample
See the script at https://github.com/Parcels-code/parcels-benchmarks/blob/Copernicus_streaming/benchmarks/copernicusstreaming.py
Parcels version
v4
Description
As described in Parcels-code/parcels-benchmarks#49, using
to_windowed_arrays()when streaming data directly from the copernicusmarine store is approximately 25x slower than temporarily storing the files to disk.As streaming the data from CopernicusMarine is the preferred way (no need for temporary storage, and able to scale to much larger datasets than required here), this slowdown is not acceptable.
Code sample
See the script at https://github.com/Parcels-code/parcels-benchmarks/blob/Copernicus_streaming/benchmarks/copernicusstreaming.py