How to output time with Dask Dataframe index to csv based on time intervals
I have a temporary index frame that I and I want to output to multiple csv files based on 15 minute intervals, is there a way to do this in dask without relying on the app or map? The data source I am using can either be in the same file or split so the existing sections will change.
+3
source to share
1 answer
The best way to deal with this is to use repartition
to repartition the data into 15 minute sections and then use to_csv
to output to files (creates a file for each section).
Something like this should work:
df.repartition(freq='15T').to_csv(...)
+3
source to share