Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

autochunk: option to save all simulated data to disk #139

Open
caglorithm opened this issue Feb 16, 2021 · 2 comments
Open

autochunk: option to save all simulated data to disk #139

caglorithm opened this issue Feb 16, 2021 · 2 comments
Assignees
@caglorithm
Labels
discussion Just for discussion (no action required, yet). enhancement Enhancing neurolib. feature request I have a wish!

Comments

@caglorithm
Copy link
Member

WIP, maybe netcdf?
@caglorithm caglorithm added feature request I have a wish! enhancement Enhancing neurolib. discussion Just for discussion (no action required, yet). labels Feb 16, 2021
@jajcayn
Copy link
Collaborator

jajcayn commented Feb 16, 2021

yes, that would be doable.. xarray supports saving to netcdf with a option, which is append. AFAIK, each chunk would be saved with correct time dimension with a option, and this would result in one big nc file with stitched chunks

@caglorithm
Copy link
Member Author

caglorithm commented Feb 16, 2021 •
edited
Loading

Another option would be storing into HDF files btw. Will also consider it, but xarray is nice because its structured and probably more flexible.

I guess I'll get my hands dirty with xarray & netcdf then and ask for your help :)

@caglorithm caglorithm self-assigned this May 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@caglorithm caglorithm

Labels
discussion Just for discussion (no action required, yet). enhancement Enhancing neurolib. feature request I have a wish!
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jajcayn @caglorithm