Zarr tutorial #323
Merged
Zarr tutorial #323
+732
−31
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
|
Thanks @negin513 for your work on this! I took a pass through and made some minor edits ahead of the tutorial on Tuesday but I think this is ready to go! |
jhamman
approved these changes
Jul 6, 2025
|
Thanks for the review @jhamman . LGTM! |
|
I'm currently resolving the build issues, will push some commits and merge shortly. |
|
🎊 PR Preview fe50cbf has been successfully built and deployed to https://xarray-contrib-xarray-tutorial-preview-pr-323.surge.sh 🕐 Build time: 0.009s
🤖 By surge-preview |
scottyhq
approved these changes
Jul 7, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi @TomNicholas
Thanks for helping assign the tasks for the SciPy tutorial. This notebook is an introduction to Zarr, including some fundamentals of the format, key differences from NetCDF, and practical usage with cloud storage.
I ended up diverging from Ryan's notebook to incorporate more Zarr v3 concepts and cloud-scale considerations, especially around sharding.
For the large-scale data example, I recommend using CMIP6 hosted on Google Cloud, as it’s both substantial and publicly accessible via xarray and we already have the content ready.
I may not have much more bandwidth or time to continue working on this due to the other SciPy presentation preparations and tight timeline. Let me know if you'd like me to make any adjustments, or if it’s easier, I can give you collaborator access so you can push changes directly to the branch.
cc'd @jhamman since you are presenting this.
Resolves some tasks of Issue #321 .