Use multi-part upload on zarr chunks larger than 5GB - #1839

Closed

jjnesbitt wants to merge 18 commits into

zarr-multipart-upload

Commits on Apr 29, 2026

Use multi-part upload on files larger than 5GB
jjnesbitt
committed
0894a06
Unify multipart upload logic between zarrs and blobs
jjnesbitt
committed
b3bf063
Fix zarr params to multi-part upload function
jjnesbitt
committed
4490bbb
Fix linting
jjnesbitt
committed
3772cc4
Fix typing error
jjnesbitt
committed
0ded7f9
Move test import to top of file
jjnesbitt
committed
6e9064b
Use multi-part checksums for multi-part zarr uploads
jjnesbitt
committed
57b353f
Add test for multi-part zarr upload
jjnesbitt
committed
9bc2976
Merge multipart behavior into md5file_nocache func
jjnesbitt
committed
6d99670
Ignore incorrect type checking error
jjnesbitt
committed
871294b
Rename zarr upload batch vars: large_items->multipart_items, items_to_upload->singlepart_items

yarikoptic
and
claude
committed
a5bfdd7

Commits on Apr 30, 2026

Gate zarr multipart upload on server capability

yarikoptic
and
claude
committed
4b81340
Translate per-file ``current`` from _multipart_upload to whole-zarr cumulative

yarikoptic
and
claude
committed
39cc742
Skip zarr multipart-upload tests when server lacks the endpoint

yarikoptic
and
claude
committed
684da5c
Merge pull request #1846 from dandi/zarr-multipart-upload-enhs
jjnesbitt
authored
56126dd
Merge branch 'master' into zarr-multipart-upload
jjnesbitt
authored
fc6b36e
Fix test_upload_zarr_large_chunks
jjnesbitt
committed
db6bcf5
Merge branch 'master' into zarr-multipart-upload
jjnesbitt
authored
f1f48da