tensorstore #1174

brokkoli71 · 2024-08-25T17:50:32Z

Description:

Use tensorstore for zarr arrays
Reduces the number of IO ops when opening a dataset
based on changes from Tensorstore #1026

Todos:

Updated Changelog
Added / Updated Tests

usage

…bs into tensorstore3

Co-authored-by: Mark Bader <[email protected]>

.github/workflows/ci.yml

…bs into tensorstore3

normanrz · 2024-12-13T16:01:27Z

I already merged in #1229 here.

markbader

Looks great, let's get it merged 🚀

brokkoli71 added 9 commits August 25, 2024 19:46

migrate changes from branch tensorstore2

47b29ec

correct decorator @lru_cache

66413e3

usage

correct parameter of TensorStoreArray::read

2e60e60

debug TensorStoreArray::open

d3bf9bd

update poetry.lock

0dce780

format, pytest argument -s and skip failing test

b98e76a

install docker-compose in nightly.yml

cad8e32

fix import for python<3.11

837fbbc

format

aa2ca5c

normanrz added this to the 2.x milestone Oct 9, 2024

normanrz added 2 commits December 4, 2024 17:04

merge

58cc4b0

refreshed snapshots

5841c62

normanrz mentioned this pull request Dec 5, 2024

Tensorstore #1026

Closed

4 tasks

normanrz added 17 commits December 5, 2024 14:57

progress

6054179

re-add displayname

bd59ed6

progress

e26cde5

wip

b8dda66

merge

d2a13d8

progress

26587f3

progress

d12122b

progress

e4c743c

progress

215558d

newer wk

b15ce3e

try ubicloud

f769c52

http_proxy for tensorstore

a7b9ba5

refresh snapshots

57b1920

Merge remote-tracking branch 'origin/tensorstore3' into tensorstore3

154f012

refresh snapshots

a627d13

rm ZarritaArray and ZarrArray + changelog

f8cdea6

Merge branch 'tensorstore3' of github.com:scalableminds/webknossos-li…

5c71e4a

…bs into tensorstore3

Apply suggestions from code review

a5c847c

Co-authored-by: Mark Bader <[email protected]>

normanrz reviewed Dec 11, 2024

View reviewed changes

.github/workflows/ci.yml Outdated Show resolved Hide resolved

normanrz and others added 13 commits December 11, 2024 13:13

revert test_from_images

059b8d6

Merge branch 'tensorstore3' of github.com:scalableminds/webknossos-li…

4782362

…bs into tensorstore3

Remove test_examples.py

324cd37

Fix typing issue.

c3c395b

wip: pr feedback

ffbb487

types and fixes

fbaa215

merge

98119cb

rm zarrita in test_layer

3ee172b

update cassettes

1fdda1e

merge with #1229

acee240

format

a718043

update cassettes

ae412c4

typing_extensions

3b232a8

normanrz requested a review from markbader December 13, 2024 16:16

normanrz added 7 commits December 13, 2024 16:36

fix test_dataset_download_upload_remote.py::test_remote_dataset

9fbb36b

fix docs/uv.lock

636f794

format

9b78eb1

use current wk version in nightly

166e378

LazyPath

ec9157f

fix test_annotation

a2d0772

Update .github/workflows/ci.yml

3995d03

markbader approved these changes Dec 17, 2024

View reviewed changes

normanrz merged commit bbcf756 into master Dec 17, 2024
19 checks passed

normanrz deleted the tensorstore3 branch December 17, 2024 14:02

normanrz mentioned this pull request Dec 17, 2024

Remove examples from tests #1229

Closed

4 tasks

This was referenced Jan 5, 2025

Save performance by opening zarr array lazily in open_remote? #1127

Closed

Major version #1200

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

tensorstore #1174

tensorstore #1174

brokkoli71 commented Aug 25, 2024 •

edited by normanrz

Loading

normanrz commented Dec 13, 2024

markbader left a comment

tensorstore #1174

tensorstore #1174

Conversation

brokkoli71 commented Aug 25, 2024 • edited by normanrz Loading

Description:

Todos:

normanrz commented Dec 13, 2024

markbader left a comment

Choose a reason for hiding this comment

brokkoli71 commented Aug 25, 2024 •

edited by normanrz

Loading