include "size" information for files/directories

[yarikoptic]

With my datalad hat on, I find it very useful to know how many data files I do serve from http://datasets.datalad.org for any sub-directory/dataset -- thePROVIDED/TOTAL indicator in Size column. It would be nice if I could see in GIN/gogs also similar information -- currently I have no clue about total size of the dataset or for which subdirectories I did upload data (and for which forgot), see e.g. https://web.gin.g-node.org/yarikoptic/ds000001 and try to answer above question ;-)

[cgars]

I totally see the point, however (and "aus der Hüfte geschossen" as we say in German), calculating those sizes for all folders all the time could be a pretty costly endeavor. Among other things, it potentially includes a lot of (currently) brute force file discoveries - as we cant rely on the annex "links" directly in many cases.

How about having a route for this, which can, in turn, be used to ask for a size from the UI on demand?

[yarikoptic]

you need to calculate them only ones, and depending on implementation could make it really smart so you could account only for differences from the previous push. in our case with http://datasets.datalad.org/ we do not even do "smart", just whenever a dataset update pushed, post-update hook processes the tree and updates metadata for the dataset/directories/etc, so we could show how much of data files/total we serve.

[achilleas-k]

GOGS API reports size of repositories using git count-objects -v. This covers the git data only (including history). Git annex reports the size of the working directory data (so latest versions only) in git annex info. We could report both of these separately and as a total on the repo landing page. The former is what you get after the initial git clone, the latter is what gets downloaded if you do a git annex get . on the root of the repo.

[yarikoptic]

sounds great! I do something similarish on http://datasets.datalad.org/ where I report available-on-server-size/total-size (in the current tree). So if I do not host (some) annexed files - there would be two numbers.