Skip to content

More on projects and meetings#75

Merged
yarikoptic merged 5 commits intomasterfrom
enh-projects
Apr 22, 2025
Merged

More on projects and meetings#75
yarikoptic merged 5 commits intomasterfrom
enh-projects

Conversation

@yarikoptic
Copy link
Member

need likely to add more

@candleindark
Copy link
Collaborator

@yarikoptic Is it possible that some media files are not pushed to the remote for storing annex objects?

(centerforopenneuroscience.org) ➜  centerforopenneuroscience.org git:(enh-projects) datalad get -r .
[INFO   ] Ensuring presence of Dataset(/Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org) to get /Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org
get(error): theme/static/img/3rd/distribits_logo.webp (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
get(error): theme/static/img/3rd/ember_logo.png (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
get(error): theme/static/img/3rd/openneuro_logo.png (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
get(error): theme/static/img/logos/logo_blue_big_tight.pdf (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
get(error): theme/static/img/team/jb.png (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
get(error): theme/static/img/team/kennedy.jpg (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
get(error): theme/static/img/team/yarik.jpg (file) [not available; (Note that these git remotes have annex-ignore set: origin upstream)]
action summary:
  get (error: 7)
(centerforopenneuroscience.org) ➜  centerforopenneuroscience.org git:(enh-projects) datalad siblings -d .
.: here(+) [git]
.: upstream(-) [https://github.com/con/centerforopenneuroscience.org.git (git)]
.: origin(-) [https://github.com/candleindark/centerforopenneuroscience.org.git (git)]
.: datasets.datalad.org(+) [http://datasets.datalad.org/centerforopenneuroscience/con.org/.git/ (git)]
(centerforopenneuroscience.org) ➜  centerforopenneuroscience.org git:(enh-projects) git annex whereis theme/static/img/3rd/distribits_logo.webp
whereis theme/static/img/3rd/distribits_logo.webp (0 copies) failed
whereis: 1 failed

@yarikoptic
Copy link
Member Author

ha -- I didn't realize that they were added into annex in unlocked form (so no symlinks). thanks @candleindark for having a look! I pushed those files and updated/merged git-annex branch to smaug now (smaug.datalad.org:/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org). So if you git fetch from that remote, git-annex should be able to fetch them. It should have everything (git annex find --not --in smaug is empty)

For links I filed a separate PR

@asmacdo
Copy link
Member

asmacdo commented Apr 22, 2025

I did git annex get . --from smaug

but the ember logo isnt showing up
Screenshot from 2025-04-22 09-09-45

I took a look, maybe its not a valid png?

Screenshot from 2025-04-22 09-09-35

Co-authored-by: Austin Macdonald <austin@dartmouth.edu>
@yarikoptic
Copy link
Member Author

re above problem @asmacdo experienced and feedback from @candleindark on matrix -- I fixed permissions, and it was needed to run git config --global --add safe.directory /mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git precisely with the trailing /.git as git said to get it fetch from smaug. Should be all good now

* origin/master:
  Add to ignore redirect warnings and move ignored regexes into config
  More fixes and ignores
  A few more random urls to fixup and use https
  Some urls to ignore for linkchecker
  Fix link for Tor CV
  fix url for nipype
  [DATALAD RUNCMD] use new url for nih project reporter
  [DATALAD RUNCMD] use https for chimera
  Point to google scholar for Nick
  [DATALAD RUNCMD] use https for nipy.org
@asmacdo
Copy link
Member

asmacdo commented Apr 22, 2025

Looks good to me after fixing the BBQS link

@yarikoptic yarikoptic merged commit 2bd03dc into master Apr 22, 2025
1 check failed
@yarikoptic
Copy link
Member Author

pushed the merge/uploaded

@candleindark
Copy link
Collaborator

It still doesn't work for me.

(centerforopenneuroscience.org) ➜  centerforopenneuroscience.org git:(master) datalad siblings configure -d . -s smaug --url ito@smaug:/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git --fetch
[INFO   ] Fetching updates for Dataset(/Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org)
update(error): . (dataset) [Fetch failed: datalad.runner.exception.CommandError(CommandError: 'git -c diff.ignoreSubmodules=none -c core.quotepath=false fetch --verbose --progress --no-recurse-submodules --prune smaug' failed with exitcode 128 under /Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org [err: 'fatal: couldn't read ./packed-refs: Permission denied
CommandError: 'ssh -o ControlPath=/Users/isaac/Library/Caches/datalad/sockets/21bfa4b1 -o SendEnv=GIT_PROTOCOL ito@smaug 'git-upload-pack '"'"'/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git'"'"''' failed with exitcode 128
fatal: the remote end hung up upon initial contact'])] [CommandError: 'git -c diff.ignoreSubmodules=none -c core.quotepath=false fetch --verbose --progress --no-recurse-submodules --prune smaug' failed with exitcode 128 under /Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org [err: 'fatal: couldn't read ./packed-refs: Permission denied
CommandError: 'ssh -o ControlPath=/Users/isaac/Library/Caches/datalad/sockets/21bfa4b1 -o SendEnv=GIT_PROTOCOL ito@smaug 'git-upload-pack '"'"'/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git'"'"''' failed with exitcode 128
fatal: the remote end hung up upon initial contact']]
update(error): . (dataset) [Fetch failed: datalad.runner.exception.CommandError(CommandError: 'git -c diff.ignoreSubmodules=none -c core.quotepath=false fetch --verbose --progress --no-recurse-submodules --prune smaug' failed with exitcode 128 under /Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org [err: 'fatal: couldn't read ./packed-refs: Permission denied
CommandError: 'ssh -o ControlPath=/Users/isaac/Library/Caches/datalad/sockets/21bfa4b1 -o SendEnv=GIT_PROTOCOL ito@smaug 'git-upload-pack '"'"'/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git'"'"''' failed with exitcode 128
fatal: the remote end hung up upon initial contact'])] [CommandError: 'git -c diff.ignoreSubmodules=none -c core.quotepath=false fetch --verbose --progress --no-recurse-submodules --prune smaug' failed with exitcode 128 under /Users/isaac/Developer/Dartmouth/centerforopenneuroscience.org [err: 'fatal: couldn't read ./packed-refs: Permission denied
CommandError: 'ssh -o ControlPath=/Users/isaac/Library/Caches/datalad/sockets/21bfa4b1 -o SendEnv=GIT_PROTOCOL ito@smaug 'git-upload-pack '"'"'/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git'"'"''' failed with exitcode 128
fatal: the remote end hung up upon initial contact']]
.: smaug(+) [ito@smaug:/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git (git)]

It seems that I need read permission for packed-refs in .git, and I don't have it.

ls as Smaug with my account is

ito@smaug:/mnt/btrfs/datasets/datalad/crawl/centerforopenneuroscience/con.org/.git$ ls -l
total 116
drwxr-sr-x 1 yoh datalad   338 Apr 22 09:19 annex
drwxr-sr-x 1 yoh datalad     0 Jun 17  2021 branches
-rw-r--r-- 1 yoh datalad   706 Jun 17  2021 config
-rw-r----- 1 yoh datalad     0 Jun 17  2021 config.dataladlock
-rw-r--r-- 1 yoh datalad    73 Jun 17  2021 description
-rw-r----- 1 yoh datalad   255 Jun 17  2021 FETCH_HEAD
-rw-r--r-- 1 yoh datalad    23 Jun 17  2021 HEAD
drwxr-sr-x 1 yoh datalad   550 Jun 17  2021 hooks
-rw-r--r-- 1 yoh datalad 91631 Apr 22 09:19 index
drwxr-sr-x 1 yoh datalad    34 Jun 17  2021 info
drwxr-sr-x 1 yoh datalad    16 Jun 17  2021 logs
drwxr-sr-x 1 yoh datalad   676 Apr 22 09:19 objects
-rw------- 1 yoh datalad    41 Sep 29  2022 ORIG_HEAD
-rw-r----- 1 yoh datalad    46 Jun 17  2021 packed-refs
drwxr-sr-x 1 yoh datalad    42 Sep 29  2022 refs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants