Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validation of ds005256 never completes #3306

Open
yarikoptic opened this issue Jan 28, 2025 · 4 comments
Open

Validation of ds005256 never completes #3306

yarikoptic opened this issue Jan 28, 2025 · 4 comments

Comments

@yarikoptic
Copy link
Contributor

https://openneuro.org/datasets/ds005256

I git pushed yesterday, but it is still

Image

as of today.

@effigies
Copy link
Contributor

How long does the validator take to run locally?

@effigies
Copy link
Contributor

We've clocked it, and it takes 15 minutes on our end. My best guess is that the HED tags are causing a slowdown.

@yarikoptic
Copy link
Contributor Author

details -- about 5 minutes
(deno) yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ duct deno run --allow-read --allow-env --reload -A https://github.com/bids-standard/bids-validator/raw/deno-build/bids-validator.js --outfile logs/deno-bids-validator.log $PWD
2025-01-28T16:41:25-0500 [INFO    ] con-duct: duct is executing 'deno run --allow-read --allow-env --reload -A https://github.com/bids-standard/bids-validator/raw/deno-build/bids-validator.js --outfile logs/deno-bids-validator.log /mnt/DATA/data/yoh/1076_spacetop'...
2025-01-28T16:41:25-0500 [INFO    ] con-duct: Log files will be written to .duct/logs/2025.01.28T16.41.25-3688580_
Download https://github.com/bids-standard/bids-validator/raw/deno-build/bids-validator.js
Download https://raw.githubusercontent.com/bids-standard/bids-validator/deno-build/bids-validator.js
2025-01-28T16:46:17-0500 [INFO    ] con-duct: Summary:
Exit Code: 1
Command: deno run --allow-read --allow-env --reload -A https://github.com/bids-standard/bids-validator/raw/deno-build/bids-validator.js --outfile logs/deno-bids-validator.log /mnt/DATA/data/yoh/1076_spacetop
Log files location: .duct/logs/2025.01.28T16.41.25-3688580_
Wall Clock Time: 291.983 sec
Memory Peak Usage (RSS): 505.5 MB
Memory Average Usage (RSS): 438.6 MB
Virtual Memory Peak Usage (VSZ): 21.1 GB
Virtual Memory Average Usage (VSZ): 21.0 GB
Memory Peak Percentage: 0.0%
Memory Average Percentage: 0.0%
CPU Peak Usage: 164.0%
Average CPU Usage: 160.09090909090904%

(deno) yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ grep ERROR logs/deno-bids-validator.log
        [ERROR] PARTICIPANT_ID_MISMATCH Participant labels found in this dataset did not match the values in participant_id column
        [ERROR] HED_ERROR The validation on this HED string returned an error.
                /task-social_events.json - ERROR: [TAG_EXTENSION_INVALID] "Categorical-value" appears as "Property/Data-property/Data-value/Categorical-value" and cannot be used as an extension. Indices ([object Object], ). (For more information on this HED error, see https://hed-specification.readthedocs.io/en/latest/Appendix_B.html#tag-extension-invalid.)
                /task-social_events.json - ERROR: [TAG_EXTENSION_INVALID] "Categorical-value" appears as "Property/Data-property/Data-value/Categorical-value" and cannot be used as an extension. Indices ([object Object], ). (For more information on this HED error, see https://hed-specification.readthedocs.io/en/latest/Appendix_B.html#tag-extension-invalid.)
        Please visit https://neurostars.org/search?q=HED_ERROR for existing conversations about this issue.
        [ERROR] HED_INTERNAL_ERROR An internal error occurred during HED validation.
                GENERIC_ERROR
                /sub-0001/ses-02/func/sub-0001_ses-02_task-faces_acq-mb8_run-01_events.tsv - ERROR: [GENERIC_ERROR] Internal error - message: "Attempting to access the onset of a TSV row without one.". (For more information on this HED error, see https://hed-specification.readthedocs.io/en/latest/Appendix_B.html#generic-error.)
                /sub-0001/ses-02/func/sub-0001_ses-02_task-faces_acq-mb8_run-02_events.tsv - ERROR: [GENERIC_ERROR] Internal error - message: "Attempting to access the onset of a TSV row without one.". (For more information on this HED error, see https://hed-specification.readthedocs.io/en/latest/Appendix_B.html#generic-error.)
        Please visit https://neurostars.org/search?q=HED_INTERNAL_ERROR for existing conversations about this issue.
        [ERROR] STIMULUS_FILE_MISSING A stimulus file was declared but not found in the dataset.
(deno) yoh@typhon:/mnt/DATA/data/yoh/1076_spacetop$ tail logs/deno-bids-validator.log

          Summary:                           Available Tasks:        Available Modalities:
          26373 Files, 2.23 TB               alignvideo              MRI                  
          118 - Subjects 4 - Sessions        faces                                        
                                             fractional                                   
                                             narratives                                   
                                             shortvideo                                   
                                             social                                       

        If you have any questions, please post on https://neurostars.org/tags/bids.

so took about 5 minutes... initial run which failed to save log due to missing lead dir took the same-ish.

@yarikoptic
Copy link
Contributor Author

so is the problem that job times out and never reported completed?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants