Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

brain example? #1

Open
ntustison opened this issue Apr 29, 2020 · 7 comments
Open

brain example? #1

ntustison opened this issue Apr 29, 2020 · 7 comments

Comments

@ntustison
Copy link

Hey, this is great. Thanks for making it available.

Can you provide an actual brain image example in addition to the random noise example?

@ha-ha-ha-han
Copy link
Owner

Hey, this is great. Thanks for making it available.

Can you provide an actual brain image example in addition to the random noise example?

Unfortunately, people can't put UK Biobank raw data on the web. Any suggestion for an openly available dataset without the need for additional preprocessing?

@ntustison
Copy link
Author

Thanks. Much appreciated and I certainly understand not sharing UK Biobank raw data.

I actually forked your repository and added a human example python notebook which demonstrates the difficulties I'm having with your model/weights on actual human data. Here's the forked repository and this is the subdirectory where I put two preprocessed human brain images. They were skull stripped, bias corrected, and affinely warped to MNI152 as specified in your paper. This is the modified python notebook which uses those two human brain images for prediction but, as you can see, I'm not getting the expected accuracy. My guess is that I might not be standardizing the intensities after loading, specifically this line here:

data = data/data.mean()

but I can't find those details in your paper. Any help would be much appreciated. Thanks.

@ha-ha-ha-han
Copy link
Owner

ha-ha-ha-han commented May 19, 2020

Thanks. Much appreciated and I certainly understand not sharing UK Biobank raw data.

I actually forked your repository and added a human example python notebook which demonstrates the difficulties I'm having with your model/weights on actual human data. Here's the forked repository and this is the subdirectory where I put two preprocessed human brain images. They were skull stripped, bias corrected, and affinely warped to MNI152 as specified in your paper.

Thanks a lot for adding human samples!
Yes, this looks all good.

This is the modified python notebook which uses those two human brain images for prediction but, as you can see, I'm not getting the expected accuracy. My guess is that I might not be standardizing the intensities after loading, specifically this line here:

data = data/data.mean()

but I can't find those details in your paper. Any help would be much appreciated. Thanks.

Looks like the code is working.

# Preprocessing
data = data/data.mean()
data = dpu.crop_center(data, (160, 192, 160))

This is correct and is what we used.

May I ask what is the data source? Since the model is trained only with UK Biobank data, so that it may need transfer-learning for your protocol/scanner.

@ntustison
Copy link
Author

Thanks Han. I appreciate the feedback. These two images were from my institution (University of Virginia). I don't know what the parameters were but I can look.

I actually have several publicly available data from different sites. I'm going to run them through this pipeline and see if I can get better numbers. I might need to come back and ask for your thoughts on the results but thanks for your help so far.

@ha-ha-ha-han
Copy link
Owner

No problem. We transferred the model to the PAC2019 challenge data (multisite, different age range than UKBiobank, 16-90yrs) and it saved some training time if you use UK Biobank-pretrained weights as an initialization. Maybe this can be helpful

@ballarinit
Copy link

Hi, thank you for the impressive work! I am currently testing the model on different data and the code is working well.
Any chance you could share more details about the MRI preprocessing or the code used for it? It would be great to have exactly the same steps here.

@ha-ha-ha-han
Copy link
Owner

ha-ha-ha-han commented Jul 11, 2020

Hi, thank you for the impressive work! I am currently testing the model on different data and the code is working well.
Any chance you could share more details about the MRI preprocessing or the code used for it? It would be great to have exactly the same steps here.

Hi, I have just updated the readme page. Check it out :)
Btw, if you fine-tune the model in your own data, then it is not necessary that the preprocessing to be exactly the same.

PS: pls consider star and/or watch this repository if you find it helpful, as we will keep updating this repository for pretrained models and weights

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants