Skip to content

Rank submodule#21

Draft
CCampJr wants to merge 3 commits intousnistgov:0.4.Xfrom
CCampJr:rank_submodule
Draft

Rank submodule#21
CCampJr wants to merge 3 commits intousnistgov:0.4.Xfrom
CCampJr:rank_submodule

Conversation

@CCampJr
Copy link
Copy Markdown
Collaborator

@CCampJr CCampJr commented Apr 23, 2019

Submodule to estimate rank of the data.

Methods to incorporate (so far):

  • SVD/PCA + various metrics (I do a lot of these)
  • HySime
  • SIMPLISMA (@ClarkAH)
  • IND and RSD (@sshojiro )

Implementation considerations

  • Out-of-core analysis
  • Python vs Cython for some
  • ?

Note that rank approximation is not a trivial task. It's super-easy to get an estimate and seemingly easier to be incorrect. Kind of the reason I didn't incorporate this feature into the 0.3.0 release.

My plan is to create a super class RankEst that all subclasses will inherit. This class will likely incorporate some metrics to describe confidence or error -- not sure.

Questions and comment welcome!

CCampJr and others added 3 commits April 22, 2019 13:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant