Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validating Core contributor network analysis results #200

Open
oindrillac opened this issue Apr 5, 2023 · 0 comments
Open

Validating Core contributor network analysis results #200

oindrillac opened this issue Apr 5, 2023 · 0 comments

Comments

@oindrillac
Copy link
Member

While it is relatively easier to verify the results of filtering out "top", "important", "emergent", "important" projects in a graph network by tribal knowledge, news, reports, affiliations etc it is harder to validate the results of core, active and peripheral contributors.

To validate the results of our bucketing of contributors by count based approaches here #188, we can definitely analyze the accuracy of our contributor grouping on a case by case basis, but one way to validate the results could be to

  • Try this on CNCF projects and check the overlap of the "core" category contributors displayed by our network analysis methods to the maintainers list https://github.com/cncf/foundation/blob/main/project-maintainers.csv. The intuition here is that there should be some degree of overlap between these and that would validate the results of our analysis.
  • Check whether the 2nd and 3rd degree contributors (Active/Peripheral etc) have some overlap with a project's contributors. (Note sure if Augur lets us fetch this list. And although this list technically ranks all of a projects contributors, it could be a good resource for a sanity check that most of the top contributors that we fetch for a project are in fact contributing to that project)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Backlog
Development

No branches or pull requests

1 participant