Investigation of Micro vs. Macro (#1)

* add requirements.txt * commit first draft of macro investigation * add plotting script * fix error & change default plot * logging / plot optimization * configurable height * Commit outputs * Add tox info * Add collated macro data * Add AUCs * Update macro.py * Add diff plot * Add size * Update macro.py * Add saving results both ways Co-authored-by: Charles Tapley Hoyt <[email protected]>
pykeen · Mar 11, 2022 · f6e9bf5 · f6e9bf5
1 parent c4e48c6
commit f6e9bf5
Show file tree

Hide file tree

Showing 23 changed files with 392,058 additions and 4 deletions.
diff --git a/.gitignore b/.gitignore
@@ -129,3 +129,4 @@ dmypy.json
 .pyre/
 
 .DS_Store
+macro_cache/
diff --git a/README.md b/README.md
@@ -1,4 +1,12 @@
 # glb2022_metrics
+
 Results for the Ranking Metrics submission @ GLB 2022
 
 ![Results](results.png)
+
+## Build
+
+After installing `tox` with `pip install tox`, do the following:
+
+1. `tox -e collate` to build the combine results files
+2. `tox -e macro` to run the analysis for micro vs. macro evaluation
diff --git a/charts/macro_testing_auc_diff.pdf b/charts/macro_testing_auc_diff.pdf
diff --git a/charts/macro_testing_auc_diff.png b/charts/macro_testing_auc_diff.png
Original file line number	Diff line number	Diff line change
Expand Up		@@ -129,3 +129,4 @@ dmypy.json
		.pyre/

		.DS_Store
		macro_cache/