Ablation Result - Table 4 #5
Description
Hi Inhwan,
I tried to reproduce the ablation study result in your table 4, especially for the intra-only (variant 1) and inter-only (variant 2) experiments. It seems that my reproduced intra-only result (avg-0.25/0.45) is better than my reproduced inter-only result (avg-0.31/0.53), which violates your result in table 4. The values are close to what you reported in the table but they do not correspond to the correct settings. It seems that the intra-group interactions has a stronger influence on the final prediction result.
I am not sure whether it is my fault or you made the mistake in the table. In your code, the inter-group flag is before intra-group flag, but in your ablation table intra-group column is before the inter-group column. Please let me know if I missed something or some possible mistakes I've made in reproducing table 4 results. If anyone have reproduced the results in table 4, please share your results.