m-rewardbench leaderboard

[ehartford]

Is there a leaderboard?

like this one (https://huggingface.co/spaces/allenai/reward-bench) but for multilingual?

I would love to know how good are these reward models with multilingual.

I always worry about non-English data getting wrongly scored by the reward model.

[ShayekhBinIslam]

Hi @ehartford, thanks for your interest! Yes, we are working on it. Hopefully in 2 weeks!

[ehartford]

Nice I can't wait to check it out! Very curious

[ehartford]

hi!

[ShayekhBinIslam]

Hi @ehartford, thank you for your patience. We are hosting the leaderboard here: https://c4ai-community-m-rewardbench.hf.space/

Update:
https://coherelabscommunity-m-rewardbench.hf.space/