Fix #3185: Support convert_to_numpy for output_value="token_embeddings"

[bhavnicksm]

Hey UKPLab and ST Team! 👋

Just added a fix for #3185

Let me know if it looks good or any changes I need to make to the PR!

Thanks 😊

cc: @tomaarsen

[tomaarsen]

Hello!

I added some tests so that the current behaviour is pretty much what is expected. Sadly, there's an issue with the expected output if the output_value is None currently.
I'm rather unhappy with the 2 convert_to_... arguments, I would have preferred just 1 parameter for that. I also don't like all the if-else's at the end of the method :/

But for now, perhaps we can re-add the removed code, but with if output_value is None to resolve the test failures?

• Tom Aarsen