Feature Request: support streaming mode with return_generation_logits #314
Description
Hi,
Is there a reason why streaming mode does not work with return_generation_logits?
I want to get the next output_token with its probabilities.
Tony
{{ message }}