Skip to content

[WIP] neural biasing with early context injection and text perturbation - #1763

Open
huangruizhe wants to merge 1 commit into
k2-fsa:masterfrom
huangruizhe:neural_biasing_text_pb
Open

[WIP] neural biasing with early context injection and text perturbation#1763
huangruizhe wants to merge 1 commit into
k2-fsa:masterfrom
huangruizhe:neural_biasing_text_pb

Conversation

@huangruizhe

@huangruizhe huangruizhe commented Sep 30, 2024

Copy link
Copy Markdown
Contributor

This PR implements the paper: Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbation
. This also addresses issue #1709 .

This codes can replicate the paper, but it is still a WIP -- needing codes refactoring and cleaning up.

TODO:

  • Make soft links to the original standard ASR recipe -- avoid copying scripts
  • Expose neural biasing and so on as an external function call to contextualize the models
  • Simplify the scripts for loading contexts -- only need an example for librispeech
  • Get evaluation scripts for common/rare words as in the contextual librispeech setup

…rly context injection and text perturbation; the codes runs well on the grid; however, it needs pretty much cleaning up and refactoring before maki a reasonable PR
@teinhonglo

Copy link
Copy Markdown

Hi RuiZhe,

Thanks for sharing this implementation. I noticed that this PR is still open and has not been merged yet. May I ask whether there are any known issues or blockers with the current code?

I’m interested in trying it out to reproduce the paper, so I would really appreciate any guidance on whether the current version is usable.

Thanks!
Tien-Hong

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants