Any plan to support SSL training with zipformer encoder ?

[kobenaxie]

like wav2vec2 Hubert w2vbert ...

[marcoyang1998]

I believe @yfyeung has tried Zipformer with HuBERT pre-training. Would you mind sharing some progress @yfyeung ?

[yfyeung]

I believe @yfyeung has tried Zipformer with HuBERT pre-training. Would you mind sharing some progress @yfyeung ?

Yeah. I am doing something like:

• Support transformer-based SSL in icefall.
• Support zipformer-based SSL in icefall.
• Release multilingual zipformer-based SSL in icefall.

Training HuBERT Large on LibriLight 60000h takes lots of time. It still takes some time.

[zw76859420]

I believe @yfyeung has tried Zipformer with HuBERT pre-training. Would you mind sharing some progress @yfyeung ?

Yeah. I am doing something like:

• Support transformer-based SSL in icefall.
• Support zipformer-based SSL in icefall.
• Release multilingual zipformer-based SSL in icefall.

Training HuBERT Large on LibriLight 60000h takes lots of time. It still takes some time.

Do you have some results to share?

[yfyeung]

I believe @yfyeung has tried Zipformer with HuBERT pre-training. Would you mind sharing some progress @yfyeung ?

Yeah. I am doing something like:

• Support transformer-based SSL in icefall.
• Support zipformer-based SSL in icefall.
• Release multilingual zipformer-based SSL in icefall.

Training HuBERT Large on LibriLight 60000h takes lots of time. It still takes some time.

Do you have some results to share?

Coming soon with the paper.

[sangeet2020]

Hi @yfyeung ,
Wanted to know if the paper is out and you could share the link and the code?

[JinZr]

Hi, Thank you for your interest, the PR has been merged and you can find the code under egs/librilight/SSL or egs/librispeech/SSL. best jin

…

On Apr 11, 2024, at 15:55, Sangeet Sagar ***@***.***> wrote: Hi @yfyeung <https://github.com/yfyeung> , Wanted to know if the paper is out and you could share the link and the code? — Reply to this email directly, view it on GitHub <#1397 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AOON42DBPICNLCCXZ3DB56TY4Y6YVAVCNFSM6AAAAABAFKSOIKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBZGEZTMNRUGM>. You are receiving this because you modified the open/close state.

[JinZr]

You can find the PR here: #1500 k2SSL: a Faster and Better Framework for Self-Supervised Speech Representation Learning by yfyeung · Pull Request #1500 · k2-fsa/icefall github.com for more details. best jin

…

On Apr 11, 2024, at 15:55, Sangeet Sagar ***@***.***> wrote: Hi @yfyeung <https://github.com/yfyeung> , Wanted to know if the paper is out and you could share the link and the code? — Reply to this email directly, view it on GitHub <#1397 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AOON42DBPICNLCCXZ3DB56TY4Y6YVAVCNFSM6AAAAABAFKSOIKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBZGEZTMNRUGM>. You are receiving this because you modified the open/close state.

[sangeet2020]

thank you :)