Closed as not planned
Description
Hello
I wonder if we can somehow extract the predictor network from a pre-trained RNNT-based ASR model and then do SSL training by just using the text, and then plug it back into the ASR for fine-tuning, or just do the inference.
Please let me know if anyone has tried this out.
Thank you
Raj Gohil