Can you share the MR results?

[kalyo-zjl]

Hi, can you share the MR results during training.
I found that if without teacher-net (moving average weights), the result will vary a lot between epochs, also getting worse compared with teacher-net (which may be a conflict with your findings). Even with teacher-net, the training is also not stable enough.

[WangWenhao0716]

@kalyo-zjl I have finished a paper to address the unstable problem and hope it will work: https://arxiv.org/abs/2002.09053