How to add the scheduler to the Model CLIP?

[APiaoG]

I tried to add a scheduler to the model CLIP, but the learning rate didn't update. I'm sure I add the WarmupCosineSchedule and scheduler.step(). so what is the problem of it?

[MadcowD]

Have you tried using the StepLR scheduler instead of the WarmupCosineSchedule? It may work better for your needs.

…

On Thu, Mar 2, 2023 at 6:26 PM APiaoG ***@***.***> wrote: I tried to add a scheduler to the model CLIP, but the learning rate didn't update. I'm sure I add the WarmupCosineSchedule and scheduler.step(). so what is the problem of it? — Reply to this email directly, view it on GitHub <#332>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFPVLZ46RKKMUMLSJ6KW4TW2FJFBANCNFSM6AAAAAAVOB2OTQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[APiaoG]

Thank you and I have solved this problem!

[MuhiimAli]

How did you solve the problem? I am running into the same issue now