LinearWarmupThreeStepsAnnealing

LinearWarmupThreeStepsAnnealing#

stable_ssl.schedulers.LinearWarmupThreeStepsAnnealing(optimizer, total_steps, start_factor=0.001, gamma=0.3, peak_step=0.05)[source]#

Combine linear warmup with a three-step learning rate annealing.