LinearWarmupCosineAnnealing

LinearWarmupCosineAnnealing#

stable_ssl.schedulers.LinearWarmupCosineAnnealing(optimizer, total_steps, start_factor=0.01, end_lr=0.0, peak_step=0.01)[source]#

Combine linear warmup with cosine annealing decay.