LinearWarmupCyclicAnnealing

LinearWarmupCyclicAnnealing#

stable_ssl.schedulers.LinearWarmupCyclicAnnealing(optimizer, total_steps, start_factor=0.01, peak_step=0.1)[source]#

Combine linear warmup with cyclic cosine annealing.