Skip to content

transformers 5 removed warmup_ratio

TrainingArguments keeps only warmup_steps. The declared budget keeps the ratio, because it is scale-invariant and pinning steps would mean a change in corpus size silently changed the warmup fraction on a pre-registered parameter. training.warmup_steps derives the step count at construction.