Is PyTorch's Nesterov Momentum Implementation Wrong? | Towards Data Science

We examine and explain the differences between the original formulation of Nesterov momentum and PyTorch’s implementation.

By · · 1 min read
Is PyTorch's Nesterov Momentum Implementation Wrong? | Towards Data Science

Source: Towards Data Science

We examine and explain the differences between the original formulation of Nesterov momentum and PyTorch’s implementation.