Gradient descent algorithms take the loss function and use partial derivatives to determine what each variable (weights and biases) in the network contributed to the loss value.

Wolfram|Alpha: The makers of Mathematica (a very powerful mathematical software package, popular amongst applied mathematicians and engineers) bring us a "google-like" mathematical search engine. In ...