(1.1 hours to learn)


The gradient of a function gives the direction of maximum increase. Its entries are given by the partial derivatives of the function. It is widely used in optimization.


This concept has the prerequisites:

Core resources (read/watch one of the following)


MIT Open Courseware: Multivariable Caclulus (2010)


Supplemental resources (the following are optional, but you may find them useful)


Khan Academy: Calculus

See also

  • Gradient ascent , or 'hill climbing', is a simple and widely used optimization algorithm.