Gaussian processes

(1.1 hours to learn)

Summary

Gaussian processes are distributions over functions such that the joint distribution at any finte set of points is a multivariate Gaussian. They are commonly used in probabilistic modeling when we want to put a prior over functions without reference to an underlying parametric representation. Usually they express fairly weak beliefs about the function, such as smoothness, but more structured versions are also possible. The most common use case is nonparametric regression and classification.

Context

This concept has the prerequisites:

Core resources (read/watch one of the following)

-Free-

Gaussian Processes for Machine Learning
A graduate-level machine learning textbook focusing on Gaussian processes.
Authors: Carl E. Rasmussen,Christopher K. I. Williams

-Paid-

Supplemental resources (the following are optional, but you may find them useful)

-Free-

Bayesian Reasoning and Machine Learning
A textbook for a graudate machine learning course.
Author: David Barber

-Paid-

See also