Gradient & Contour Plots

Gradient and Contour Plots

Mathematical Definition

For a scalar function of two variables, f(x, y), a level curve (or contour line) is the set of all points (x, y) such that f(x, y) = c, where c is a constant.

The gradient of f, denoted by ∇f or grad f, is a vector composed of the partial derivatives of the function with respect to each variable:

The directional derivative of f in the direction of a unit vector u is given by the dot product of the gradient and u:

This value is maximized when cos(θ) = 1, which occurs when u points in the exact same direction as the gradient ∇f.

Key Concepts

• Orthogonality: The gradient vector ∇f is always orthogonal (perpendicular) to the contour lines of f. If you walk along a contour line, your elevation doesn't change (directional derivative is zero), meaning the dot product of the gradient and the tangent vector of the contour must be zero.
• Steepest Ascent/Descent: The gradient vector points in the direction of maximum rate of increase of the function. Conversely, −∇f points in the direction of steepest descent.
• Magnitude: The length of the gradient vector, |∇f|, represents the maximum rate of change at that point. On a contour map, regions where contour lines are close together (steep terrain) will have longer gradient vectors than regions where contours are far apart (flat terrain).
• Critical Points: Points where ∇f(x, y) = [0, 0] are known as critical points. These can be local maxima (peaks), local minima (pits), or saddle points.

Historical Context

The concepts of partial derivatives and gradients emerged from the development of multivariable calculus in the late 17th and 18th centuries by mathematicians such as Isaac Newton, Gottfried Wilhelm Leibniz, and Leonhard Euler.

The use of contour lines (isarithms) for mapping dates back to 1584, when Dutchman Pieter Bruinsz used them to chart the depth of the river Spaarne. In 1701, Edmond Halley used them to map magnetic variation. The formal mathematical connection between level sets and vector calculus was solidified in the 19th century by figures like George Green and Carl Friedrich Gauss, forming the basis for modern vector analysis and physics.

Real-world Applications

• Meteorology: Isobars on weather maps are contour lines of atmospheric pressure. The wind direction (gradient) flows perpendicularly to these lines (though affected by the Coriolis force).
• Geography and Topography: Topographic maps use contour lines to represent elevation. The gradient determines the steepness of a slope and the path water will take flowing downhill.
• Machine Learning: Gradient descent is a fundamental optimization algorithm. It iteratively moves in the direction of the negative gradient of a loss function to find a local minimum (the optimal parameters for a model).
• Physics (Electromagnetism): The electric field is the negative gradient of the electric potential scalar field (E = −∇V). Equipotential surfaces correspond to the contour lines.
• Thermodynamics: Heat flows in the direction of the negative gradient of the temperature field (from hot to cold), perpendicular to isotherms (lines of constant temperature).

Related Concepts

• Implicit Differentiation — finding derivatives of functions defined by equations rather than explicit formulas
• Taylor Series — multi-variable Taylor series rely on gradients (Jacobian) and Hessians
• Vector Fields — assigning a vector to every point in a space, often derived as the gradient of a potential function