Change of Basis
Visualizing how vector coordinates transform between different coordinate systems.
Change of Basis
Concept Overview
In linear algebra, a basis is a set of linearly independent vectors that span a given vector space. Any vector in that space can be expressed as a unique linear combination of these basis vectors. The standard basis in ℝ2 consists of vectors (1, 0) and (0, 1). However, choosing a different basis is often useful for simplifying problems, such as diagonalizing matrices or viewing data from a different perspective. A "change of basis" refers to translating the coordinates of a vector from one basis to another.
Mathematical Definition
Let V be a vector space, and let B = {b1, b2, ..., bn} be a basis for V. Any vector v in V can be written as:
The scalars c1, c2, ..., cn are the coordinates of v relative to the basis B. If we have a "new" basis B' and an "old" basis (typically the standard basis), the change of coordinates matrix P (or transition matrix) from the new basis B' to the standard basis has the basis vectors of B' as its columns.
To find the coordinates of a standard vector v in the new basis B', we multiply v by the inverse of P:
Key Concepts
- Linear Independence: For a set of vectors to form a basis, no vector in the set can be written as a linear combination of the others. If they are dependent, their matrix determinant is 0, and its inverse does not exist.
- Spanning Set: A basis must be able to reach every point in the vector space using linear combinations.
- Transition Matrix (P): The matrix whose columns are the vectors of the new basis expressed in the old basis. It converts coordinates from the new basis to the old basis (v = P[v]B').
- Inverse Matrix (P-1): Used to convert standard coordinates into the new basis coordinates.
Historical Context
The concepts of bases and dimension emerged as linear algebra formalized in the 19th and early 20th centuries. Giuseppe Peano gave the first modern, axiomatic definition of a vector space in 1888. The idea of changing coordinate systems, however, dates back much further to analytical geometry developed by René Descartes and Pierre de Fermat in the 17th century, where translating and rotating axes were common techniques to simplify equations of conics.
Real-world Applications
- Computer Graphics: Changing basis is essential for 3D rendering to transform coordinates from the "world space" to the "camera space" or "screen space".
- Data Compression (PCA): Principal Component Analysis uses a change of basis to find the directions of maximum variance in high-dimensional data, allowing for dimensionality reduction.
- Quantum Mechanics: Physical states are represented as vectors in Hilbert spaces. Changing basis corresponds to changing the observable being measured (e.g., switching from position space to momentum space).
- Signal Processing: The Fourier transform is a change of basis from the time domain (standard basis impulses) to the frequency domain (basis of sine and cosine waves).
Related Concepts
- Eigenvalues & Eigenvectors — Often used to find a basis where a linear transformation is represented by a simple diagonal matrix.
- Linear Transformations — Matrices represent transformations relative to a chosen basis.
- Gram-Schmidt Process — A method for converting an arbitrary basis into an orthogonal or orthonormal basis.
- Vector Spaces — The abstract spaces spanned by basis sets.
Experience it interactively
Adjust parameters, observe in real time, and build deep intuition with Riano’s interactive Change of Basis module.
Try Change of Basis on Riano →