Lecture 9: Principal Component Analysis in Finance

Quick Overview

Principal Component Analysis (PCA) is a core, efficient, and fast unsupervised learning tool in finance, primarily used for dimensionality reduction and understanding correlation structures in high-dimensional, highly correlated data like US Treasury yields, where it decomposes yield changes into persistent, interpretable factors like level, slope, and curvature.

Key Points: PCA is an absolutely core data science tool in finance, essential for learning by doing through projects, and helpful for job interviews. PCA functions as an unsupervised learning method for clustering and dimensionality reduction, unlike regression, it implies no causality, treating all dimensions equally. In the US bond market example, PCA decomposed highly correlated yield changes into three persistent factors: PC1 (Level, explaining 85-90% of variance), PC2 (Slope, 5-10% of variance), and PC3 (Curvature). A critical step in PCA application is ensuring the data is mean-centered (demeaned) because PCA rotates around the origin (0,0), which is often overlooked when applying it to positive data like stock prices. When using PCA, analyzing eigenvalues (variance explained) is crucial; one seeks eigenvalues that are distinct, ideally separated by an order of magnitude, indicating robust factors. A key use case in finance is constructing uncorrelated portfolios (e.g., PC2 and PC3 portfolios) based on factor loadings to isolate specific dynamics (like slope or curvature) that can then be traded, often requiring leverage due to low individual factor variance. The decision to normalize variance is context-dependent: normalize when units are arbitrary (like temperature vs. pressure) but avoid normalization when units are inherently comparable and meaningful (like quiz grades or comparable yield changes).

Context: The lecture features Stefan Andreev, a PhD in Chemical Physics from Harvard who has worked at Morgan Stanley and Citadel, discussing Principal Component Analysis (PCA) as a guest speaker. The context centers on applying PCA within quantitative finance, emphasizing its utility for understanding complex, high-dimensional datasets, particularly time series data common in financial markets like the US bond market.