Lecture 23: Introduction to Machine Learning

Quick Overview

Machine learning, central to the Fourth Industrial Revolution, differs from traditional statistics by prioritizing data collection before hypothesis development, and it encompasses unsupervised learning for pattern detection, supervised learning for prediction using training/validation/test sets to avoid overfitting, and reinforcement learning for multi-stage decision-making, as demonstrated by John Hull's work applying neural networks to derivative pricing and reinforcement learning to hedging strategies.

Key Points: Machine learning marks the Fourth Industrial Revolution, contrasting with the Third Industrial Revolution (computers and digitization) by enabling systems to learn relationships from data rather than just automating known rules, such as determining loan approval rules instead of just automating existing ones. Machine learning fundamentally differs from traditional statistics because practitioners collect data first to find patterns or develop predictive tools, whereas statistics requires developing a hypothesis before collecting data. The three primary types of machine learning algorithms discussed are Unsupervised learning (looking for patterns/clusters), Supervised learning (predicting or classifying using training, validation, and test sets to manage overfitting), and Reinforcement learning (multi-stage decision making). Artificial Neural Networks (ANNs) predict output through multiple stages (hidden layers) using weighted combinations of previous layer values passed through activation functions (like sigmoid or identity), with the weights being the primary parameters determined through iterative gradient descent. In supervised learning, overfitting occurs when a complex model fits the training set too well but performs poorly on the validation set; the rule of thumb is to increase complexity until performance worsens on the validation set. John Hull demonstrated using an ANN trained on 10,000 Black-Scholes-Merton prices (with added noise) to replicate the model quickly, showing real-world application in valuing exotic derivatives faster than Monte Carlo simulation. Reinforcement learning, used for sequential decision-making, involves a trial-and-error process balancing exploration (random choice) and exploitation (choosing the best known action), successfully used to solve the game of Nim and applied to hedging derivatives to potentially save transaction costs.