Neural Network Design
Hagan, M. T., Demuth, H. B., Beale, M. H., & De Jesús, O. (2014). Neural network design (2nd ed.). Martin Hagan.
These chapters introduce advanced optimization algorithms and cover foundational linear algebra necessary for understanding optimization surfaces and feature pipelines. The materials also provide initial context for feature extraction (CNN blocks) and lightweight deployment patterns, directly supporting all Module 4 MLOs and preparing you for the final assignments and exam.
Chapter 5 – Signal & Weight Vector Spaces (Inner Product, Norm, Orthogonality, Gram–Schmidt)
Chapter 6 – Linear Transformations (Change of Basis, Eigenvalues/Eigenvectors, Diagonalization)
Chapter 9 – Performance Optimization (Steepest Descent, Stable Learning Rates, Line Search, Newton, Conjugate Gradient)