Neural Network Design
Hagan, M. T., Demuth, H. B., Beale, M. H., & De Jesús, O. (2014). Neural network design (2nd ed.). Martin Hagan.
These chapters build core vocabulary on generalization and dynamic learning. The readings introduce estimating generalization error, early stopping, regularization, Bayesian regularization, and the connection between early stopping and regularization, as well as layered digital dynamic networks, BPTT versus RTRL, and stability notes. They support MLO 1 to MLO 4 and prepare you for the Module 3 quiz and assignment.
Chapter 13 – Generalization: estimating generalization error, early stopping, regularization, Bayesian regularization, and the early stopping to regularization connection.
Chapter 14 – Dynamic Networks: layered digital dynamic networks, principles of dynamic learning, BPTT versus RTRL, and stability notes.