Deep learning : foundations and concepts / Christopher M. Bishop, Hugh Bishop.

Includes bibliographic references (pages 625-640) and index.

The deep learning revolution — Probabilities — Standard distributions — Single-layer networks: Regression — Single-layer networks : Classification — Deep neural networks — Gradient descent — Backpropagation — Regularization — Convolutional networks — Structured distributions — Transformers — Graph neural networks — Sampling — Discrete latent variables — Continuous latent variables — Generative adversarial networks — Normalizing flows.

This book offers a comprehensive introduction to the central ideas that underpin deep learning. It is intended both for newcomers to machine learning and for those already experienced in the field. Covering key concepts relating to contemporary architectures and techniques, this essential book equips readers with a robust foundation for potential future specialization. The field of deep learning is undergoing rapid evolution, and therefore this book focusses on ideas that are likely to endure the test of time.

The book is organized into numerous bite-sized chapters, each exploring a distinct topic, and the narrative follows a linear progression, with each chapter building upon content from its predecessors. This structure is well-suited to teaching a two-semester undergraduate or postgraduate machine learning course, while remaining equally relevant to those engaged in active research or in self-study.

A full understanding of machine learning requires some mathematical background and so the book includes a self-contained introduction to probability theory. However, the focus of the book is on conveying a clear understanding of ideas, with emphasis on the real-world practical value of techniques rather than on abstract theory. Complex concepts are therefore presented from multiple complementary perspectives including textual descriptions, diagrams, mathematical formulae, and pseudo-code.