Welcome
  • Introduction and Outline
  • Where to get the code
  • Anyone Can Succeed in this Course
Review
  • Review Section Introduction
  • What does machine learning do?
  • Neuron Predictions
  • Neuron Training
  • Deep Learning Readiness Test
  • Review Section Summary
Preliminaries: From Neurons to Neural Networks
  • Neural Networks with No Math
  • Introduction to the E-Commerce Course Project
Classifying more than 2 things at a time
  • Prediction: Section Introduction and Outline
  • From Logistic Regression to Neural Networks
  • Interpreting the Weights of a Neural Network
  • Softmax
  • Sigmoid vs. Softmax
  • Feedforward in Slow-Mo (part 1)
  • Feedforward in Slow-Mo (part 2)
  • Where to get the code for this course
  • Softmax in Code
  • Building an entire feedforward neural network in Python
  • E-Commerce Course Project: Pre-Processing the Data
  • E-Commerce Course Project: Making Predictions
  • Prediction Quizzes
  • Prediction: Section Summary
  • Suggestion Box
Training a neural network
  • Training: Section Introduction and Outline
  • What do all these symbols and letters mean?
  • What does it mean to "train" a neural network?
  • How to Brace Yourself to Learn Backpropagation
  • Categorical Cross-Entropy Loss Function
  • Training Logistic Regression with Softmax (part 1)
  • Training Logistic Regression with Softmax (part 2)
  • Backpropagation (part 1)
  • Backpropagation (part 2)
  • Backpropagation in code
  • Backpropagation (part 3)
  • The WRONG Way to Learn Backpropagation
  • E-Commerce Course Project: Training Logistic Regression with Softmax
  • E-Commerce Course Project: Training a Neural Network
  • Training Quiz
  • Training: Section Summary
Practical Machine Learning
  • Practical Issues: Section Introduction and Outline
  • Donut and XOR Review
  • Donut and XOR Revisited
  • Neural Networks for Regression
  • Common nonlinearities and their derivatives
  • Practical Considerations for Choosing Activation Functions
  • Hyperparameters and Cross-Validation
  • Manually Choosing Learning Rate and Regularization Penalty
  • Why Divide by Square Root of D?
  • Practical Issues: Section Summary
TensorFlow, exercises, practice, and what to learn next
  • TensorFlow plug-and-play example
  • Visualizing what a neural network has learned using TensorFlow Playground
  • Where to go from here
  • You know more than you think you know
  • How to get good at deep learning + exercises
  • Deep neural networks in just 3 lines of code with Sci-Kit Learn
Project: Facial Expression Recognition
  • Facial Expression Recognition Project Introduction
  • Facial Expression Recognition Problem Description
  • The class imbalance problem
  • Utilities walkthrough
  • Facial Expression Recognition in Code (Binary / Sigmoid)
  • Facial Expression Recognition in Code (Logistic Regression Softmax)
  • Facial Expression Recognition in Code (ANN Softmax)
  • Facial Expression Recognition Project Summary
Backpropagation Supplementary Lectures
  • Backpropagation Supplementary Lectures Introduction
  • Why Learn the Ins and Outs of Backpropagation?
  • Gradient Descent Tutorial
  • Help with Softmax Derivative
  • Backpropagation with Softmax Troubleshooting
Higher-Level Discussion
  • What's the difference between "neural networks" and "deep learning"?
  • Who should take this course in 2020 and beyond?
  • Who should learn backpropagation in 2020 and beyond?
  • Where does this course fit into your deep learning studies?
Setting Up Your Environment (FAQ by Student Request)
  • Windows-Focused Environment Setup 2018
  • How to install Numpy, Scipy, Matplotlib, Pandas, IPython, Theano, and TensorFlow
Extra Help With Python Coding for Beginners (FAQ by Student Request)
  • How to Uncompress a .tar.gz file
  • How to Code by Yourself (part 1)
  • How to Code by Yourself (part 2)
  • Proof that using Jupyter Notebook is the same as not using it
  • Python 2 vs Python 3
Effective Learning Strategies for Machine Learning (FAQ by Student Request)
  • How to Succeed in this Course (Long Version)
  • Is this for Beginners or Experts? Academic or Practical? Fast or slow-paced?
  • Where does this course fit into your deep learning studies? (Old Version)
  • Machine Learning and AI Prerequisite Roadmap (pt 1)
  • Machine Learning and AI Prerequisite Roadmap (pt 2)