Learning curves

• Learning curves
• Loss curve
• Accuracy curve
• Overfitting
• Unstable curves
• Can we benefit from more data
• Coding train size comparison

Activation functions

• Activation zoo
• Effects of activation functions
• Which activation function to use?
• Comparing activation functions

Batch size and batch normalization

• Batches
• Mini-batch
• Effects of batch sizes
• Batch size in Keras
• Normalization in machine learning
• Reasons for batch normalization
• Batch normalization advantages
• Batch normalization in Keras

Hyperparameter tuning

• Neural network hyperparameters
• Sklearn recap
• Turn a Keras model into a Sklearn estimator
• Cross-validation
• Tips for neural networks hyperparameter tuning
• A random search on Keras models
• Tuning other hyperparameters