[TIL_200918] Optimization Problem - Gradient Checking

오늘 배운 것

Improving Deep Neural Networks 1주 차

Optimization Problem

• Normalizing Inputs
• Vanishing/Exploding Gradients
• Weight Initialization
• Numerical Approximation of Gradients
• Gradient Checking

내일 배울 것

Improving Deep Neural Networks 2주 차

Optimization Algorithms