Gradient descent algorithm

(경사 하강법)

• Minimize cost function
• Gradient descent is used many minimization problems
• For a given cost function cost(W, b), it will find W, b to minimize cost
• It can be applied to more general function: cost(W1, W2)
  

Formal definition

이해를 쉽게 하기 위해 b값은 0이라고 가정한다.

α: learning rate (상수)
W 값을 편미분하면

Gradient Descent Algorithm 식