1. Computation Graph

• Back propagation is basically a process to find a relationship between cost J function and the parameters.
• It works its way backwards from the result, then finds the derivatives values as it moves backwards.
  
• N (Number of units) + P (Number of parameters) = the number of steps needed to compute the derivatives.
  What derivatives??