Artificial Intelligence

Artificial Intelligence: Any technique that enables computers to mimic human behavior
Machine Learning: Ability to learn without explicitly being programmed
Deep Learning: Extract patterns from data using neural networks

Importance of Activation Functions
The Purpose of activation functions is to introduce non-linearities into the network.

Empirical Loss
The empirical loss measures the total loss over our entire dataset.