Loss function, Cost function

The loss function computes the error for a single training example; the cost function is the average of the loss functions of the entire training set.