AI is the new electricity.

  1. What is a neural network?
    Deep learning is training neural network.
    Simple neural network can be a LR model.

neuron is actually the function to output y. For example, input x (size of a house) to function f and get the ouput y (price of the house), the function f is a neuron.

ReLU function (Rectified Linear Unit 线性整流单元)
This function take an input and output a max from 0 and the input.

Standard NN