Genesis of Deep Learning. Neuron & Artificial Neural Network (ANN)

In the beginning, there was (and still is) the neuron. A neuron is the basic building block of artificial neural networks, which forms the basic architecture for Deep Learning today.

neuron
Fig 1. Illustration of a neuron and its inputs

The neuron is basically, a summation of all inputs (X1, X2 & B in Fig 1) multiplied by the weights and passed through an activation function F (i.e. non-linear transformation). By combining a whole bunch of these neurons, you get an artificial neural network (Fig 2) which you could train to perform predictions of various tasks (e.g. estimate test results, classify stuff according to categories, etc.).

ann
Fig 2. Illustration of artificial neural network

So, there you go! this is the beginning of neural networks and Deep Learning as we know it today. I hope to share more about how the ANN works in upcoming posts.

Advertisements

One thought on “Genesis of Deep Learning. Neuron & Artificial Neural Network (ANN)

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s