# Deep Neural Network (DNN) in a Brief

Neural Network (NN):

It is a series of algorithms that endeavors to recognize underlying relationships in a set of data through a process that mimics the way the human brain operates.

Examples and Applications of NN:

Convolutio…

This content originally appeared on DEV Community and was authored by Afroz Chakure

### Neural Network (NN):

It is a series of algorithms that endeavors to recognize underlying relationships in a set of data through a process that mimics the way the human brain operates.

### Examples and Applications of NN:

1. Convolutional neural network => Good for image recognition
2. Long Short-Term memory network => Good for Speech Recognition

### Neuron:

1. It is a mathematical function that models the functioning of a biological neuron.
2. It computes the weighted average of its input and passes the sum through a non-linear function called the activation function (such as the sigmoid).

### Training an Artificial neural network:

Fig 1. Training an Artificial Neural Network

1. The process of repeated nudging an input of a function by some multiple of the negative gradient is called Gradient Descent.
2. When there are one or more inputs, you can use Gradient descent for optimizing the values of the coefficients by iteratively minimizing the error of the model on your training data.
3. A learning rate is used as a scale factor and the coefficients are updated in the direction towards minimizing the error.
4. This process is repeated until a minimum sum squared error is achieved or no further improvement is possible.

### Backward Propagation:

1. It is an algorithm for supervised learning of an ANN using Gradient Descent.
2. Given an ANN and an error function it calculates the gradient of the error function w.r.t. the NN weights.
3. Here the partial computations of the gradient from one layer are reused in the computation of the gradient for the previous layer.

### Backpropagation Calculation:

• The chain rule expressions give us the derivatives that determine each component in the gradient that helps to minimize the cost of the network by repeatedly stepping downhill.

This content originally appeared on DEV Community and was authored by Afroz Chakure

Print Share Comment Cite Upload Translate
APA
Afroz Chakure | Sciencx (2023-02-04T22:57:11+00:00) » Deep Neural Network (DNN) in a Brief. Retrieved from https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/.
MLA
" » Deep Neural Network (DNN) in a Brief." Afroz Chakure | Sciencx - Sunday February 7, 2021, https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/
HARVARD
Afroz Chakure | Sciencx Sunday February 7, 2021 » Deep Neural Network (DNN) in a Brief., viewed 2023-02-04T22:57:11+00:00,<https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/>
VANCOUVER
Afroz Chakure | Sciencx - » Deep Neural Network (DNN) in a Brief. [Internet]. [Accessed 2023-02-04T22:57:11+00:00]. Available from: https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/
CHICAGO
" » Deep Neural Network (DNN) in a Brief." Afroz Chakure | Sciencx - Accessed 2023-02-04T22:57:11+00:00. https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/
IEEE
" » Deep Neural Network (DNN) in a Brief." Afroz Chakure | Sciencx [Online]. Available: https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/. [Accessed: 2023-02-04T22:57:11+00:00]
rf:citation
» Deep Neural Network (DNN) in a Brief | Afroz Chakure | Sciencx | https://www.scien.cx/2021/02/07/deep-neural-network-dnn-in-a-brief/ | 2023-02-04T22:57:11+00:00