To learn what is neuro network, let’s first study a type of artificial neuron called a perceptron.
Perceptrons were invented by Frank Rosenblatt in the 1950s and 1960s. A perceptron takes several binary inputs and produces a single output:
In the above example, we have three inputs, , and . The perceptron then give each input a weight, , and , and calculate the weighted sum . The neuron’s output, 0 or 1, is determined by whether the weighted sum is less than or greater than some threshold value.
- The weighted sum is also widely used in Fuzzy Controllers. There are plenty of researches in fuzzy neural networks.
- The output function is also called active/transfer function can be: sgn, sigmoid neurons, ReLU.