Is diagram mein ek interesting concept dikhaya gaya hai: A neural network can use hidden neurons to detect different combinations of inputs.
Let's break it down.
We have:
2 input neurons:
4 hidden neurons:
1 output neuron:
Bias = -2
The colour of the edges represents weights:
Red edge = -1
Blue edge = +1
Notice the weights going into each hidden neuron.
| Hidden neuron | Weight from | Weight from |
|---|---|---|
| -1 | -1 | |
| -1 | +1 | |
| +1 | -1 | |
| +1 | +1 |
These represent all possible combinations of two bipolar inputs.
If inputs are either -1 or +1, there are:
possible combinations.
| -1 | -1 |
| -1 | +1 |
| +1 | -1 |
| +1 | +1 |
Each hidden neuron is designed to detect one particular combination.
Let's take
Its weights are:
Bias = -2.
Its weighted sum is:
For input
For input
So
The same principle applies to the other three neurons.
All four hidden neurons connect to the output neuron through weights:
The output neuron combines their outputs to produce the final prediction.
The exact output depends on these weights and the output activation function.
Number of possible input combinations
Where
| Inputs | Combinations |
|---|---|
| 1 | 2 |
| 2 | 4 |
| 3 | 8 |
| 4 | 16 |
| 10 | 1024 |
One technical caution: With the given bias of -2, a matching input produces weighted sum exactly zero. Whether that counts as neuron activation depends on whether the perceptron uses a
The main idea to remember: Each hidden neuron can be designed to recognise one particular input combination.