Consider the system of Problem P10.3 again. Train the network using the LMS algorithm, with the initial guess set to zero and a learning rate a = 0.25. Apply each reference pattern only once during training. Draw the decision boundary at each stage.
Problem P10.3
Suppose that we have the following input/target pairs:
These patterns occur with equal probability, and they are used to train an ADALINE network with no bias. What does the mean square error performance surface look like?