Consider the system of Problem P10.3 again. Train the network using the LMS algorithm, with the initial guess set to zero and a learning rate a = 0.25. Apply each reference pattern only once during training. Draw the decision boundary at each stage.
Problem P10.3
Suppose that we have the following input/target pairs:
![1703_14f7531c-51e1-46c3-8708-36926a5abfa4.png](https://secure.tutorsglobe.com/CMSImages/1703_14f7531c-51e1-46c3-8708-36926a5abfa4.png)
These patterns occur with equal probability, and they are used to train an ADALINE network with no bias. What does the mean square error performance surface look like?