Repeat the image-coding experiment of the previous problem

Question

Repeat the image-coding experiment of the previous problem using a Jayant quantizer. We want to DPCM-encode images using a two-tap predictor of the form

X^{^}_i,j = a x X_i,j-1 + b x X_i-1,j

and a four-level quantizer followed by a Huffman coder. Find the equations we need to solve to obtain coefficients a and b that minimize the mean squared error.