The ordinary least squares (OLS) procedure commonly used in regression produces a line of "best fit" for the data to which it is applied. How would you define best fit in regression analysis?
What is there about the procedure that guarantees a best fit to the data? What assumptions about the use of a regression technique are necessary to produce this result?