Chapter 6: Q23E (page 331)
Suppose \(A\) is \(m \times n\) with linearly independent columns and \(b\) is in \({\mathbb{R}^m}\). Use the normal equations to produce a formula for \(\hat b\), the projection of b onto \({\rm{Col}}\,A\).
Short Answer
The formula is given by, \(\hat b = A{\left( {{A^T}A} \right)^{ - 1}}{A^T}b\).