Warning: foreach() argument must be of type array|object, bool given in /var/www/html/web/app/themes/studypress-core-theme/template-parts/header/mobile-offcanvas.php on line 20

Suppose \(A\) is \(m \times n\) with linearly independent columns and \(b\) is in \({\mathbb{R}^m}\). Use the normal equations to produce a formula for \(\hat b\), the projection of b onto \({\rm{Col}}\,A\).

Short Answer

Expert verified

The formula is given by, \(\hat b = A{\left( {{A^T}A} \right)^{ - 1}}{A^T}b\).

Step by step solution

01

Least-square solution

It is given that,\(A\) is a \(m \times n\) matrix with linearly independent columns andb is in \({\mathbb{R}^m}\). So, the least-square solution \(\hat x\)is given by \(\hat x = {\left( {{A^T}A} \right)^{ - 1}}{A^T}b\).

02

Formula for \(\hat b\)

Given that\(b\)is an orthogonal projection onto\({\rm{Col}}\,A\), then\(\hat b = A\hat x\).

Substitute\(\hat x = {\left( {{A^T}A} \right)^{ - 1}}{A^T}b\)in the above equation to get:

\(\begin{aligned}{}\hat b &= A\hat x\\\hat b &= A{\left( {{A^T}A} \right)^{ - 1}}{A^T}b\end{aligned}\)

Hence, the required formula is \(\hat b = A{\left( {{A^T}A} \right)^{ - 1}}{A^T}b\).

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with Vaia!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

In exercises 1-6, determine which sets of vectors are orthogonal.

\(\left[ {\begin{array}{*{20}{c}}5\\{ - 4}\\0\\3\end{array}} \right]\), \(\left[ {\begin{array}{*{20}{c}}{ - 4}\\1\\{ - 3}\\8\end{array}} \right]\), \(\left[ {\begin{array}{*{20}{c}}3\\3\\5\\{ - 1}\end{array}} \right]\)

A healthy child’s systolic blood pressure (in millimetres of mercury) and weight (in pounds) are approximately related by the equation

\({\beta _0} + {\beta _1}\ln w = p\)

Use the following experimental data to estimate the systolic blood pressure of healthy child weighing 100 pounds.

\(\begin{array} w&\\ & {44}&{61}&{81}&{113}&{131} \\ \hline {\ln w}&\\vline & {3.78}&{4.11}&{4.39}&{4.73}&{4.88} \\ \hline p&\\vline & {91}&{98}&{103}&{110}&{112} \end{array}\)

For a matrix program, the Gram–Schmidt process worksbetter with orthonormal vectors. Starting with \({x_1},......,{x_p}\) asin Theorem 11, let \(A = \left\{ {{x_1},......,{x_p}} \right\}\) . Suppose \(Q\) is an\(n \times k\)matrix whose columns form an orthonormal basis for

the subspace \({W_k}\) spanned by the first \(k\) columns of A. Thenfor \(x\) in \({\mathbb{R}^n}\), \(Q{Q^T}x\) is the orthogonal projection of x onto \({W_k}\) (Theorem 10 in Section 6.3). If \({x_{k + 1}}\) is the next column of \(A\),then equation (2) in the proof of Theorem 11 becomes

\({v_{k + 1}} = {x_{k + 1}} - Q\left( {{Q^T}T {x_{k + 1}}} \right)\)

(The parentheses above reduce the number of arithmeticoperations.) Let \({u_{k + 1}} = \frac{{{v_{k + 1}}}}{{\left\| {{v_{k + 1}}} \right\|}}\). The new \(Q\) for thenext step is \(\left( {\begin{aligned}{{}{}}Q&{{u_{k + 1}}}\end{aligned}} \right)\). Use this procedure to compute the\(QR\)factorization of the matrix in Exercise 24. Write thekeystrokes or commands you use.

In Exercises 7–10, let\[W\]be the subspace spanned by the\[{\bf{u}}\]’s, and write y as the sum of a vector in\[W\]and a vector orthogonal to\[W\].

7.\[y = \left[ {\begin{aligned}1\\3\\5\end{aligned}} \right]\],\[{{\bf{u}}_1} = \left[ {\begin{aligned}1\\3\\{ - 2}\end{aligned}} \right]\],\[{{\bf{u}}_2} = \left[ {\begin{aligned}5\\1\\4\end{aligned}} \right]\]

In Exercises 1-4, find a least-sqaures solution of \(A{\bf{x}} = {\bf{b}}\) by (a) constructing a normal equations for \({\bf{\hat x}}\) and (b) solving for \({\bf{\hat x}}\).

2. \(A = \left( {\begin{aligned}{{}{}}{\bf{2}}&{\bf{1}}\\{ - {\bf{2}}}&{\bf{0}}\\{\bf{2}} {\bf{3}}\end{aligned}} \right)\), \(b = \left( {\begin{aligned}{{}{}}{ - {\bf{5}}}\\{\bf{8}}\\{\bf{1}}\end{aligned}} \right)\)

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.

Sign-up for free