Warning: foreach() argument must be of type array|object, bool given in /var/www/html/web/app/themes/studypress-core-theme/template-parts/header/mobile-offcanvas.php on line 20

Suppose that X1,….., Xn form a random sample from the normal distribution with unknown mean µ and known variance σ2> 0 . Show thatX̄nis an efficient estimator of µ.

Short Answer

Expert verified

n is the most efficient estimator of µ.

Step by step solution

01

Given the information

It is given that X1,….., Xnis iid variables from a normal distribution with unknown mean µ and known variance σ2> 0. Therefore X1….. Xn are iid normal ( µ, σ).

02

Define the pdf

f(x| µ, σ ) = 1/√ 2πσ2) exp(- 1/2 ((x -µ)/σ)2)

03

Define an efficient estimator

The most efficient estimator among a group of unbiased estimators is the one with the minor variance.

An efficient estimator also fetches a small variance or mean square error. Therefore, there is a slight deviation between the estimated and parameter values

04

Define fisher information

So, to establish efficiency, we have to compare the estimator's variance with the Cramer-Rao bound.

Assume X~ f (x| θ) (pdf or pmf) with θ ∈ ʘ ⊂ R

Then the fisher information is defined by

Ix(θ) = Eθ[(∂ / ∂θ logf(X|θ))2]

= Eθ[(-∂2 / ∂θ2 logf(X|θ)]

And

Ix(θ) = nlx1 (θ)

05

Calculating fisher information for normal distribution

Let X =X1

From the definition

Ix(θ) = Eθ[(∂ / (∂σ2)2 log f(X|θ2)]

= -3(x-µ)2/ σ4 + 1/σ2

= 1/2 σ2

And we know that,

Ix2) = nIX12)

= n/2 σ2

therefore fisher information isn/2σ2

06

Applying CRLB bound

Now, by the Cramer Rao bound

V (σ)≥ Ix2)-1= n/2σ2

Since the lowest bound of variance is attained by CRLB equality, the M.L.E.X̄n is the most efficient estimator of µ.

Unlock Step-by-Step Solutions & Ace Your Exams!

  • Full Textbook Solutions

    Get detailed explanations and key concepts

  • Unlimited Al creation

    Al flashcards, explanations, exams and more...

  • Ads-free access

    To over 500 millions flashcards

  • Money-back guarantee

    We refund you if you fail your exam.

Over 30 million students worldwide already upgrade their learning with Vaia!

One App. One Place for Learning.

All the tools & learning materials you need for study success - in one app.

Get started for free

Most popular questions from this chapter

Consider again the conditions of Exercise 12. Suppose also that in a random sample of size n = 8, it is found that \(\sum\limits_{{\bf{i = 1}}}^{\bf{n}} {{{\bf{x}}_{\bf{i}}}{\bf{ = 16}}} \,\,{\bf{and}}\,\,\sum\limits_{{\bf{i = 1}}}^{\bf{n}} {{{\bf{x}}_{\bf{i}}}^{\bf{2}}{\bf{ = 48}}} \) . Find the shortest possible interval such that the posterior probability that \({\bf{\mu }}\) lies inthe interval is 0.99.

Suppose that a point(X, Y )is to be chosen at random in thexy-plane, whereXandYare independent random variables, and each has the standard normal distribution. If a circle is drawn in thexy-plane with its center at the origin, what is the radius of the smallest circle that can be chosen for there to be a probability of 0.99 that the point(X, Y )will lie inside the circle?

By using the table of the t distribution given in the back of this book, determine the value of the integral

\(\int\limits_{ - \infty }^{2.5} {\frac{{dx}}{{{{\left( {12 + {x^2}} \right)}^2}}}} \)

Suppose that\({{\bf{X}}_{\bf{1}}}{\bf{, \ldots ,}}{{\bf{X}}_{\bf{n}}}\)form a random sample from the normal distribution with meanμand variance\({{\bf{\sigma }}^{\bf{2}}}\), and let\({{\bf{\hat \sigma }}^{\bf{2}}}\)denote the sample variance. Determine the smallest values ofnfor which the following relations are satisfied:

  1. \({\bf{Pr}}\left( {\frac{{{{{\bf{\hat \sigma }}}^{\bf{2}}}}}{{{{\bf{\sigma }}^{\bf{2}}}}} \le {\bf{1}}{\bf{.5}}} \right) \ge {\bf{0}}{\bf{.95}}\)
  2. \({\bf{Pr}}\left( {\left| {{{{\bf{\hat \sigma }}}^{\bf{2}}}{\bf{ - }}{{\bf{\sigma }}^{\bf{2}}}} \right| \le \frac{{\bf{1}}}{{\bf{2}}}{{\bf{\sigma }}^{\bf{2}}}} \right) \ge {\bf{0}}{\bf{.8}}\)

Question:Suppose that a specific population of individuals is composed of k different strata (k ≥ 2), and that for i = 1,...,k, the proportion of individuals in the total population who belong to stratum i is pi, where pi > 0 and\(\sum\nolimits_{{\bf{i = 1}}}^{\bf{k}} {{{\bf{p}}_{\bf{i}}}{\bf{ = 1}}} \). We are interested in estimating the mean value μ of a particular characteristic among the total population. Among the individuals in stratum i, this characteristic has mean\({{\bf{\mu }}_{\bf{i}}}\)and variance\({\bf{\sigma }}_{\bf{i}}^{\bf{2}}\), where the value of\({{\bf{\mu }}_{\bf{i}}}\)is unknown and the value of\({\bf{\sigma }}_{\bf{i}}^{\bf{2}}\)is known. Suppose that a stratified sample is taken from the population as follows: From each stratum i, a random sample of ni individuals is taken, and the characteristic is measured for each individual. The samples from the k strata are taken independently of each other. Let\({{\bf{\bar X}}_{\bf{i}}}\)denote the average of the\({{\bf{n}}_{\bf{i}}}\)measurements in the sample from stratum i.

a. Show that\({\bf{\mu = }}\sum\nolimits_{{\bf{i = 1}}}^{\bf{k}} {{{\bf{p}}_{\bf{i}}}{{\bf{\mu }}_{\bf{i}}}} \), and show also that\({\bf{\hat \mu = }}\sum\nolimits_{{\bf{i = 1}}}^{\bf{k}} {{{\bf{p}}_{\bf{i}}}{{{\bf{\bar X}}}_{\bf{i}}}} \)is an unbiased estimator of μ.

b. Let\({\bf{n = }}\sum\nolimits_{{\bf{i = 1}}}^{\bf{k}} {{{\bf{n}}_{\bf{i}}}} \)denote the total number of observations in the k samples. For a fixed value of n, find the values for which the variance \({\bf{\hat \mu }}\)will be a minimum.

See all solutions

Recommended explanations on Math Textbooks

View all explanations

What do you think about this solution?

We value your feedback to improve our textbook solutions.

Study anywhere. Anytime. Across all devices.

Sign-up for free