Transformed errors are Gauss-Markov
Problem
- Setup
- Random sample \(\left( y_i,x_i \right)\) for \(i=1, \ldots ,n\)
- Correctly specified linear regression model, \(y_i=x'_iβ+ε_i\) where \(E\left( ε_i \mid x_i \right)=0\) .
- \(Var\left( ε_i \mid x_i \right)=σ^2σ_i^2\) where \(σ^2\) is unknown and \(σ_i^2\) is known or in matrix form, \(Var\left( ε \mid X \right)=σ^2Ψ\) where \(Ψ=diag\left( σ_1^2, \ldots ,σ_n^2 \right)\) .
- Transformed variables, vector form: \(y^*=Ψ^{-1/2}y\) , \(X^*=Ψ^{-1/2}X\) , \(ε^*=Ψ^{-1/2}ε\)
- Transformed model: \(y^*=X^*β+ε^*\)
Show that \(ε^*=Ψ^{-1/2 }ε\) are GM errors
Solution
\[E\left( Ψ^{-1/2 }ε \mid X \right)=Ψ^{-1/2 }E\left( ε \mid X \right)=Ψ^{-1/2 }⋅0=0\]
\[Var\left( Ψ^{-1/2}ε \mid X \right)=Ψ^{-1/2}Var\left( ε \mid X \right)Ψ^{-1/2}=Ψ^{-1/2}σ^2ΨΨ^{-1/2}=σ^2Ψ^{-1/2}ΨΨ^{-1/2}\]
Since \(Ψ=Ψ^{1/2}Ψ^{1/2}\) we have
\[σ^2Ψ^{-1/2}ΨΨ^{-1/2}=σ^2Ψ^{-1/2}Ψ^{1/2}Ψ^{1/2}Ψ^{-1/2}=σ^2I⋅I=σ^2I\]