OLS estimator of AR($1$) is biasedUnbiased Estimator for a Uniform Variable SupportOLS standard error that corrects for autocorrelation but not heteroskedasticityRates of convergence of an OLS estimatorIs this estimator biased?AR(1) process: Finding the distribution of the prediction errorHow to show $Y = sum_i=1^n fracY_in-2$ is a biased estimator of the mean?show $bar x$ is biased estimator $f(x)=e^(delta-x)$A question about nonstationary test in time series.Determine if an Estimator is Biased (Unusual Expectation Expression)Conditional expectation $operatorname E[varepsilon_svarepsilon_tmid X_1,ldots,X_n-1]$
Friend wants my recommendation but I don't want to
What is 管理しきれず?
Would mining huge amounts of resources on the Moon change its orbit?
Was World War I a war of liberals against authoritarians?
Writing in a Christian voice
How to test the sharpness of a knife?
Exposing a company lying about themselves in a tightly knit industry: Is my career at risk on the long run?
Why is participating in the European Parliamentary elections used as a threat?
Print a physical multiplication table
Recursively updating the MLE as new observations stream in
Hot air balloons as primitive bombers
Unfrosted light bulb
Why didn’t Eve recognize the little cockroach as a living organism?
What is the reasoning behind standardization (dividing by standard deviation)?
PTIJ: At the Passover Seder, is one allowed to speak more than once during Maggid?
What is the difference between something being completely legal and being completely decriminalized?
Why do I have a large white artefact on the rendered image?
PTIJ: Why do we make a Lulav holder?
Why are there no stars visible in cislunar space?
What is the tangent at a sharp point on a curve?
Determine voltage drop over 10G resistors with cheap multimeter
What is it called when someone votes for an option that's not their first choice?
Asserting that Atheism and Theism are both faith based positions
How to find the largest number(s) in a list of elements, possibly non-unique?
OLS estimator of AR($1$) is biased
Unbiased Estimator for a Uniform Variable SupportOLS standard error that corrects for autocorrelation but not heteroskedasticityRates of convergence of an OLS estimatorIs this estimator biased?AR(1) process: Finding the distribution of the prediction errorHow to show $Y = sum_i=1^n fracY_in-2$ is a biased estimator of the mean?show $bar x$ is biased estimator $f(x)=e^(delta-x)$A question about nonstationary test in time series.Determine if an Estimator is Biased (Unusual Expectation Expression)Conditional expectation $operatorname E[varepsilon_svarepsilon_tmid X_1,ldots,X_n-1]$
$begingroup$
Suppose that we have a sample $X_0,X_1,ldots,X_n$ from the AR($1$) model given by
$$
X_t=phi X_t-1+varepsilon_t
$$
for $tinmathbb Z$, where $|phi|<1$ and $varepsilon_t_tinmathbb Z$ are iid random variables such that $operatorname Evarepsilon_0=0$ and $operatorname Evarepsilon_0^2=sigma^2<infty$. The OLS estimator of $phi$ is given by
$$
hatphi
=phi+sum_t=1^nBigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_t.
$$
How can I show that
$$
sum_t=1^n-1operatorname EBigl[Bigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_tBigr]ne0,
$$
i.e. that the estimator $hatphi$ is biased?
Intuitively, if we increase $varepsilon_t$ and $phi>0$, then we also increase $X_t+1,X_t+2,ldots$ and it seems that $operatorname Ehat phi<phi$ if $phi>0$ and $operatorname Ehat phi>phi$ if $phi<0$. Is this correct? This is only an heuristic argument. How can I rigorously show that the expected value is not equal to $0$?
Any help is much appreciated!
statistics least-squares time-series
$endgroup$
add a comment |
$begingroup$
Suppose that we have a sample $X_0,X_1,ldots,X_n$ from the AR($1$) model given by
$$
X_t=phi X_t-1+varepsilon_t
$$
for $tinmathbb Z$, where $|phi|<1$ and $varepsilon_t_tinmathbb Z$ are iid random variables such that $operatorname Evarepsilon_0=0$ and $operatorname Evarepsilon_0^2=sigma^2<infty$. The OLS estimator of $phi$ is given by
$$
hatphi
=phi+sum_t=1^nBigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_t.
$$
How can I show that
$$
sum_t=1^n-1operatorname EBigl[Bigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_tBigr]ne0,
$$
i.e. that the estimator $hatphi$ is biased?
Intuitively, if we increase $varepsilon_t$ and $phi>0$, then we also increase $X_t+1,X_t+2,ldots$ and it seems that $operatorname Ehat phi<phi$ if $phi>0$ and $operatorname Ehat phi>phi$ if $phi<0$. Is this correct? This is only an heuristic argument. How can I rigorously show that the expected value is not equal to $0$?
Any help is much appreciated!
statistics least-squares time-series
$endgroup$
add a comment |
$begingroup$
Suppose that we have a sample $X_0,X_1,ldots,X_n$ from the AR($1$) model given by
$$
X_t=phi X_t-1+varepsilon_t
$$
for $tinmathbb Z$, where $|phi|<1$ and $varepsilon_t_tinmathbb Z$ are iid random variables such that $operatorname Evarepsilon_0=0$ and $operatorname Evarepsilon_0^2=sigma^2<infty$. The OLS estimator of $phi$ is given by
$$
hatphi
=phi+sum_t=1^nBigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_t.
$$
How can I show that
$$
sum_t=1^n-1operatorname EBigl[Bigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_tBigr]ne0,
$$
i.e. that the estimator $hatphi$ is biased?
Intuitively, if we increase $varepsilon_t$ and $phi>0$, then we also increase $X_t+1,X_t+2,ldots$ and it seems that $operatorname Ehat phi<phi$ if $phi>0$ and $operatorname Ehat phi>phi$ if $phi<0$. Is this correct? This is only an heuristic argument. How can I rigorously show that the expected value is not equal to $0$?
Any help is much appreciated!
statistics least-squares time-series
$endgroup$
Suppose that we have a sample $X_0,X_1,ldots,X_n$ from the AR($1$) model given by
$$
X_t=phi X_t-1+varepsilon_t
$$
for $tinmathbb Z$, where $|phi|<1$ and $varepsilon_t_tinmathbb Z$ are iid random variables such that $operatorname Evarepsilon_0=0$ and $operatorname Evarepsilon_0^2=sigma^2<infty$. The OLS estimator of $phi$ is given by
$$
hatphi
=phi+sum_t=1^nBigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_t.
$$
How can I show that
$$
sum_t=1^n-1operatorname EBigl[Bigl(fracX_t-1sum_t=1^nX_t-1^2Bigr)varepsilon_tBigr]ne0,
$$
i.e. that the estimator $hatphi$ is biased?
Intuitively, if we increase $varepsilon_t$ and $phi>0$, then we also increase $X_t+1,X_t+2,ldots$ and it seems that $operatorname Ehat phi<phi$ if $phi>0$ and $operatorname Ehat phi>phi$ if $phi<0$. Is this correct? This is only an heuristic argument. How can I rigorously show that the expected value is not equal to $0$?
Any help is much appreciated!
statistics least-squares time-series
statistics least-squares time-series
edited Mar 13 at 11:29
Cettt
1,888622
1,888622
asked Mar 13 at 10:11
Cm7F7BbCm7F7Bb
12.6k32243
12.6k32243
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3146367%2fols-estimator-of-ar1-is-biased%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3146367%2fols-estimator-of-ar1-is-biased%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown