If $E(Ymid X)=a+bX$, show that $b =fracmathrmCov(X,Y)mathrmVar(X)$ without assuming $(X,Y)$ has bivariate normal distribution? The Next CEO of Stack OverflowProving $a$ (in $Y = aX + b + e$) satisfies $a = Cov(X, Y )/Var(X)$Prove that (X,Y) is bivariate normal if X is normal and Y conditionally on X is normal$P(X>0,Y>0)$ for a bivariate normal distribution with correlation $rho$Symmetric property for bivariate normal distributionBivariate normal distribution questionBivariate distribution with normal conditionsDistribution Theory - bivariate normal distributionQuestion on bivariate normal distributionDo we really need finite variances $mathrmVar(X)$ and $mathrmVar(Y)$ in the definition of covariance $mathrmCov(X,Y)$?Non-normal Bivariate distribution with normal marginsCorrelation coefficient of a bivariate normal distribution
Is it okay to store user locations?
What's the point of interval inversion?
How do I solve this limit?
Text adventure game code
Customer Requests (Sometimes) Drive Me Bonkers!
Why didn't Khan get resurrected in the Genesis Explosion?
Is a stroke of luck acceptable after a series of unfavorable events?
Would this house-rule that treats advantage as a +1 to the roll instead (and disadvantage as -1) and allows them to stack be balanced?
Visit to the USA with ESTA approved before trip to Iran
Solution of this Diophantine Equation
Increase performance creating Mandelbrot set in python
How easy is it to start Magic from scratch?
What do "high sea" and "carry" mean in this sentence?
Science fiction (dystopian) short story set after WWIII
How do spells that require an ability check vs. the caster's spell save DC work?
How to write papers efficiently when English isn't my first language?
When airplanes disconnect from a tanker during air to air refueling, why do they bank so sharply to the right?
How to use tikz in fbox?
Why do remote companies require working in the US?
What can we do to stop prior company from asking us questions?
Why does standard notation not preserve intervals (visually)
Term for the "extreme-extension" version of a straw man fallacy?
MAZDA 3 2006 (UK) - poor acceleration then takes off at 3250 revs
Why didn't Theresa May consult with Parliament before negotiating a deal with the EU?
If $E(Ymid X)=a+bX$, show that $b =fracmathrmCov(X,Y)mathrmVar(X)$ without assuming $(X,Y)$ has bivariate normal distribution?
The Next CEO of Stack OverflowProving $a$ (in $Y = aX + b + e$) satisfies $a = Cov(X, Y )/Var(X)$Prove that (X,Y) is bivariate normal if X is normal and Y conditionally on X is normal$P(X>0,Y>0)$ for a bivariate normal distribution with correlation $rho$Symmetric property for bivariate normal distributionBivariate normal distribution questionBivariate distribution with normal conditionsDistribution Theory - bivariate normal distributionQuestion on bivariate normal distributionDo we really need finite variances $mathrmVar(X)$ and $mathrmVar(Y)$ in the definition of covariance $mathrmCov(X,Y)$?Non-normal Bivariate distribution with normal marginsCorrelation coefficient of a bivariate normal distribution
$begingroup$
If $E(Ymid X)=a+bX$, show that $b =fracmathrmCov(X,Y)mathrmVar(X)$ where $a$ and $b$ are constants.
This question was asked before:
Proving $a$ (in $Y = aX + b + e$) satisfies $a = Cov(X, Y )/Var(X)$
But can someone suggest an answer without assuming bivariate normal distribution?
probability-theory probability-distributions conditional-probability
$endgroup$
add a comment |
$begingroup$
If $E(Ymid X)=a+bX$, show that $b =fracmathrmCov(X,Y)mathrmVar(X)$ where $a$ and $b$ are constants.
This question was asked before:
Proving $a$ (in $Y = aX + b + e$) satisfies $a = Cov(X, Y )/Var(X)$
But can someone suggest an answer without assuming bivariate normal distribution?
probability-theory probability-distributions conditional-probability
$endgroup$
1
$begingroup$
It comes down to justifying $operatornamecov(X,,Y)=operatornamecov(X,,a+bX)$.
$endgroup$
– J.G.
Mar 18 at 10:49
$begingroup$
$X$ and $Y$ should be square integrable, this is missing from the statement
$endgroup$
– zhoraster
Mar 18 at 10:55
$begingroup$
Law of total covariance should do then.
$endgroup$
– Mann
Mar 18 at 11:07
add a comment |
$begingroup$
If $E(Ymid X)=a+bX$, show that $b =fracmathrmCov(X,Y)mathrmVar(X)$ where $a$ and $b$ are constants.
This question was asked before:
Proving $a$ (in $Y = aX + b + e$) satisfies $a = Cov(X, Y )/Var(X)$
But can someone suggest an answer without assuming bivariate normal distribution?
probability-theory probability-distributions conditional-probability
$endgroup$
If $E(Ymid X)=a+bX$, show that $b =fracmathrmCov(X,Y)mathrmVar(X)$ where $a$ and $b$ are constants.
This question was asked before:
Proving $a$ (in $Y = aX + b + e$) satisfies $a = Cov(X, Y )/Var(X)$
But can someone suggest an answer without assuming bivariate normal distribution?
probability-theory probability-distributions conditional-probability
probability-theory probability-distributions conditional-probability
edited Mar 18 at 22:02
Jack
27.6k1782203
27.6k1782203
asked Mar 18 at 10:33
Sri Krishna SahooSri Krishna Sahoo
620217
620217
1
$begingroup$
It comes down to justifying $operatornamecov(X,,Y)=operatornamecov(X,,a+bX)$.
$endgroup$
– J.G.
Mar 18 at 10:49
$begingroup$
$X$ and $Y$ should be square integrable, this is missing from the statement
$endgroup$
– zhoraster
Mar 18 at 10:55
$begingroup$
Law of total covariance should do then.
$endgroup$
– Mann
Mar 18 at 11:07
add a comment |
1
$begingroup$
It comes down to justifying $operatornamecov(X,,Y)=operatornamecov(X,,a+bX)$.
$endgroup$
– J.G.
Mar 18 at 10:49
$begingroup$
$X$ and $Y$ should be square integrable, this is missing from the statement
$endgroup$
– zhoraster
Mar 18 at 10:55
$begingroup$
Law of total covariance should do then.
$endgroup$
– Mann
Mar 18 at 11:07
1
1
$begingroup$
It comes down to justifying $operatornamecov(X,,Y)=operatornamecov(X,,a+bX)$.
$endgroup$
– J.G.
Mar 18 at 10:49
$begingroup$
It comes down to justifying $operatornamecov(X,,Y)=operatornamecov(X,,a+bX)$.
$endgroup$
– J.G.
Mar 18 at 10:49
$begingroup$
$X$ and $Y$ should be square integrable, this is missing from the statement
$endgroup$
– zhoraster
Mar 18 at 10:55
$begingroup$
$X$ and $Y$ should be square integrable, this is missing from the statement
$endgroup$
– zhoraster
Mar 18 at 10:55
$begingroup$
Law of total covariance should do then.
$endgroup$
– Mann
Mar 18 at 11:07
$begingroup$
Law of total covariance should do then.
$endgroup$
– Mann
Mar 18 at 11:07
add a comment |
2 Answers
2
active
oldest
votes
$begingroup$
Observe that: $$mathbbEY=mathbbEleft[mathbbEleft[Ymid Xright]right]=mathbbEleft[a+bXright]=a+bmathbbEX$$
so that:
$$mathsfCovleft(X,Yright)=mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)right]=mathbbEleft[mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)mid Xright]right]=$$$$mathbbEleft[left(X-mathbbEXright)mathbbEleft[left(Y-mathbbEYright)mid Xright]right]=mathbbEleft[left(X-mathbbEXright)left(a+bX-mathbbEYright)right]=bmathbbEleft(X-mathbbEXright)^2=bmathsfVarX$$
$endgroup$
add a comment |
$begingroup$
Least squares method. Consider the squared residual that must be minimized:
$$R^2=sum_i=1^n (y_i-ax_i-b)^2;\
begincases(R^2)_a=-2sum_i=1^n(y_i-ax_i-b)x_i=0\
(R^2)_b=-sum_i=1^n (y_i-ax_i-b)=0 endcases Rightarrow \
begincasescolorredsum_i=1^n x_i^2cdot a+colorbluesum_i=1^n x_icdot b=
colorgreensum_i=1^n x_iy_i\
colorredsum_i=1^n x_icdot a+qquad colorbluencdot b=colorgreensum_i=1^n y_iendcases qquad stackrelCramerRightarrow \
a=fracbeginvmatrixcolorgreensum_i=1^n x_iy_i&colorbluesum_i=1^n x_i\ colorgreensum_i=1^n y_i&colorbluenendvmatrixbeginvmatrixcolorredsum_i=1^n x_i^2&colorbluesum_i=1^n x_i\ colorredsum_i=1^n x_i&colorbluenendvmatrix=
fracnsum_i=1^n x_iy_i-sum_i=1^n x_icdot sum_i=1^n y_insum_i=1^n x_i^2-(sum_i=1^n x_i)^2=\
fracfracsum_i=1^n x_iy_in-fracsum_i=1^n x_incdot fracsum_i=1^n y_infracsum_i=1^n x_i^2n-left(fracsum_i=1^n x_inright)^2=\
fracCov(X,Y)Var(X).$$
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3152630%2fif-ey-mid-x-abx-show-that-b-frac-mathrmcovx-y-mathrmvarx-w%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Observe that: $$mathbbEY=mathbbEleft[mathbbEleft[Ymid Xright]right]=mathbbEleft[a+bXright]=a+bmathbbEX$$
so that:
$$mathsfCovleft(X,Yright)=mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)right]=mathbbEleft[mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)mid Xright]right]=$$$$mathbbEleft[left(X-mathbbEXright)mathbbEleft[left(Y-mathbbEYright)mid Xright]right]=mathbbEleft[left(X-mathbbEXright)left(a+bX-mathbbEYright)right]=bmathbbEleft(X-mathbbEXright)^2=bmathsfVarX$$
$endgroup$
add a comment |
$begingroup$
Observe that: $$mathbbEY=mathbbEleft[mathbbEleft[Ymid Xright]right]=mathbbEleft[a+bXright]=a+bmathbbEX$$
so that:
$$mathsfCovleft(X,Yright)=mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)right]=mathbbEleft[mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)mid Xright]right]=$$$$mathbbEleft[left(X-mathbbEXright)mathbbEleft[left(Y-mathbbEYright)mid Xright]right]=mathbbEleft[left(X-mathbbEXright)left(a+bX-mathbbEYright)right]=bmathbbEleft(X-mathbbEXright)^2=bmathsfVarX$$
$endgroup$
add a comment |
$begingroup$
Observe that: $$mathbbEY=mathbbEleft[mathbbEleft[Ymid Xright]right]=mathbbEleft[a+bXright]=a+bmathbbEX$$
so that:
$$mathsfCovleft(X,Yright)=mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)right]=mathbbEleft[mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)mid Xright]right]=$$$$mathbbEleft[left(X-mathbbEXright)mathbbEleft[left(Y-mathbbEYright)mid Xright]right]=mathbbEleft[left(X-mathbbEXright)left(a+bX-mathbbEYright)right]=bmathbbEleft(X-mathbbEXright)^2=bmathsfVarX$$
$endgroup$
Observe that: $$mathbbEY=mathbbEleft[mathbbEleft[Ymid Xright]right]=mathbbEleft[a+bXright]=a+bmathbbEX$$
so that:
$$mathsfCovleft(X,Yright)=mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)right]=mathbbEleft[mathbbEleft[left(X-mathbbEXright)left(Y-mathbbEYright)mid Xright]right]=$$$$mathbbEleft[left(X-mathbbEXright)mathbbEleft[left(Y-mathbbEYright)mid Xright]right]=mathbbEleft[left(X-mathbbEXright)left(a+bX-mathbbEYright)right]=bmathbbEleft(X-mathbbEXright)^2=bmathsfVarX$$
answered Mar 18 at 11:05
drhabdrhab
104k545136
104k545136
add a comment |
add a comment |
$begingroup$
Least squares method. Consider the squared residual that must be minimized:
$$R^2=sum_i=1^n (y_i-ax_i-b)^2;\
begincases(R^2)_a=-2sum_i=1^n(y_i-ax_i-b)x_i=0\
(R^2)_b=-sum_i=1^n (y_i-ax_i-b)=0 endcases Rightarrow \
begincasescolorredsum_i=1^n x_i^2cdot a+colorbluesum_i=1^n x_icdot b=
colorgreensum_i=1^n x_iy_i\
colorredsum_i=1^n x_icdot a+qquad colorbluencdot b=colorgreensum_i=1^n y_iendcases qquad stackrelCramerRightarrow \
a=fracbeginvmatrixcolorgreensum_i=1^n x_iy_i&colorbluesum_i=1^n x_i\ colorgreensum_i=1^n y_i&colorbluenendvmatrixbeginvmatrixcolorredsum_i=1^n x_i^2&colorbluesum_i=1^n x_i\ colorredsum_i=1^n x_i&colorbluenendvmatrix=
fracnsum_i=1^n x_iy_i-sum_i=1^n x_icdot sum_i=1^n y_insum_i=1^n x_i^2-(sum_i=1^n x_i)^2=\
fracfracsum_i=1^n x_iy_in-fracsum_i=1^n x_incdot fracsum_i=1^n y_infracsum_i=1^n x_i^2n-left(fracsum_i=1^n x_inright)^2=\
fracCov(X,Y)Var(X).$$
$endgroup$
add a comment |
$begingroup$
Least squares method. Consider the squared residual that must be minimized:
$$R^2=sum_i=1^n (y_i-ax_i-b)^2;\
begincases(R^2)_a=-2sum_i=1^n(y_i-ax_i-b)x_i=0\
(R^2)_b=-sum_i=1^n (y_i-ax_i-b)=0 endcases Rightarrow \
begincasescolorredsum_i=1^n x_i^2cdot a+colorbluesum_i=1^n x_icdot b=
colorgreensum_i=1^n x_iy_i\
colorredsum_i=1^n x_icdot a+qquad colorbluencdot b=colorgreensum_i=1^n y_iendcases qquad stackrelCramerRightarrow \
a=fracbeginvmatrixcolorgreensum_i=1^n x_iy_i&colorbluesum_i=1^n x_i\ colorgreensum_i=1^n y_i&colorbluenendvmatrixbeginvmatrixcolorredsum_i=1^n x_i^2&colorbluesum_i=1^n x_i\ colorredsum_i=1^n x_i&colorbluenendvmatrix=
fracnsum_i=1^n x_iy_i-sum_i=1^n x_icdot sum_i=1^n y_insum_i=1^n x_i^2-(sum_i=1^n x_i)^2=\
fracfracsum_i=1^n x_iy_in-fracsum_i=1^n x_incdot fracsum_i=1^n y_infracsum_i=1^n x_i^2n-left(fracsum_i=1^n x_inright)^2=\
fracCov(X,Y)Var(X).$$
$endgroup$
add a comment |
$begingroup$
Least squares method. Consider the squared residual that must be minimized:
$$R^2=sum_i=1^n (y_i-ax_i-b)^2;\
begincases(R^2)_a=-2sum_i=1^n(y_i-ax_i-b)x_i=0\
(R^2)_b=-sum_i=1^n (y_i-ax_i-b)=0 endcases Rightarrow \
begincasescolorredsum_i=1^n x_i^2cdot a+colorbluesum_i=1^n x_icdot b=
colorgreensum_i=1^n x_iy_i\
colorredsum_i=1^n x_icdot a+qquad colorbluencdot b=colorgreensum_i=1^n y_iendcases qquad stackrelCramerRightarrow \
a=fracbeginvmatrixcolorgreensum_i=1^n x_iy_i&colorbluesum_i=1^n x_i\ colorgreensum_i=1^n y_i&colorbluenendvmatrixbeginvmatrixcolorredsum_i=1^n x_i^2&colorbluesum_i=1^n x_i\ colorredsum_i=1^n x_i&colorbluenendvmatrix=
fracnsum_i=1^n x_iy_i-sum_i=1^n x_icdot sum_i=1^n y_insum_i=1^n x_i^2-(sum_i=1^n x_i)^2=\
fracfracsum_i=1^n x_iy_in-fracsum_i=1^n x_incdot fracsum_i=1^n y_infracsum_i=1^n x_i^2n-left(fracsum_i=1^n x_inright)^2=\
fracCov(X,Y)Var(X).$$
$endgroup$
Least squares method. Consider the squared residual that must be minimized:
$$R^2=sum_i=1^n (y_i-ax_i-b)^2;\
begincases(R^2)_a=-2sum_i=1^n(y_i-ax_i-b)x_i=0\
(R^2)_b=-sum_i=1^n (y_i-ax_i-b)=0 endcases Rightarrow \
begincasescolorredsum_i=1^n x_i^2cdot a+colorbluesum_i=1^n x_icdot b=
colorgreensum_i=1^n x_iy_i\
colorredsum_i=1^n x_icdot a+qquad colorbluencdot b=colorgreensum_i=1^n y_iendcases qquad stackrelCramerRightarrow \
a=fracbeginvmatrixcolorgreensum_i=1^n x_iy_i&colorbluesum_i=1^n x_i\ colorgreensum_i=1^n y_i&colorbluenendvmatrixbeginvmatrixcolorredsum_i=1^n x_i^2&colorbluesum_i=1^n x_i\ colorredsum_i=1^n x_i&colorbluenendvmatrix=
fracnsum_i=1^n x_iy_i-sum_i=1^n x_icdot sum_i=1^n y_insum_i=1^n x_i^2-(sum_i=1^n x_i)^2=\
fracfracsum_i=1^n x_iy_in-fracsum_i=1^n x_incdot fracsum_i=1^n y_infracsum_i=1^n x_i^2n-left(fracsum_i=1^n x_inright)^2=\
fracCov(X,Y)Var(X).$$
answered Mar 18 at 13:04
farruhotafarruhota
21.6k2842
21.6k2842
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3152630%2fif-ey-mid-x-abx-show-that-b-frac-mathrmcovx-y-mathrmvarx-w%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
$begingroup$
It comes down to justifying $operatornamecov(X,,Y)=operatornamecov(X,,a+bX)$.
$endgroup$
– J.G.
Mar 18 at 10:49
$begingroup$
$X$ and $Y$ should be square integrable, this is missing from the statement
$endgroup$
– zhoraster
Mar 18 at 10:55
$begingroup$
Law of total covariance should do then.
$endgroup$
– Mann
Mar 18 at 11:07