What is the relationship between converge(calculus) and converge in probability(statistic) The 2019 Stack Overflow Developer Survey Results Are In Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)convergence in probability induced by a metricUnderstanding Uniform ContinuityWhat exactly is simple consistency?Formal Definition of Limit and ProofsDefinition of continuityAt what point is the function $f:mathbbRrightarrowmathbbR$ continuous?if $x_0$ is a limit point of $D$, then a function $f:DrightarrowmathbbR$ is continuous at $x_0$ iff $limlimits_xrightarrow x_0f(x)=f(x_0)$Understanding “For every $theta in Theta$” in the definition of the weak consistence of an estimatorRelationship between unit circle and cosine wave?Relation between the concept of Contiguity and Absolutely Continuous Measures$lim$ vs $liminf$ and $limsup$ in the proof convergence in probability implies convergence in distribution
Homework question about an engine pulling a train
How do I design a circuit to convert a 100 mV and 50 Hz sine wave to a square wave?
Why are PDP-7-style microprogrammed instructions out of vogue?
Nested ellipses in tikzpicture: Chomsky hierarchy
Are spiders unable to hurt humans, especially very small spiders?
Word to describe a time interval
One-dimensional Japanese puzzle
Mortgage adviser recommends a longer term than necessary combined with overpayments
"... to apply for a visa" or "... and applied for a visa"?
Presidential Pardon
Does Parliament hold absolute power in the UK?
Why doesn't a hydraulic lever violate conservation of energy?
Can we generate random numbers using irrational numbers like π and e?
Store Dynamic-accessible hidden metadata in a cell
My body leaves; my core can stay
Can the Right Ascension and Argument of Perigee of a spacecraft's orbit keep varying by themselves with time?
How to determine omitted units in a publication
What do I do when my TA workload is more than expected?
Circular reasoning in L'Hopital's rule
How to read αἱμύλιος or when to aspirate
What aspect of planet Earth must be changed to prevent the industrial revolution?
Huge performance difference of the command find with and without using %M option to show permissions
Define a list range inside a list
Why not take a picture of a closer black hole?
What is the relationship between converge(calculus) and converge in probability(statistic)
The 2019 Stack Overflow Developer Survey Results Are In
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)convergence in probability induced by a metricUnderstanding Uniform ContinuityWhat exactly is simple consistency?Formal Definition of Limit and ProofsDefinition of continuityAt what point is the function $f:mathbbRrightarrowmathbbR$ continuous?if $x_0$ is a limit point of $D$, then a function $f:DrightarrowmathbbR$ is continuous at $x_0$ iff $limlimits_xrightarrow x_0f(x)=f(x_0)$Understanding “For every $theta in Theta$” in the definition of the weak consistence of an estimatorRelationship between unit circle and cosine wave?Relation between the concept of Contiguity and Absolutely Continuous Measures$lim$ vs $liminf$ and $limsup$ in the proof convergence in probability implies convergence in distribution
$begingroup$
I learnt the converge definition in advanced calculus:
For any $epsilon>0$, there is a $N$, such that for all $n>N$, we have $|X_n-x|<epsilon$ then we say $X_n$ converge to $x$.
Then I learnt the consistent estimators in statistics:
For every $epsilon>0$ and every $theta in Theta$, $limlimits_ntoinftyP_theta(|W_n-theta| ge epsilon) = 0$
So my question is that is there any relationship between consistent estimators and converge sequence?
Are the two definition equivalent?
I believe the two definition must have something in common, but I can not find that.
And also , Is there any relationship between converge in distribution[$F_X_nto F_x$] and the definition of continuity in function? [$X_nto x_0, f(X_n) to f(x_0)]$
real-analysis calculus probability probability-theory statistics
$endgroup$
add a comment |
$begingroup$
I learnt the converge definition in advanced calculus:
For any $epsilon>0$, there is a $N$, such that for all $n>N$, we have $|X_n-x|<epsilon$ then we say $X_n$ converge to $x$.
Then I learnt the consistent estimators in statistics:
For every $epsilon>0$ and every $theta in Theta$, $limlimits_ntoinftyP_theta(|W_n-theta| ge epsilon) = 0$
So my question is that is there any relationship between consistent estimators and converge sequence?
Are the two definition equivalent?
I believe the two definition must have something in common, but I can not find that.
And also , Is there any relationship between converge in distribution[$F_X_nto F_x$] and the definition of continuity in function? [$X_nto x_0, f(X_n) to f(x_0)]$
real-analysis calculus probability probability-theory statistics
$endgroup$
$begingroup$
Convergence of sequences and convergence of functions (one example being estimators) work differently. Both still mean that things get closer and closer, but for numerical sequences they get closer to a single point; for functions many points get closer to other many points at the same time, and there are various ways that those points of a function can get closer and closer.
$endgroup$
– AspiringMathematician
Mar 24 at 16:31
$begingroup$
There are a about 500 (I‘m exaggerating of course) different definitions for the convergence of random variables (I really recommend you to read en.m.wikipedia.org/wiki/Convergence_of_random_variables). Currently you are talking about convergence in probability. Note that the convergence in real analysis deals with numbers, whereas the convergence terms in probability theory deal with random variables. So many of the convergence terms are quite different.
$endgroup$
– Maximilian Janisch
Mar 24 at 16:31
$begingroup$
Have a look at wikipedia. Be aware that random variables are actually functions (not just numbers).
$endgroup$
– drhab
Mar 24 at 16:33
$begingroup$
I see, so basically, the main difference is between function and the single value
$endgroup$
– MolinYue
Mar 25 at 15:30
add a comment |
$begingroup$
I learnt the converge definition in advanced calculus:
For any $epsilon>0$, there is a $N$, such that for all $n>N$, we have $|X_n-x|<epsilon$ then we say $X_n$ converge to $x$.
Then I learnt the consistent estimators in statistics:
For every $epsilon>0$ and every $theta in Theta$, $limlimits_ntoinftyP_theta(|W_n-theta| ge epsilon) = 0$
So my question is that is there any relationship between consistent estimators and converge sequence?
Are the two definition equivalent?
I believe the two definition must have something in common, but I can not find that.
And also , Is there any relationship between converge in distribution[$F_X_nto F_x$] and the definition of continuity in function? [$X_nto x_0, f(X_n) to f(x_0)]$
real-analysis calculus probability probability-theory statistics
$endgroup$
I learnt the converge definition in advanced calculus:
For any $epsilon>0$, there is a $N$, such that for all $n>N$, we have $|X_n-x|<epsilon$ then we say $X_n$ converge to $x$.
Then I learnt the consistent estimators in statistics:
For every $epsilon>0$ and every $theta in Theta$, $limlimits_ntoinftyP_theta(|W_n-theta| ge epsilon) = 0$
So my question is that is there any relationship between consistent estimators and converge sequence?
Are the two definition equivalent?
I believe the two definition must have something in common, but I can not find that.
And also , Is there any relationship between converge in distribution[$F_X_nto F_x$] and the definition of continuity in function? [$X_nto x_0, f(X_n) to f(x_0)]$
real-analysis calculus probability probability-theory statistics
real-analysis calculus probability probability-theory statistics
edited Mar 24 at 16:51
Brian
1,517416
1,517416
asked Mar 24 at 16:08
MolinYueMolinYue
31
31
$begingroup$
Convergence of sequences and convergence of functions (one example being estimators) work differently. Both still mean that things get closer and closer, but for numerical sequences they get closer to a single point; for functions many points get closer to other many points at the same time, and there are various ways that those points of a function can get closer and closer.
$endgroup$
– AspiringMathematician
Mar 24 at 16:31
$begingroup$
There are a about 500 (I‘m exaggerating of course) different definitions for the convergence of random variables (I really recommend you to read en.m.wikipedia.org/wiki/Convergence_of_random_variables). Currently you are talking about convergence in probability. Note that the convergence in real analysis deals with numbers, whereas the convergence terms in probability theory deal with random variables. So many of the convergence terms are quite different.
$endgroup$
– Maximilian Janisch
Mar 24 at 16:31
$begingroup$
Have a look at wikipedia. Be aware that random variables are actually functions (not just numbers).
$endgroup$
– drhab
Mar 24 at 16:33
$begingroup$
I see, so basically, the main difference is between function and the single value
$endgroup$
– MolinYue
Mar 25 at 15:30
add a comment |
$begingroup$
Convergence of sequences and convergence of functions (one example being estimators) work differently. Both still mean that things get closer and closer, but for numerical sequences they get closer to a single point; for functions many points get closer to other many points at the same time, and there are various ways that those points of a function can get closer and closer.
$endgroup$
– AspiringMathematician
Mar 24 at 16:31
$begingroup$
There are a about 500 (I‘m exaggerating of course) different definitions for the convergence of random variables (I really recommend you to read en.m.wikipedia.org/wiki/Convergence_of_random_variables). Currently you are talking about convergence in probability. Note that the convergence in real analysis deals with numbers, whereas the convergence terms in probability theory deal with random variables. So many of the convergence terms are quite different.
$endgroup$
– Maximilian Janisch
Mar 24 at 16:31
$begingroup$
Have a look at wikipedia. Be aware that random variables are actually functions (not just numbers).
$endgroup$
– drhab
Mar 24 at 16:33
$begingroup$
I see, so basically, the main difference is between function and the single value
$endgroup$
– MolinYue
Mar 25 at 15:30
$begingroup$
Convergence of sequences and convergence of functions (one example being estimators) work differently. Both still mean that things get closer and closer, but for numerical sequences they get closer to a single point; for functions many points get closer to other many points at the same time, and there are various ways that those points of a function can get closer and closer.
$endgroup$
– AspiringMathematician
Mar 24 at 16:31
$begingroup$
Convergence of sequences and convergence of functions (one example being estimators) work differently. Both still mean that things get closer and closer, but for numerical sequences they get closer to a single point; for functions many points get closer to other many points at the same time, and there are various ways that those points of a function can get closer and closer.
$endgroup$
– AspiringMathematician
Mar 24 at 16:31
$begingroup$
There are a about 500 (I‘m exaggerating of course) different definitions for the convergence of random variables (I really recommend you to read en.m.wikipedia.org/wiki/Convergence_of_random_variables). Currently you are talking about convergence in probability. Note that the convergence in real analysis deals with numbers, whereas the convergence terms in probability theory deal with random variables. So many of the convergence terms are quite different.
$endgroup$
– Maximilian Janisch
Mar 24 at 16:31
$begingroup$
There are a about 500 (I‘m exaggerating of course) different definitions for the convergence of random variables (I really recommend you to read en.m.wikipedia.org/wiki/Convergence_of_random_variables). Currently you are talking about convergence in probability. Note that the convergence in real analysis deals with numbers, whereas the convergence terms in probability theory deal with random variables. So many of the convergence terms are quite different.
$endgroup$
– Maximilian Janisch
Mar 24 at 16:31
$begingroup$
Have a look at wikipedia. Be aware that random variables are actually functions (not just numbers).
$endgroup$
– drhab
Mar 24 at 16:33
$begingroup$
Have a look at wikipedia. Be aware that random variables are actually functions (not just numbers).
$endgroup$
– drhab
Mar 24 at 16:33
$begingroup$
I see, so basically, the main difference is between function and the single value
$endgroup$
– MolinYue
Mar 25 at 15:30
$begingroup$
I see, so basically, the main difference is between function and the single value
$endgroup$
– MolinYue
Mar 25 at 15:30
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Perhaps this rephrasing will make the parallel more clear:
$X_nto X$ in probability $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $Eleft[fracX_n-Xright]<epsilon.$
For a proof, see convergence in probability induced by a metric.
In other words, if we define $d_P(X,Y)$ to be the funny quantity $Eleft[fracX-Yright]$, then $d_P(X_n,X)$ replaces $|X_n-X|$ in the usual definition of convergence. More generally, in any metric space with a distance function $d$, we have the following notion of convergence:
$x_nto x$ $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $d(x_n,x)<epsilon$.
Your calculus notion of convergence is the one from the metric space $mathbb R$ with distance function $d(x,y)=|x-y|$, while convergence in probability comes $d_P$.
Finally, there is a relationship between convergence and distribution and metric convergence. Let $X_n$ have cdf $F_n$, and let $X$ have cdf $F$.
$X_nto X$ in distribution $iff$ for all $x$ such that $F$ is continuous at $x$, we have $F_n(x)to F(x)$.
Also, convergence in distribution is induced by a metric in the same way convergence in probability is. In this case, the metric is
$$
d_textLevy(X,Y)=infepsilon>0:P(Xle x-epsilon)-epsilon<P(Yle x)le P(Xle x+epsilon)+epsilontext for all xin mathbb R
$$
See https://en.wikipedia.org/wiki/L%C3%A9vy_metric.
$endgroup$
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3160717%2fwhat-is-the-relationship-between-convergecalculus-and-converge-in-probability%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Perhaps this rephrasing will make the parallel more clear:
$X_nto X$ in probability $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $Eleft[fracX_n-Xright]<epsilon.$
For a proof, see convergence in probability induced by a metric.
In other words, if we define $d_P(X,Y)$ to be the funny quantity $Eleft[fracX-Yright]$, then $d_P(X_n,X)$ replaces $|X_n-X|$ in the usual definition of convergence. More generally, in any metric space with a distance function $d$, we have the following notion of convergence:
$x_nto x$ $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $d(x_n,x)<epsilon$.
Your calculus notion of convergence is the one from the metric space $mathbb R$ with distance function $d(x,y)=|x-y|$, while convergence in probability comes $d_P$.
Finally, there is a relationship between convergence and distribution and metric convergence. Let $X_n$ have cdf $F_n$, and let $X$ have cdf $F$.
$X_nto X$ in distribution $iff$ for all $x$ such that $F$ is continuous at $x$, we have $F_n(x)to F(x)$.
Also, convergence in distribution is induced by a metric in the same way convergence in probability is. In this case, the metric is
$$
d_textLevy(X,Y)=infepsilon>0:P(Xle x-epsilon)-epsilon<P(Yle x)le P(Xle x+epsilon)+epsilontext for all xin mathbb R
$$
See https://en.wikipedia.org/wiki/L%C3%A9vy_metric.
$endgroup$
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
add a comment |
$begingroup$
Perhaps this rephrasing will make the parallel more clear:
$X_nto X$ in probability $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $Eleft[fracX_n-Xright]<epsilon.$
For a proof, see convergence in probability induced by a metric.
In other words, if we define $d_P(X,Y)$ to be the funny quantity $Eleft[fracX-Yright]$, then $d_P(X_n,X)$ replaces $|X_n-X|$ in the usual definition of convergence. More generally, in any metric space with a distance function $d$, we have the following notion of convergence:
$x_nto x$ $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $d(x_n,x)<epsilon$.
Your calculus notion of convergence is the one from the metric space $mathbb R$ with distance function $d(x,y)=|x-y|$, while convergence in probability comes $d_P$.
Finally, there is a relationship between convergence and distribution and metric convergence. Let $X_n$ have cdf $F_n$, and let $X$ have cdf $F$.
$X_nto X$ in distribution $iff$ for all $x$ such that $F$ is continuous at $x$, we have $F_n(x)to F(x)$.
Also, convergence in distribution is induced by a metric in the same way convergence in probability is. In this case, the metric is
$$
d_textLevy(X,Y)=infepsilon>0:P(Xle x-epsilon)-epsilon<P(Yle x)le P(Xle x+epsilon)+epsilontext for all xin mathbb R
$$
See https://en.wikipedia.org/wiki/L%C3%A9vy_metric.
$endgroup$
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
add a comment |
$begingroup$
Perhaps this rephrasing will make the parallel more clear:
$X_nto X$ in probability $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $Eleft[fracX_n-Xright]<epsilon.$
For a proof, see convergence in probability induced by a metric.
In other words, if we define $d_P(X,Y)$ to be the funny quantity $Eleft[fracX-Yright]$, then $d_P(X_n,X)$ replaces $|X_n-X|$ in the usual definition of convergence. More generally, in any metric space with a distance function $d$, we have the following notion of convergence:
$x_nto x$ $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $d(x_n,x)<epsilon$.
Your calculus notion of convergence is the one from the metric space $mathbb R$ with distance function $d(x,y)=|x-y|$, while convergence in probability comes $d_P$.
Finally, there is a relationship between convergence and distribution and metric convergence. Let $X_n$ have cdf $F_n$, and let $X$ have cdf $F$.
$X_nto X$ in distribution $iff$ for all $x$ such that $F$ is continuous at $x$, we have $F_n(x)to F(x)$.
Also, convergence in distribution is induced by a metric in the same way convergence in probability is. In this case, the metric is
$$
d_textLevy(X,Y)=infepsilon>0:P(Xle x-epsilon)-epsilon<P(Yle x)le P(Xle x+epsilon)+epsilontext for all xin mathbb R
$$
See https://en.wikipedia.org/wiki/L%C3%A9vy_metric.
$endgroup$
Perhaps this rephrasing will make the parallel more clear:
$X_nto X$ in probability $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $Eleft[fracX_n-Xright]<epsilon.$
For a proof, see convergence in probability induced by a metric.
In other words, if we define $d_P(X,Y)$ to be the funny quantity $Eleft[fracX-Yright]$, then $d_P(X_n,X)$ replaces $|X_n-X|$ in the usual definition of convergence. More generally, in any metric space with a distance function $d$, we have the following notion of convergence:
$x_nto x$ $iff$ for any $epsilon>0$, there is an $N$ so $nge N$ implies $d(x_n,x)<epsilon$.
Your calculus notion of convergence is the one from the metric space $mathbb R$ with distance function $d(x,y)=|x-y|$, while convergence in probability comes $d_P$.
Finally, there is a relationship between convergence and distribution and metric convergence. Let $X_n$ have cdf $F_n$, and let $X$ have cdf $F$.
$X_nto X$ in distribution $iff$ for all $x$ such that $F$ is continuous at $x$, we have $F_n(x)to F(x)$.
Also, convergence in distribution is induced by a metric in the same way convergence in probability is. In this case, the metric is
$$
d_textLevy(X,Y)=infepsilon>0:P(Xle x-epsilon)-epsilon<P(Yle x)le P(Xle x+epsilon)+epsilontext for all xin mathbb R
$$
See https://en.wikipedia.org/wiki/L%C3%A9vy_metric.
answered Mar 24 at 20:09
Mike EarnestMike Earnest
27.7k22152
27.7k22152
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
add a comment |
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
$begingroup$
Thank you! it seems that I need work harder
$endgroup$
– MolinYue
Mar 27 at 19:28
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3160717%2fwhat-is-the-relationship-between-convergecalculus-and-converge-in-probability%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Convergence of sequences and convergence of functions (one example being estimators) work differently. Both still mean that things get closer and closer, but for numerical sequences they get closer to a single point; for functions many points get closer to other many points at the same time, and there are various ways that those points of a function can get closer and closer.
$endgroup$
– AspiringMathematician
Mar 24 at 16:31
$begingroup$
There are a about 500 (I‘m exaggerating of course) different definitions for the convergence of random variables (I really recommend you to read en.m.wikipedia.org/wiki/Convergence_of_random_variables). Currently you are talking about convergence in probability. Note that the convergence in real analysis deals with numbers, whereas the convergence terms in probability theory deal with random variables. So many of the convergence terms are quite different.
$endgroup$
– Maximilian Janisch
Mar 24 at 16:31
$begingroup$
Have a look at wikipedia. Be aware that random variables are actually functions (not just numbers).
$endgroup$
– drhab
Mar 24 at 16:33
$begingroup$
I see, so basically, the main difference is between function and the single value
$endgroup$
– MolinYue
Mar 25 at 15:30