Filtration in Markov Chains and stopping times Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)Stopping times of Markov chainsMarkov chains and natural filtrationTime homogeneous Markov chain with random timesA question about the “stopping time with respect to a set” of a Markov chainContinuous time Markov Chain's Natural FiltrationGiven a list L of N elements uniformly sampled from a set A, what is the probability that L contains every element of A?Interchanging limit and expectation for irreducible Markov chainsIrreducible Markov Chain has finite stopping-time to a finite setDetermining whether the following are Markov ChainsStrong Markov property and time-homogeneity
How do living politicians protect their readily obtainable signatures from misuse?
Do I really need to have a message in a novel to appeal to readers?
What's the meaning of "fortified infraction restraint"?
Is it possible for SQL statements to execute concurrently within a single session in SQL Server?
How often does castling occur in grandmaster games?
What is the font for "b" letter?
Time to Settle Down!
Maximum summed subsequences with non-adjacent items
How to tell that you are a giant?
Can the Great Weapon Master feat's "Power Attack" apply to attacks from the Spiritual Weapon spell?
Is there a kind of relay only consumes power when switching?
Hangman Game with C++
Sum letters are not two different
How does light 'choose' between wave and particle behaviour?
Can a new player join a group only when a new campaign starts?
Is CEO the "profession" with the most psychopaths?
How to write the following sign?
Is grep documentation about ignoring case wrong, since it doesn't ignore case in filenames?
Chinese Seal on silk painting - what does it mean?
Most bit efficient text communication method?
How do I use the new nonlinear finite element in Mathematica 12 for this equation?
As a beginner, should I get a Squier Strat with a SSS config or a HSS?
An adverb for when you're not exaggerating
What initially awakened the Balrog?
Filtration in Markov Chains and stopping times
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)Stopping times of Markov chainsMarkov chains and natural filtrationTime homogeneous Markov chain with random timesA question about the “stopping time with respect to a set” of a Markov chainContinuous time Markov Chain's Natural FiltrationGiven a list L of N elements uniformly sampled from a set A, what is the probability that L contains every element of A?Interchanging limit and expectation for irreducible Markov chainsIrreducible Markov Chain has finite stopping-time to a finite setDetermining whether the following are Markov ChainsStrong Markov property and time-homogeneity
$begingroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
$endgroup$
add a comment |
$begingroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
$endgroup$
add a comment |
$begingroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
$endgroup$
I am trying to get a better understand of filtrations, and I can't seem to find any simple, concrete examples, so I will try to make one here.
Consider a discrete-time Markov chain with states $A,B$ that we run for 3 time steps. Is the following a correct representation of the corresponding filtration?
$$mathcalF_0 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_1 = emptyset, AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_2 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
$$mathcalF_3 = emptyset, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,
AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB,AAA,AAB,ABA,ABB, BAA,BAB,BBA,BBB, AAA,AAB,ABA,ABB,BAA,BAB,BBA,BBB$$
If this is correct, what are some "stopping times" in this example? Suppose $tau_A$ is the first time at which the chain is in state $A$. Then for $tau_A$ to be a stopping time we must have $tau_A=t in mathcalF_t$ for $t=0,1,2,3$? What is the event $tau_A=t$ in the above filtration?
probability markov-chains filtrations
probability markov-chains filtrations
asked Mar 27 at 15:50
theQmantheQman
45538
45538
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3164679%2ffiltration-in-markov-chains-and-stopping-times%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
add a comment |
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
add a comment |
$begingroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
$endgroup$
This is correct.
The event $tau_A=1$ is exactly $AAA,AAB,ABA,ABBinmathcal F_1$. Indeed, this event means that the first step leads to $A$.
The event $tau_A=2$ is exactly $BAA,BABinmathcal F_2$. This event occures when the chain is at $B$ after the first step, and then at $A$ after the second step.
Try to find the event $tau_A=3$ in $mathcal F_3$.
answered Mar 27 at 16:37
NChNCh
7,1403825
7,1403825
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3164679%2ffiltration-in-markov-chains-and-stopping-times%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown