Complexity/Operation count for the forward and backward substitution in the LU decomposition? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Finding determinant for characteristic polynomialDecompose symmetric matrix to scaling factorsRegularity of a matrixFinding eigenvalues of a block matrixHow to compute determinant (or eigenvalues) of this matrix?Is it true that solving a triangular system using forward or backward substitution numerically stable?Showing a set of matrices is a subspaceDeterminant of $N times N$ matrix$PA = LU$ descomposition. Prove that $max_1leq i,jleq n|u_i,j| leq 2max_1leq i,jleq n|a_i,j|$How many flops do we need to find the inverse of $n*n$ matrix A using Cholesky factorization and forward and backward substitution.
When to stop saving and start investing?
How discoverable are IPv6 addresses and AAAA names by potential attackers?
When is phishing education going too far?
What's the purpose of writing one's academic bio in 3rd person?
What LEGO pieces have "real-world" functionality?
What causes the vertical darker bands in my photo?
How does cp -a work
Letter Boxed validator
What are the pros and cons of Aerospike nosecones?
How do I keep my slimes from escaping their pens?
Why does Python start at index 1 when iterating an array backwards?
Should I call the interviewer directly, if HR aren't responding?
Is it true that "carbohydrates are of no use for the basal metabolic need"?
Is the address of a local variable a constexpr?
Sorting numerically
If a contract sometimes uses the wrong name, is it still valid?
Should gear shift center itself while in neutral?
Why is "Consequences inflicted." not a sentence?
Doubts about chords
Are my PIs rude or am I just being too sensitive?
Why is "Captain Marvel" translated as male in Portugal?
Does surprise arrest existing movement?
Does accepting a pardon have any bearing on trying that person for the same crime in a sovereign jurisdiction?
Bonus calculation: Am I making a mountain out of a molehill?
Complexity/Operation count for the forward and backward substitution in the LU decomposition?
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Finding determinant for characteristic polynomialDecompose symmetric matrix to scaling factorsRegularity of a matrixFinding eigenvalues of a block matrixHow to compute determinant (or eigenvalues) of this matrix?Is it true that solving a triangular system using forward or backward substitution numerically stable?Showing a set of matrices is a subspaceDeterminant of $N times N$ matrix$PA = LU$ descomposition. Prove that $max_1leq i,jleq n|u_i,j| leq 2max_1leq i,jleq n|a_i,j|$How many flops do we need to find the inverse of $n*n$ matrix A using Cholesky factorization and forward and backward substitution.
$begingroup$
If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.
I understand a forward substitution is then required where one first solves:
$$Ly=b$$ for $y$.
And then we solve:
$$Ux=y$$ for $x$.
I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.
I can see that for the backward substitution, for example, the system is represented as:
$$beginbmatrix
u_11 & u_12 & cdots & u_1n \
0 & u_22 &cdots &u_2n \
cdots& cdots & ddots &vdots \
0 & 0 & cdots & u_nn
endbmatrix beginbmatrix
x_1\
x_2\
vdots \
x_n
endbmatrix = beginbmatrix
y_1\
y_2\
vdots \
y_n
endbmatrix$$
From which:
$$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$
From an equation like this, how can one identify the approximate operation count?
linear-algebra computational-complexity lu-decomposition
$endgroup$
add a comment |
$begingroup$
If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.
I understand a forward substitution is then required where one first solves:
$$Ly=b$$ for $y$.
And then we solve:
$$Ux=y$$ for $x$.
I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.
I can see that for the backward substitution, for example, the system is represented as:
$$beginbmatrix
u_11 & u_12 & cdots & u_1n \
0 & u_22 &cdots &u_2n \
cdots& cdots & ddots &vdots \
0 & 0 & cdots & u_nn
endbmatrix beginbmatrix
x_1\
x_2\
vdots \
x_n
endbmatrix = beginbmatrix
y_1\
y_2\
vdots \
y_n
endbmatrix$$
From which:
$$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$
From an equation like this, how can one identify the approximate operation count?
linear-algebra computational-complexity lu-decomposition
$endgroup$
add a comment |
$begingroup$
If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.
I understand a forward substitution is then required where one first solves:
$$Ly=b$$ for $y$.
And then we solve:
$$Ux=y$$ for $x$.
I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.
I can see that for the backward substitution, for example, the system is represented as:
$$beginbmatrix
u_11 & u_12 & cdots & u_1n \
0 & u_22 &cdots &u_2n \
cdots& cdots & ddots &vdots \
0 & 0 & cdots & u_nn
endbmatrix beginbmatrix
x_1\
x_2\
vdots \
x_n
endbmatrix = beginbmatrix
y_1\
y_2\
vdots \
y_n
endbmatrix$$
From which:
$$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$
From an equation like this, how can one identify the approximate operation count?
linear-algebra computational-complexity lu-decomposition
$endgroup$
If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.
I understand a forward substitution is then required where one first solves:
$$Ly=b$$ for $y$.
And then we solve:
$$Ux=y$$ for $x$.
I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.
I can see that for the backward substitution, for example, the system is represented as:
$$beginbmatrix
u_11 & u_12 & cdots & u_1n \
0 & u_22 &cdots &u_2n \
cdots& cdots & ddots &vdots \
0 & 0 & cdots & u_nn
endbmatrix beginbmatrix
x_1\
x_2\
vdots \
x_n
endbmatrix = beginbmatrix
y_1\
y_2\
vdots \
y_n
endbmatrix$$
From which:
$$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$
From an equation like this, how can one identify the approximate operation count?
linear-algebra computational-complexity lu-decomposition
linear-algebra computational-complexity lu-decomposition
edited Apr 10 '17 at 14:29
silver96
asked Apr 10 '17 at 14:01
silver96silver96
345
345
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
If your matrix is $ntimes n$ you have the following operations
$n$ divisions,
$fracn^2-n2$ sums,
$fracn^2-n2$ multiplications.
The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
$sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.
The total number of operations is $2n^2-n=mathcalO(n^2)$
I hope it solves your doubts
$endgroup$
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2227719%2fcomplexity-operation-count-for-the-forward-and-backward-substitution-in-the-lu-d%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
If your matrix is $ntimes n$ you have the following operations
$n$ divisions,
$fracn^2-n2$ sums,
$fracn^2-n2$ multiplications.
The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
$sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.
The total number of operations is $2n^2-n=mathcalO(n^2)$
I hope it solves your doubts
$endgroup$
add a comment |
$begingroup$
If your matrix is $ntimes n$ you have the following operations
$n$ divisions,
$fracn^2-n2$ sums,
$fracn^2-n2$ multiplications.
The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
$sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.
The total number of operations is $2n^2-n=mathcalO(n^2)$
I hope it solves your doubts
$endgroup$
add a comment |
$begingroup$
If your matrix is $ntimes n$ you have the following operations
$n$ divisions,
$fracn^2-n2$ sums,
$fracn^2-n2$ multiplications.
The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
$sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.
The total number of operations is $2n^2-n=mathcalO(n^2)$
I hope it solves your doubts
$endgroup$
If your matrix is $ntimes n$ you have the following operations
$n$ divisions,
$fracn^2-n2$ sums,
$fracn^2-n2$ multiplications.
The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
$sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.
The total number of operations is $2n^2-n=mathcalO(n^2)$
I hope it solves your doubts
answered Oct 14 '18 at 18:40
user194811user194811
313
313
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2227719%2fcomplexity-operation-count-for-the-forward-and-backward-substitution-in-the-lu-d%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown