Complexity/Operation count for the forward and backward substitution in the LU decomposition? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Finding determinant for characteristic polynomialDecompose symmetric matrix to scaling factorsRegularity of a matrixFinding eigenvalues of a block matrixHow to compute determinant (or eigenvalues) of this matrix?Is it true that solving a triangular system using forward or backward substitution numerically stable?Showing a set of matrices is a subspaceDeterminant of $N times N$ matrix$PA = LU$ descomposition. Prove that $max_1leq i,jleq n|u_i,j| leq 2max_1leq i,jleq n|a_i,j|$How many flops do we need to find the inverse of $n*n$ matrix A using Cholesky factorization and forward and backward substitution.

When to stop saving and start investing?

How discoverable are IPv6 addresses and AAAA names by potential attackers?

When is phishing education going too far?

What's the purpose of writing one's academic bio in 3rd person?

What LEGO pieces have "real-world" functionality?

What causes the vertical darker bands in my photo?

How does cp -a work

Letter Boxed validator

What are the pros and cons of Aerospike nosecones?

How do I keep my slimes from escaping their pens?

Why does Python start at index 1 when iterating an array backwards?

Should I call the interviewer directly, if HR aren't responding?

Is it true that "carbohydrates are of no use for the basal metabolic need"?

Is the address of a local variable a constexpr?

Sorting numerically

If a contract sometimes uses the wrong name, is it still valid?

Should gear shift center itself while in neutral?

Why is "Consequences inflicted." not a sentence?

Doubts about chords

Are my PIs rude or am I just being too sensitive?

Why is "Captain Marvel" translated as male in Portugal?

Does surprise arrest existing movement?

Does accepting a pardon have any bearing on trying that person for the same crime in a sovereign jurisdiction?

Bonus calculation: Am I making a mountain out of a molehill?



Complexity/Operation count for the forward and backward substitution in the LU decomposition?



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Finding determinant for characteristic polynomialDecompose symmetric matrix to scaling factorsRegularity of a matrixFinding eigenvalues of a block matrixHow to compute determinant (or eigenvalues) of this matrix?Is it true that solving a triangular system using forward or backward substitution numerically stable?Showing a set of matrices is a subspaceDeterminant of $N times N$ matrix$PA = LU$ descomposition. Prove that $max_1leq i,jleq n|u_i,j| leq 2max_1leq i,jleq n|a_i,j|$How many flops do we need to find the inverse of $n*n$ matrix A using Cholesky factorization and forward and backward substitution.










2












$begingroup$


If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



I understand a forward substitution is then required where one first solves:



$$Ly=b$$ for $y$.



And then we solve:
$$Ux=y$$ for $x$.



I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



I can see that for the backward substitution, for example, the system is represented as:



$$beginbmatrix
u_11 & u_12 & cdots & u_1n \
0 & u_22 &cdots &u_2n \
cdots& cdots & ddots &vdots \
0 & 0 & cdots & u_nn
endbmatrix beginbmatrix
x_1\
x_2\
vdots \
x_n
endbmatrix = beginbmatrix
y_1\
y_2\
vdots \
y_n
endbmatrix$$



From which:



$$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



From an equation like this, how can one identify the approximate operation count?










share|cite|improve this question











$endgroup$
















    2












    $begingroup$


    If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



    I understand a forward substitution is then required where one first solves:



    $$Ly=b$$ for $y$.



    And then we solve:
    $$Ux=y$$ for $x$.



    I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



    I can see that for the backward substitution, for example, the system is represented as:



    $$beginbmatrix
    u_11 & u_12 & cdots & u_1n \
    0 & u_22 &cdots &u_2n \
    cdots& cdots & ddots &vdots \
    0 & 0 & cdots & u_nn
    endbmatrix beginbmatrix
    x_1\
    x_2\
    vdots \
    x_n
    endbmatrix = beginbmatrix
    y_1\
    y_2\
    vdots \
    y_n
    endbmatrix$$



    From which:



    $$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



    From an equation like this, how can one identify the approximate operation count?










    share|cite|improve this question











    $endgroup$














      2












      2








      2


      1



      $begingroup$


      If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



      I understand a forward substitution is then required where one first solves:



      $$Ly=b$$ for $y$.



      And then we solve:
      $$Ux=y$$ for $x$.



      I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



      I can see that for the backward substitution, for example, the system is represented as:



      $$beginbmatrix
      u_11 & u_12 & cdots & u_1n \
      0 & u_22 &cdots &u_2n \
      cdots& cdots & ddots &vdots \
      0 & 0 & cdots & u_nn
      endbmatrix beginbmatrix
      x_1\
      x_2\
      vdots \
      x_n
      endbmatrix = beginbmatrix
      y_1\
      y_2\
      vdots \
      y_n
      endbmatrix$$



      From which:



      $$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



      From an equation like this, how can one identify the approximate operation count?










      share|cite|improve this question











      $endgroup$




      If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



      I understand a forward substitution is then required where one first solves:



      $$Ly=b$$ for $y$.



      And then we solve:
      $$Ux=y$$ for $x$.



      I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



      I can see that for the backward substitution, for example, the system is represented as:



      $$beginbmatrix
      u_11 & u_12 & cdots & u_1n \
      0 & u_22 &cdots &u_2n \
      cdots& cdots & ddots &vdots \
      0 & 0 & cdots & u_nn
      endbmatrix beginbmatrix
      x_1\
      x_2\
      vdots \
      x_n
      endbmatrix = beginbmatrix
      y_1\
      y_2\
      vdots \
      y_n
      endbmatrix$$



      From which:



      $$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



      From an equation like this, how can one identify the approximate operation count?







      linear-algebra computational-complexity lu-decomposition






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited Apr 10 '17 at 14:29







      silver96

















      asked Apr 10 '17 at 14:01









      silver96silver96

      345




      345




















          1 Answer
          1






          active

          oldest

          votes


















          3












          $begingroup$

          If your matrix is $ntimes n$ you have the following operations




          1. $n$ divisions,


          2. $fracn^2-n2$ sums,


          3. $fracn^2-n2$ multiplications.

          The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
          $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



          The total number of operations is $2n^2-n=mathcalO(n^2)$



          I hope it solves your doubts






          share|cite|improve this answer









          $endgroup$













            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "69"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            noCode: true, onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2227719%2fcomplexity-operation-count-for-the-forward-and-backward-substitution-in-the-lu-d%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            3












            $begingroup$

            If your matrix is $ntimes n$ you have the following operations




            1. $n$ divisions,


            2. $fracn^2-n2$ sums,


            3. $fracn^2-n2$ multiplications.

            The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
            $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



            The total number of operations is $2n^2-n=mathcalO(n^2)$



            I hope it solves your doubts






            share|cite|improve this answer









            $endgroup$

















              3












              $begingroup$

              If your matrix is $ntimes n$ you have the following operations




              1. $n$ divisions,


              2. $fracn^2-n2$ sums,


              3. $fracn^2-n2$ multiplications.

              The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
              $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



              The total number of operations is $2n^2-n=mathcalO(n^2)$



              I hope it solves your doubts






              share|cite|improve this answer









              $endgroup$















                3












                3








                3





                $begingroup$

                If your matrix is $ntimes n$ you have the following operations




                1. $n$ divisions,


                2. $fracn^2-n2$ sums,


                3. $fracn^2-n2$ multiplications.

                The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
                $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



                The total number of operations is $2n^2-n=mathcalO(n^2)$



                I hope it solves your doubts






                share|cite|improve this answer









                $endgroup$



                If your matrix is $ntimes n$ you have the following operations




                1. $n$ divisions,


                2. $fracn^2-n2$ sums,


                3. $fracn^2-n2$ multiplications.

                The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
                $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



                The total number of operations is $2n^2-n=mathcalO(n^2)$



                I hope it solves your doubts







                share|cite|improve this answer












                share|cite|improve this answer



                share|cite|improve this answer










                answered Oct 14 '18 at 18:40









                user194811user194811

                313




                313



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Mathematics Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2227719%2fcomplexity-operation-count-for-the-forward-and-backward-substitution-in-the-lu-d%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Lowndes Grove History Architecture References Navigation menu32°48′6″N 79°57′58″W / 32.80167°N 79.96611°W / 32.80167; -79.9661132°48′6″N 79°57′58″W / 32.80167°N 79.96611°W / 32.80167; -79.9661178002500"National Register Information System"Historic houses of South Carolina"Lowndes Grove""+32° 48' 6.00", −79° 57' 58.00""Lowndes Grove, Charleston County (260 St. Margaret St., Charleston)""Lowndes Grove"The Charleston ExpositionIt Happened in South Carolina"Lowndes Grove (House), Saint Margaret Street & Sixth Avenue, Charleston, Charleston County, SC(Photographs)"Plantations of the Carolina Low Countrye

                    random experiment with two different functions on unit interval Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)Random variable and probability space notionsRandom Walk with EdgesFinding functions where the increase over a random interval is Poisson distributedNumber of days until dayCan an observed event in fact be of zero probability?Unit random processmodels of coins and uniform distributionHow to get the number of successes given $n$ trials , probability $P$ and a random variable $X$Absorbing Markov chain in a computer. Is “almost every” turned into always convergence in computer executions?Stopped random walk is not uniformly integrable

                    How should I support this large drywall patch? Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?How do I cover large gaps in drywall?How do I keep drywall around a patch from crumbling?Can I glue a second layer of drywall?How to patch long strip on drywall?Large drywall patch: how to avoid bulging seams?Drywall Mesh Patch vs. Bulge? To remove or not to remove?How to fix this drywall job?Prep drywall before backsplashWhat's the best way to fix this horrible drywall patch job?Drywall patching using 3M Patch Plus Primer