Complexity/Operation count for the forward and backward substitution in the LU decomposition? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Finding determinant for characteristic polynomialDecompose symmetric matrix to scaling factorsRegularity of a matrixFinding eigenvalues of a block matrixHow to compute determinant (or eigenvalues) of this matrix?Is it true that solving a triangular system using forward or backward substitution numerically stable?Showing a set of matrices is a subspaceDeterminant of $N times N$ matrix$PA = LU$ descomposition. Prove that $max_1leq i,jleq n|u_i,j| leq 2max_1leq i,jleq n|a_i,j|$How many flops do we need to find the inverse of $n*n$ matrix A using Cholesky factorization and forward and backward substitution.

When to stop saving and start investing?

How discoverable are IPv6 addresses and AAAA names by potential attackers?

When is phishing education going too far?

What's the purpose of writing one's academic bio in 3rd person?

What LEGO pieces have "real-world" functionality?

What causes the vertical darker bands in my photo?

How does cp -a work

Letter Boxed validator

What are the pros and cons of Aerospike nosecones?

How do I keep my slimes from escaping their pens?

Why does Python start at index 1 when iterating an array backwards?

Should I call the interviewer directly, if HR aren't responding?

Is it true that "carbohydrates are of no use for the basal metabolic need"?

Is the address of a local variable a constexpr?

Sorting numerically

If a contract sometimes uses the wrong name, is it still valid?

Should gear shift center itself while in neutral?

Why is "Consequences inflicted." not a sentence?

Doubts about chords

Are my PIs rude or am I just being too sensitive?

Why is "Captain Marvel" translated as male in Portugal?

Does surprise arrest existing movement?

Does accepting a pardon have any bearing on trying that person for the same crime in a sovereign jurisdiction?

Bonus calculation: Am I making a mountain out of a molehill?



Complexity/Operation count for the forward and backward substitution in the LU decomposition?



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)Finding determinant for characteristic polynomialDecompose symmetric matrix to scaling factorsRegularity of a matrixFinding eigenvalues of a block matrixHow to compute determinant (or eigenvalues) of this matrix?Is it true that solving a triangular system using forward or backward substitution numerically stable?Showing a set of matrices is a subspaceDeterminant of $N times N$ matrix$PA = LU$ descomposition. Prove that $max_1leq i,jleq n|u_i,j| leq 2max_1leq i,jleq n|a_i,j|$How many flops do we need to find the inverse of $n*n$ matrix A using Cholesky factorization and forward and backward substitution.










2












$begingroup$


If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



I understand a forward substitution is then required where one first solves:



$$Ly=b$$ for $y$.



And then we solve:
$$Ux=y$$ for $x$.



I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



I can see that for the backward substitution, for example, the system is represented as:



$$beginbmatrix
u_11 & u_12 & cdots & u_1n \
0 & u_22 &cdots &u_2n \
cdots& cdots & ddots &vdots \
0 & 0 & cdots & u_nn
endbmatrix beginbmatrix
x_1\
x_2\
vdots \
x_n
endbmatrix = beginbmatrix
y_1\
y_2\
vdots \
y_n
endbmatrix$$



From which:



$$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



From an equation like this, how can one identify the approximate operation count?










share|cite|improve this question











$endgroup$
















    2












    $begingroup$


    If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



    I understand a forward substitution is then required where one first solves:



    $$Ly=b$$ for $y$.



    And then we solve:
    $$Ux=y$$ for $x$.



    I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



    I can see that for the backward substitution, for example, the system is represented as:



    $$beginbmatrix
    u_11 & u_12 & cdots & u_1n \
    0 & u_22 &cdots &u_2n \
    cdots& cdots & ddots &vdots \
    0 & 0 & cdots & u_nn
    endbmatrix beginbmatrix
    x_1\
    x_2\
    vdots \
    x_n
    endbmatrix = beginbmatrix
    y_1\
    y_2\
    vdots \
    y_n
    endbmatrix$$



    From which:



    $$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



    From an equation like this, how can one identify the approximate operation count?










    share|cite|improve this question











    $endgroup$














      2












      2








      2


      1



      $begingroup$


      If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



      I understand a forward substitution is then required where one first solves:



      $$Ly=b$$ for $y$.



      And then we solve:
      $$Ux=y$$ for $x$.



      I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



      I can see that for the backward substitution, for example, the system is represented as:



      $$beginbmatrix
      u_11 & u_12 & cdots & u_1n \
      0 & u_22 &cdots &u_2n \
      cdots& cdots & ddots &vdots \
      0 & 0 & cdots & u_nn
      endbmatrix beginbmatrix
      x_1\
      x_2\
      vdots \
      x_n
      endbmatrix = beginbmatrix
      y_1\
      y_2\
      vdots \
      y_n
      endbmatrix$$



      From which:



      $$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



      From an equation like this, how can one identify the approximate operation count?










      share|cite|improve this question











      $endgroup$




      If I have a linear system of equations $Ax=b$ where $A in mathbbR ^ntimes n, x in mathbbR ^n, b in mathbbR ^n $ this system can be solved for $x$ via an LU decomposition: $$A = LU$$ where $U in mathbbR ^ntimes n$ is upper triangular and $L in mathbbR ^ntimes n$ is lower triangular.



      I understand a forward substitution is then required where one first solves:



      $$Ly=b$$ for $y$.



      And then we solve:
      $$Ux=y$$ for $x$.



      I am currently trying to determine the operation count or the FLOPS for each of the forward substitution and backward substitution. I have seen that the correct value is approximately given by $mathcalO(n^2)$ flops but I am unsure how one can arrive at this value.



      I can see that for the backward substitution, for example, the system is represented as:



      $$beginbmatrix
      u_11 & u_12 & cdots & u_1n \
      0 & u_22 &cdots &u_2n \
      cdots& cdots & ddots &vdots \
      0 & 0 & cdots & u_nn
      endbmatrix beginbmatrix
      x_1\
      x_2\
      vdots \
      x_n
      endbmatrix = beginbmatrix
      y_1\
      y_2\
      vdots \
      y_n
      endbmatrix$$



      From which:



      $$x_i = frac1u_ii left ( y_i - sum_j=i+1^nu_ijx_j right ); i = n, ..., 1$$



      From an equation like this, how can one identify the approximate operation count?







      linear-algebra computational-complexity lu-decomposition






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited Apr 10 '17 at 14:29







      silver96

















      asked Apr 10 '17 at 14:01









      silver96silver96

      345




      345




















          1 Answer
          1






          active

          oldest

          votes


















          3












          $begingroup$

          If your matrix is $ntimes n$ you have the following operations




          1. $n$ divisions,


          2. $fracn^2-n2$ sums,


          3. $fracn^2-n2$ multiplications.

          The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
          $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



          The total number of operations is $2n^2-n=mathcalO(n^2)$



          I hope it solves your doubts






          share|cite|improve this answer









          $endgroup$













            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "69"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            noCode: true, onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2227719%2fcomplexity-operation-count-for-the-forward-and-backward-substitution-in-the-lu-d%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            3












            $begingroup$

            If your matrix is $ntimes n$ you have the following operations




            1. $n$ divisions,


            2. $fracn^2-n2$ sums,


            3. $fracn^2-n2$ multiplications.

            The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
            $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



            The total number of operations is $2n^2-n=mathcalO(n^2)$



            I hope it solves your doubts






            share|cite|improve this answer









            $endgroup$

















              3












              $begingroup$

              If your matrix is $ntimes n$ you have the following operations




              1. $n$ divisions,


              2. $fracn^2-n2$ sums,


              3. $fracn^2-n2$ multiplications.

              The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
              $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



              The total number of operations is $2n^2-n=mathcalO(n^2)$



              I hope it solves your doubts






              share|cite|improve this answer









              $endgroup$















                3












                3








                3





                $begingroup$

                If your matrix is $ntimes n$ you have the following operations




                1. $n$ divisions,


                2. $fracn^2-n2$ sums,


                3. $fracn^2-n2$ multiplications.

                The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
                $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



                The total number of operations is $2n^2-n=mathcalO(n^2)$



                I hope it solves your doubts






                share|cite|improve this answer









                $endgroup$



                If your matrix is $ntimes n$ you have the following operations




                1. $n$ divisions,


                2. $fracn^2-n2$ sums,


                3. $fracn^2-n2$ multiplications.

                The number of divisions is clear because you have $n$ rows. The number of sums and multiplications are
                $sum_i=1^n-1n^2=fracn^2-n2$. It comes from $sum_j=1+1^nu_ijx_j$.



                The total number of operations is $2n^2-n=mathcalO(n^2)$



                I hope it solves your doubts







                share|cite|improve this answer












                share|cite|improve this answer



                share|cite|improve this answer










                answered Oct 14 '18 at 18:40









                user194811user194811

                313




                313



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Mathematics Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2227719%2fcomplexity-operation-count-for-the-forward-and-backward-substitution-in-the-lu-d%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Solar Wings Breeze Design and development Specifications (Breeze) References Navigation menu1368-485X"Hang glider: Breeze (Solar Wings)"e

                    Kathakali Contents Etymology and nomenclature History Repertoire Songs and musical instruments Traditional plays Styles: Sampradayam Training centers and awards Relationship to other dance forms See also Notes References External links Navigation menueThe Illustrated Encyclopedia of Hinduism: A-MSouth Asian Folklore: An EncyclopediaRoutledge International Encyclopedia of Women: Global Women's Issues and KnowledgeKathakali Dance-drama: Where Gods and Demons Come to PlayKathakali Dance-drama: Where Gods and Demons Come to PlayKathakali Dance-drama: Where Gods and Demons Come to Play10.1353/atj.2005.0004The Illustrated Encyclopedia of Hinduism: A-MEncyclopedia of HinduismKathakali Dance-drama: Where Gods and Demons Come to PlaySonic Liturgy: Ritual and Music in Hindu Tradition"The Mirror of Gesture"Kathakali Dance-drama: Where Gods and Demons Come to Play"Kathakali"Indian Theatre: Traditions of PerformanceIndian Theatre: Traditions of PerformanceIndian Theatre: Traditions of PerformanceIndian Theatre: Traditions of PerformanceMedieval Indian Literature: An AnthologyThe Oxford Companion to Indian TheatreSouth Asian Folklore: An Encyclopedia : Afghanistan, Bangladesh, India, Nepal, Pakistan, Sri LankaThe Rise of Performance Studies: Rethinking Richard Schechner's Broad SpectrumIndian Theatre: Traditions of PerformanceModern Asian Theatre and Performance 1900-2000Critical Theory and PerformanceBetween Theater and AnthropologyKathakali603847011Indian Theatre: Traditions of PerformanceIndian Theatre: Traditions of PerformanceIndian Theatre: Traditions of PerformanceBetween Theater and AnthropologyBetween Theater and AnthropologyNambeesan Smaraka AwardsArchivedThe Cambridge Guide to TheatreRoutledge International Encyclopedia of Women: Global Women's Issues and KnowledgeThe Garland Encyclopedia of World Music: South Asia : the Indian subcontinentThe Ethos of Noh: Actors and Their Art10.2307/1145740By Means of Performance: Intercultural Studies of Theatre and Ritual10.1017/s204912550000100xReconceiving the Renaissance: A Critical ReaderPerformance TheoryListening to Theatre: The Aural Dimension of Beijing Opera10.2307/1146013Kathakali: The Art of the Non-WorldlyOn KathakaliKathakali, the dance theatreThe Kathakali Complex: Performance & StructureKathakali Dance-Drama: Where Gods and Demons Come to Play10.1093/obo/9780195399318-0071Drama and Ritual of Early Hinduism"In the Shadow of Hollywood Orientalism: Authentic East Indian Dancing"10.1080/08949460490274013Sanskrit Play Production in Ancient IndiaIndian Music: History and StructureBharata, the Nāṭyaśāstra233639306Table of Contents2238067286469807Dance In Indian Painting10.2307/32047833204783Kathakali Dance-Theatre: A Visual Narrative of Sacred Indian MimeIndian Classical Dance: The Renaissance and BeyondKathakali: an indigenous art-form of Keralaeee

                    Method to test if a number is a perfect power? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)Detecting perfect squares faster than by extracting square rooteffective way to get the integer sequence A181392 from oeisA rarely mentioned fact about perfect powersHow many numbers such $n$ are there that $n<100,lfloorsqrtn rfloor mid n$Check perfect squareness by modulo division against multiple basesFor what pair of integers $(a,b)$ is $3^a + 7^b$ a perfect square.Do there exist any positive integers $n$ such that $lfloore^nrfloor$ is a perfect power? What is the probability that one exists?finding perfect power factors of an integerProve that the sequence contains a perfect square for any natural number $m $ in the domain of $f$ .Counting Perfect Powers