Given two side matrices $P$ and $Q$, extract (find) the diagonal scaling matrix $Sigma$ of a singular value decomposition The 2019 Stack Overflow Developer Survey Results Are InSingular Value Decomposition for zero-diagonal symmetric matrixDecomposing a stochastic matrix into a product of stochastic matricesDiagonal and anti-diagonal integral matrices: a special decompositionSingular Value Decomposition and Square matricesSingular Value Decomposition of Commuting MatricesSingular value decomposition of a matrix multiplicationIs it possible to compute derivative of truncated SVD without computing a full SVD?Unique decomposition of a positive definite matrix into a sum of outer products $bf x_kbf x_k^rm T$ and a diagonal matrix?Singular Value Decomposition for Rectangular MatricesSingular value decomposition of Block Diagonal matrix.

Shouldn't "much" here be used instead of "more"?

Geography at the pixel level

Can you compress metal and what would be the consequences?

Is "plugging out" electronic devices an American expression?

A poker game description that does not feel gimmicky

Why is the maximum length of OpenWrt’s root password 8 characters?

What is the meaning of the verb "bear" in this context?

Lightning Grid - Columns and Rows?

Is this app Icon Browser Safe/Legit?

How can I autofill dates in Excel excluding Sunday?

Why can Shazam fly?

What is the motivation for a law requiring 2 parties to consent for recording a conversation

Delete all lines which don't have n characters before delimiter

How to save as into a customized destination on macOS?

Which Sci-Fi work first showed weapon of galactic-scale mass destruction?

Protecting Dualbooting Windows from dangerous code (like rm -rf)

Time travel alters history but people keep saying nothing's changed

Have you ever entered Singapore using a different passport or name?

Apparent duplicates between Haynes service instructions and MOT

When should I buy a clipper card after flying to OAK?

Did 3000BC Egyptians use meteoric iron weapons?

Does a dangling wire really electrocute me if I'm standing in water?

How to notate time signature switching consistently every measure

For what reasons would an animal species NOT cross a *horizontal* land bridge?



Given two side matrices $P$ and $Q$, extract (find) the diagonal scaling matrix $Sigma$ of a singular value decomposition



The 2019 Stack Overflow Developer Survey Results Are InSingular Value Decomposition for zero-diagonal symmetric matrixDecomposing a stochastic matrix into a product of stochastic matricesDiagonal and anti-diagonal integral matrices: a special decompositionSingular Value Decomposition and Square matricesSingular Value Decomposition of Commuting MatricesSingular value decomposition of a matrix multiplicationIs it possible to compute derivative of truncated SVD without computing a full SVD?Unique decomposition of a positive definite matrix into a sum of outer products $bf x_kbf x_k^rm T$ and a diagonal matrix?Singular Value Decomposition for Rectangular MatricesSingular value decomposition of Block Diagonal matrix.










0












$begingroup$


I have an application where I have already approximated a given matrix $R$ of size $m times n$ by multiplying two matrices $P$ and $Q^mathrm T$: $hat R=PQ^mathrm T$. $P$ is size $m times k$ and $Q$ is size $n times k$ and $Q^mathrm T$ is size $k times n$. I desire now to use these two matrices to efficiently as possible find a proper singular value decomposition, which has three matrices as you know.



What gives me great hope is that Simon Funk said here that "The end result, it's worth noting, is exactly an SVD if the training set perfectly covers the matrix. Call it what you will when it doesn't. [If you're wondering where the diagonal scaling matrix is, it gets arbitrarily rolled in to the two side matrices, but could be trivially extracted if needed.]"



Can someone describe and detail the trivial extraction process he talked about which I can use to find that third matrix $Sigma$ in the famous SVD equation $hat R = U Sigma V^mathrm T$?



Never mind FunkSVD, as I am not using that algorithm currently, but I do have a pretty well-estimated pair of matrices $P$ and $Q$ as my starting point. I used a gradient descent and machine learning to get $P$ and $Q$ already.



I am required to NOT run SVD from scratch -- instead I must do something very efficient to "trivially extract" the sigma matrix, when given "two side matrices", which dear Mr. Funk said is possible.



Thanks for contributions if any!










share|cite|improve this question











$endgroup$
















    0












    $begingroup$


    I have an application where I have already approximated a given matrix $R$ of size $m times n$ by multiplying two matrices $P$ and $Q^mathrm T$: $hat R=PQ^mathrm T$. $P$ is size $m times k$ and $Q$ is size $n times k$ and $Q^mathrm T$ is size $k times n$. I desire now to use these two matrices to efficiently as possible find a proper singular value decomposition, which has three matrices as you know.



    What gives me great hope is that Simon Funk said here that "The end result, it's worth noting, is exactly an SVD if the training set perfectly covers the matrix. Call it what you will when it doesn't. [If you're wondering where the diagonal scaling matrix is, it gets arbitrarily rolled in to the two side matrices, but could be trivially extracted if needed.]"



    Can someone describe and detail the trivial extraction process he talked about which I can use to find that third matrix $Sigma$ in the famous SVD equation $hat R = U Sigma V^mathrm T$?



    Never mind FunkSVD, as I am not using that algorithm currently, but I do have a pretty well-estimated pair of matrices $P$ and $Q$ as my starting point. I used a gradient descent and machine learning to get $P$ and $Q$ already.



    I am required to NOT run SVD from scratch -- instead I must do something very efficient to "trivially extract" the sigma matrix, when given "two side matrices", which dear Mr. Funk said is possible.



    Thanks for contributions if any!










    share|cite|improve this question











    $endgroup$














      0












      0








      0





      $begingroup$


      I have an application where I have already approximated a given matrix $R$ of size $m times n$ by multiplying two matrices $P$ and $Q^mathrm T$: $hat R=PQ^mathrm T$. $P$ is size $m times k$ and $Q$ is size $n times k$ and $Q^mathrm T$ is size $k times n$. I desire now to use these two matrices to efficiently as possible find a proper singular value decomposition, which has three matrices as you know.



      What gives me great hope is that Simon Funk said here that "The end result, it's worth noting, is exactly an SVD if the training set perfectly covers the matrix. Call it what you will when it doesn't. [If you're wondering where the diagonal scaling matrix is, it gets arbitrarily rolled in to the two side matrices, but could be trivially extracted if needed.]"



      Can someone describe and detail the trivial extraction process he talked about which I can use to find that third matrix $Sigma$ in the famous SVD equation $hat R = U Sigma V^mathrm T$?



      Never mind FunkSVD, as I am not using that algorithm currently, but I do have a pretty well-estimated pair of matrices $P$ and $Q$ as my starting point. I used a gradient descent and machine learning to get $P$ and $Q$ already.



      I am required to NOT run SVD from scratch -- instead I must do something very efficient to "trivially extract" the sigma matrix, when given "two side matrices", which dear Mr. Funk said is possible.



      Thanks for contributions if any!










      share|cite|improve this question











      $endgroup$




      I have an application where I have already approximated a given matrix $R$ of size $m times n$ by multiplying two matrices $P$ and $Q^mathrm T$: $hat R=PQ^mathrm T$. $P$ is size $m times k$ and $Q$ is size $n times k$ and $Q^mathrm T$ is size $k times n$. I desire now to use these two matrices to efficiently as possible find a proper singular value decomposition, which has three matrices as you know.



      What gives me great hope is that Simon Funk said here that "The end result, it's worth noting, is exactly an SVD if the training set perfectly covers the matrix. Call it what you will when it doesn't. [If you're wondering where the diagonal scaling matrix is, it gets arbitrarily rolled in to the two side matrices, but could be trivially extracted if needed.]"



      Can someone describe and detail the trivial extraction process he talked about which I can use to find that third matrix $Sigma$ in the famous SVD equation $hat R = U Sigma V^mathrm T$?



      Never mind FunkSVD, as I am not using that algorithm currently, but I do have a pretty well-estimated pair of matrices $P$ and $Q$ as my starting point. I used a gradient descent and machine learning to get $P$ and $Q$ already.



      I am required to NOT run SVD from scratch -- instead I must do something very efficient to "trivially extract" the sigma matrix, when given "two side matrices", which dear Mr. Funk said is possible.



      Thanks for contributions if any!







      matrix-decomposition






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited Mar 23 at 17:26









      Rócherz

      3,0263823




      3,0263823










      asked Aug 2 '18 at 19:30









      Geoffrey AndersonGeoffrey Anderson

      1012




      1012




















          0






          active

          oldest

          votes












          Your Answer





          StackExchange.ifUsing("editor", function ()
          return StackExchange.using("mathjaxEditing", function ()
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          );
          );
          , "mathjax-editing");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "69"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2870425%2fgiven-two-side-matrices-p-and-q-extract-find-the-diagonal-scaling-matrix%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Mathematics Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2870425%2fgiven-two-side-matrices-p-and-q-extract-find-the-diagonal-scaling-matrix%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Lowndes Grove History Architecture References Navigation menu32°48′6″N 79°57′58″W / 32.80167°N 79.96611°W / 32.80167; -79.9661132°48′6″N 79°57′58″W / 32.80167°N 79.96611°W / 32.80167; -79.9661178002500"National Register Information System"Historic houses of South Carolina"Lowndes Grove""+32° 48' 6.00", −79° 57' 58.00""Lowndes Grove, Charleston County (260 St. Margaret St., Charleston)""Lowndes Grove"The Charleston ExpositionIt Happened in South Carolina"Lowndes Grove (House), Saint Margaret Street & Sixth Avenue, Charleston, Charleston County, SC(Photographs)"Plantations of the Carolina Low Countrye

          random experiment with two different functions on unit interval Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)Random variable and probability space notionsRandom Walk with EdgesFinding functions where the increase over a random interval is Poisson distributedNumber of days until dayCan an observed event in fact be of zero probability?Unit random processmodels of coins and uniform distributionHow to get the number of successes given $n$ trials , probability $P$ and a random variable $X$Absorbing Markov chain in a computer. Is “almost every” turned into always convergence in computer executions?Stopped random walk is not uniformly integrable

          How should I support this large drywall patch? Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?How do I cover large gaps in drywall?How do I keep drywall around a patch from crumbling?Can I glue a second layer of drywall?How to patch long strip on drywall?Large drywall patch: how to avoid bulging seams?Drywall Mesh Patch vs. Bulge? To remove or not to remove?How to fix this drywall job?Prep drywall before backsplashWhat's the best way to fix this horrible drywall patch job?Drywall patching using 3M Patch Plus Primer