Probability before and after PCA projectionCombine n Normal distribution Probability Sets in a limited float rangeProbability of drawing an Ace: before and afterBefore and after training running timesorhogonal projectionProbability After Sampling Without Replacement Until SuccessConditional Sample from Gaussian CopulaGeometric Probability: P(Bob comes before 1:30 and Alice comes after Bob)Expected Value where probability changes after successAverage of conditional probabilities and co-occuranceProbability of rolling first 3 with a fair die before 10th roll and after 4th roll.

Official degrees of earth’s rotation per day

How to explain that I do not want to visit a country due to personal safety concern?

What has been your most complicated TikZ drawing?

Rules about breaking the rules. How do I do it well?

Why doesn't the EU now just force the UK to choose between referendum and no-deal?

Why did it take so long to abandon sail after steamships were demonstrated?

How to simplify this time periods definition interface?

Employee lack of ownership

How could a female member of a species produce eggs unto death?

Is it normal that my co-workers at a fitness company criticize my food choices?

Who is our nearest planetary neighbor, on average?

How to write cleanly even if my character uses expletive language?

Brexit - No Deal Rejection

Why does Deadpool say "You're welcome, Canada," after shooting Ryan Reynolds in the end credits?

Will a pinhole camera work with instant film?

Is it true that real estate prices mainly go up?

Meaning of "SEVERA INDEOVI VAS" from 3rd Century slab

Good allowance savings plan?

Current sense amp + op-amp buffer + ADC: Measuring down to 0 with single supply

Why would a flight no longer considered airworthy be redirected like this?

PTIJ: Who should pay for Uber rides: the child or the parent?

Make a transparent 448*448 image

Rejected in 4th interview round citing insufficient years of experience

How to deal with taxi scam when on vacation?



Probability before and after PCA projection


Combine n Normal distribution Probability Sets in a limited float rangeProbability of drawing an Ace: before and afterBefore and after training running timesorhogonal projectionProbability After Sampling Without Replacement Until SuccessConditional Sample from Gaussian CopulaGeometric Probability: P(Bob comes before 1:30 and Alice comes after Bob)Expected Value where probability changes after successAverage of conditional probabilities and co-occuranceProbability of rolling first 3 with a fair die before 10th roll and after 4th roll.













0












$begingroup$


If there is a set of points generated from a multivariate normal distribution with mean and covariance matrix:



mean=[1, 2]; covariance=[5, -2; -2, 3];


Data in original space



And is thereafter projected into PCA-space using the eigenvectors of the covariance:



PCA_cov=[-5.3, 0.93; 3.28, 1.5]; data_proj=PCA_cov^(-1)*data;


Projection into PCA space



The projected data now have mean and covariance:



mean_PC=[0.034, 1.26]; sigma=[0.4, 0.75];


Why does a projected point from the original- to PCA-space not exhibit the same probability?



It is the red squares in the previous images that have been used to calculate the graph below.



Calculated probability of data and projection



In the multivariate case it is calculated with SciPy.stats.multivariate_normal package, should therefore be correct.
In the projected space it is again calculate with SciPy, not multivariate. The probability in both axis is then multiplied together.



I guess the question can be summarized as: Why is the probability of a point and its projection not the same?



Thanks in advance!










share|cite|improve this question







New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$











  • $begingroup$
    My question is as read at the end: Why is the probability of a point and its projection not the same? It is not projected to a lower dimension just rotated and scaled into the orthogonal eigenspace
    $endgroup$
    – Michael
    2 days ago
















0












$begingroup$


If there is a set of points generated from a multivariate normal distribution with mean and covariance matrix:



mean=[1, 2]; covariance=[5, -2; -2, 3];


Data in original space



And is thereafter projected into PCA-space using the eigenvectors of the covariance:



PCA_cov=[-5.3, 0.93; 3.28, 1.5]; data_proj=PCA_cov^(-1)*data;


Projection into PCA space



The projected data now have mean and covariance:



mean_PC=[0.034, 1.26]; sigma=[0.4, 0.75];


Why does a projected point from the original- to PCA-space not exhibit the same probability?



It is the red squares in the previous images that have been used to calculate the graph below.



Calculated probability of data and projection



In the multivariate case it is calculated with SciPy.stats.multivariate_normal package, should therefore be correct.
In the projected space it is again calculate with SciPy, not multivariate. The probability in both axis is then multiplied together.



I guess the question can be summarized as: Why is the probability of a point and its projection not the same?



Thanks in advance!










share|cite|improve this question







New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$











  • $begingroup$
    My question is as read at the end: Why is the probability of a point and its projection not the same? It is not projected to a lower dimension just rotated and scaled into the orthogonal eigenspace
    $endgroup$
    – Michael
    2 days ago














0












0








0





$begingroup$


If there is a set of points generated from a multivariate normal distribution with mean and covariance matrix:



mean=[1, 2]; covariance=[5, -2; -2, 3];


Data in original space



And is thereafter projected into PCA-space using the eigenvectors of the covariance:



PCA_cov=[-5.3, 0.93; 3.28, 1.5]; data_proj=PCA_cov^(-1)*data;


Projection into PCA space



The projected data now have mean and covariance:



mean_PC=[0.034, 1.26]; sigma=[0.4, 0.75];


Why does a projected point from the original- to PCA-space not exhibit the same probability?



It is the red squares in the previous images that have been used to calculate the graph below.



Calculated probability of data and projection



In the multivariate case it is calculated with SciPy.stats.multivariate_normal package, should therefore be correct.
In the projected space it is again calculate with SciPy, not multivariate. The probability in both axis is then multiplied together.



I guess the question can be summarized as: Why is the probability of a point and its projection not the same?



Thanks in advance!










share|cite|improve this question







New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$




If there is a set of points generated from a multivariate normal distribution with mean and covariance matrix:



mean=[1, 2]; covariance=[5, -2; -2, 3];


Data in original space



And is thereafter projected into PCA-space using the eigenvectors of the covariance:



PCA_cov=[-5.3, 0.93; 3.28, 1.5]; data_proj=PCA_cov^(-1)*data;


Projection into PCA space



The projected data now have mean and covariance:



mean_PC=[0.034, 1.26]; sigma=[0.4, 0.75];


Why does a projected point from the original- to PCA-space not exhibit the same probability?



It is the red squares in the previous images that have been used to calculate the graph below.



Calculated probability of data and projection



In the multivariate case it is calculated with SciPy.stats.multivariate_normal package, should therefore be correct.
In the projected space it is again calculate with SciPy, not multivariate. The probability in both axis is then multiplied together.



I guess the question can be summarized as: Why is the probability of a point and its projection not the same?



Thanks in advance!







probability probability-distributions projective-space






share|cite|improve this question







New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|cite|improve this question







New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|cite|improve this question




share|cite|improve this question






New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked Mar 11 at 10:33









MichaelMichael

11




11




New contributor




Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






Michael is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











  • $begingroup$
    My question is as read at the end: Why is the probability of a point and its projection not the same? It is not projected to a lower dimension just rotated and scaled into the orthogonal eigenspace
    $endgroup$
    – Michael
    2 days ago

















  • $begingroup$
    My question is as read at the end: Why is the probability of a point and its projection not the same? It is not projected to a lower dimension just rotated and scaled into the orthogonal eigenspace
    $endgroup$
    – Michael
    2 days ago
















$begingroup$
My question is as read at the end: Why is the probability of a point and its projection not the same? It is not projected to a lower dimension just rotated and scaled into the orthogonal eigenspace
$endgroup$
– Michael
2 days ago





$begingroup$
My question is as read at the end: Why is the probability of a point and its projection not the same? It is not projected to a lower dimension just rotated and scaled into the orthogonal eigenspace
$endgroup$
– Michael
2 days ago











0






active

oldest

votes











Your Answer





StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "69"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);






Michael is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3143536%2fprobability-before-and-after-pca-projection%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes








Michael is a new contributor. Be nice, and check out our Code of Conduct.









draft saved

draft discarded


















Michael is a new contributor. Be nice, and check out our Code of Conduct.












Michael is a new contributor. Be nice, and check out our Code of Conduct.











Michael is a new contributor. Be nice, and check out our Code of Conduct.














Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3143536%2fprobability-before-and-after-pca-projection%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

Lowndes Grove History Architecture References Navigation menu32°48′6″N 79°57′58″W / 32.80167°N 79.96611°W / 32.80167; -79.9661132°48′6″N 79°57′58″W / 32.80167°N 79.96611°W / 32.80167; -79.9661178002500"National Register Information System"Historic houses of South Carolina"Lowndes Grove""+32° 48' 6.00", −79° 57' 58.00""Lowndes Grove, Charleston County (260 St. Margaret St., Charleston)""Lowndes Grove"The Charleston ExpositionIt Happened in South Carolina"Lowndes Grove (House), Saint Margaret Street & Sixth Avenue, Charleston, Charleston County, SC(Photographs)"Plantations of the Carolina Low Countrye

random experiment with two different functions on unit interval Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)Random variable and probability space notionsRandom Walk with EdgesFinding functions where the increase over a random interval is Poisson distributedNumber of days until dayCan an observed event in fact be of zero probability?Unit random processmodels of coins and uniform distributionHow to get the number of successes given $n$ trials , probability $P$ and a random variable $X$Absorbing Markov chain in a computer. Is “almost every” turned into always convergence in computer executions?Stopped random walk is not uniformly integrable

How should I support this large drywall patch? Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?How do I cover large gaps in drywall?How do I keep drywall around a patch from crumbling?Can I glue a second layer of drywall?How to patch long strip on drywall?Large drywall patch: how to avoid bulging seams?Drywall Mesh Patch vs. Bulge? To remove or not to remove?How to fix this drywall job?Prep drywall before backsplashWhat's the best way to fix this horrible drywall patch job?Drywall patching using 3M Patch Plus Primer