Fdtxjr

I am looking at the negative binomial distribution for the case where $p$ corresponds to "success probability" and $r$ is the integer number of "failures". In this case we have $$E(X)=fracrp1−p$$ $$textVar(X)=fracrp(1−p)^2$$

I thought it might be derived from the geometric distribution but the geometric distribution is derived from the negative binomial distribution, and not the other way round?

Please explain and a source that I can use would also be great for this.

You look at a sequence of independent Bernoulli trials $B_i$ where $B_isim Bernoulli(1-p)$. So $B_i=1$ denotes success and $B_i=0$ denotes failure.

Let $N$ be the number of successes needed to get the first failure. So if $N=k$, ($kgeq0$) then you have $k$ successes before you get the first failure at $(k+1)$-th trial. In other words, if $N=k$ then you get to observe $(B_1=1,B_2=1,...,B_k=1,B_k+1=0)$. Then $Nsim Geometric(p)$.

Now let $N_r$ be the number of Bernoulli successes you observe before getting the $r$-th failure. Then you can see that you have to observe a random number of successes before getting the first failure, then a random number of successes before getting the second failure, and so on, till a random number of successes before getting the $r$-th failure. Each such random number of successes has $Geometric(p)$ distribution. So $N_r$ is the sum of $r$ many $Geometric(p)$ random variables. This $N_r$ has the $Negative$ $Binomial$ distribution.

So it is the other way round: the Geometric distribution gives rise to the Negative Binomial distribution.

Expectation of the Negative Binomial distribution is just the sum of expectations of $r$ many Geometric($p$) random variables. Each has expectation $dfracp1-p$, so our Negative Binomial has expectation $dfracrp1-p$.

Since the Geometric random variables are independent, variance of Negative Binomial is sum of variances of $r$ many Geometric($p$) random variables. A $Geometric(p)$ r.v. has variance $dfracp(1-p)^2$, so our Negative Binomial has variance $dfracrp(1-p)^2$.

The (0 based) geometric distribution is that of the count of failures before the first success in an indefinite sequence of independent Bernoulli trials with identical success rate.

A negative binomial distribution is that of the count of successes before a specified number of failures occurs in an indefinite sequence of independent Bernoulli trials with identical success rate.

These definitions are clearly inter related.   You can derive one from the other, or both together from first principles.

It all depends on what seed you have been given.

Let $X_i$ be a geometric random variable with success rate, $1-p$.   Then by applying the above definition it is apparent that $X_i$ has a negative binomial distribution the count of 'successes' before 1 'failure', with 'failure' rate $1-p$.

$$X_isimmathcal Geo_0(1-p) iff X_i~sim~mathcalNegBin(1, p)$$

So if you are given the probability mass function, expectation, and variance, for a general negative binomial, you can immediately find the probability mass function, expectation, and variance for a geometric random variable.

Let $Y_r$ be a negative binomial random variable with success rate, $p$, and specified number of successes $r$.   Then $Y_r$ is the sum of $r$ independent geometric distributions with identical success rate $1-p$.   (Can you see why?)

$$Y_rsimmathcalNegBin(r, p)~iff~ Y_r=sum_i=1^r X_i~wedge~ bigl(X_ibigr)_i=1^roversetrm iidsimmathcalGeo_0(1-p)$$

So if you have been given the pmf for a geometric distribution, you can obtain the general pmf, expectation, and variance, of a negative binomial distribution, with just a little work.

So if you start with $mathsf E(X_1)=p(1-p)^-1, mathsf Var(X_1)=p(1-p)^-2$ because, $X_1simmathcalGeo_0(1-p)$ then...

$$beginalignmathsf E(Y_r) ~&=~ sum_i=1^rmathsf E(X_i) \[1ex] &=~ rmathsf E(X_1) \[1ex] ~&=~ rp(1-p)^-1\[2ex]mathsf Var(Y_r) ~&=~ sum_i=1^rmathsf Var(X_i)+2sum_1leq i<jleq rmathsfCov(X_i,X_j)\[1ex] &=~ rmathsfVar(X_1) \[1ex] &=~ rp(1-p)^-2endalign$$