## 3.4 Independence

In general, the conditional probability of event \(A\) given some other event \(B\) is usually different from the unconditional probability of \(A\). That is, in general \(\textrm{P}(A | B) \neq \textrm{P}(A)\). Knowledge of the occurrence of event \(B\) typically influences the probability of event \(A\), and vice versa. If so, we say that events \(A\) and \(B\) are *dependent*.

However, in some situations knowledge of the occurrence of one event does not influence the probability of another. For example, if a coin is flipped twice then knowing that the first flip landed on Heads does not change the probability that the second flips lands on Heads. In these situations we say the events are independent.

### 3.4.1 Independence of events

**Example 2.65 **Consider the following hypothetical data.

Republican (\(D^c\)) | Democrat (\(D\)) | Total | |
---|---|---|---|

Loves puppies (\(L\)) | 180 | 270 | 450 |

Does not love puppies (\(L^c\)) | 20 | 30 | 50 |

Total | 200 | 300 | 500 |

Suppose a person is randomly selected from this group. Consider the events \[\begin{align*} L & = \{\text{person loves puppies}\}\\ D & = \{\text{person is a Democrat}\} \end{align*}\]

- Compute and interpret \(\textrm{P}(L)\).
- Compute and interpret \(\textrm{P}(L|D)\).
- Compute and interpret \(\textrm{P}(L|D^c)\).
- What do you notice about \(\textrm{P}(L)\), \(\textrm{P}(L|D)\), and \(\textrm{P}(L|D^c)\)?
- Compute and interpret \(\textrm{P}(D)\).
- Compute and interpret \(\textrm{P}(D|L)\).
- Compute and interpret \(\textrm{P}(D|L^c)\).
- What do you notice about \(\textrm{P}(D)\), \(\textrm{P}(D|L)\), and \(\textrm{P}(D|L^c)\)?
- Compute and interpret \(\textrm{P}(D \cap L)\).
- What is the relationship between \(\textrm{P}(D \cap L\)) and \(\textrm{P}(D)\) and \(\textrm{P}(L)\)?
- When randomly selecting a person from this particular group, would you say that events \(D\) and \(L\) are independent? Why?

*Solution*to Example 2.65

- The probability that the randomly selected person loves puppies is \(\textrm{P}(L)=450/500=0.9\).
- The conditional probability that the randomly selected person loves puppies given that the person is a Democrat is \(\textrm{P}(L|D)=270/300=0.9\).
- The conditional probability that the randomly selected person loves puppies given that the person is not a Democrat is \(\textrm{P}(L|D^2)=180/200=0.9\).
- $(L)=(L|D)=(L|D^c)=0.9. Regardless of whether or not the person is a Democrat the probability that they love puppies is 0.9.
- The probability that the randomly selected person is a Democrat is \(\textrm{P}(D)=300/500=0.6\).
- The conditional probability that the randomly selected person is a Democrat given that the person loves puppies is \(\textrm{P}(D|L)=270/450=0.6\).
- The conditional probability that the randomly selected person is a Democrat given that the person does not love puppies is \(\textrm{P}(D|L^c)=30/50=0.6\).
- $(D)=(D|L)=(D|L^c)=0.6. Regardless of whether or not the person loves puppies the probability that the person is a Democrat is 0.6.
- The probability that the random selected person is a Deomcrat and loves puppies is \(\textrm{P}(D \cap L)=270/500=0.54\).
- \(\textrm{P}(D \cap L) = 0.54 = (0.6)(0.9)=\textrm{P}(D)\textrm{P}(L)\). The joint probability is a product of the marginal probabilities.
- Yes, the events \(D\) and \(L\) are independent. Knowing that whether or not the person is a Democrat does not change the probability that the person loves puppies, and vice versa.

As in the example,events \(A\) and \(B\) are independent if the knowing whether or not one occurs does not change the probability of the other.

**Definition 2.19 **
Two events \(A\) and \(B\) defined on a probability space with probability measure \(\textrm{P}\) are independent if \(\textrm{P}(A\cap B) = \textrm{P}(A)\textrm{P}(B)\). That is, two events are independent if their joint probability is the product of their marginal probabilities.

**Theorem 2.5 **For events \(A\) and \(B\) with \(0<\textrm{P}(A)<1\) and \(0<\textrm{P}(B)<1\), the following are equivalent. That is, if one is true then they all are true; if one is false, then they all are false.

\[\begin{align*} \text{$A$ and $B$} & \text{ are independent}\\ \textrm{P}(A \cap B) & = \textrm{P}(A)\textrm{P}(B)\\ \textrm{P}(A^c \cap B) & = \textrm{P}(A^c)\textrm{P}(B)\\ \textrm{P}(A \cap B^c) & = \textrm{P}(A)\textrm{P}(B^c)\\ \textrm{P}(A^c \cap B^c) & = \textrm{P}(A^c)\textrm{P}(B^c)\\ \textrm{P}(A|B) & = \textrm{P}(A)\\ \textrm{P}(A|B) & = \textrm{P}(A|B^c)\\ \textrm{P}(B|A) & = \textrm{P}(B)\\ \textrm{P}(B|A) & = \textrm{P}(B|A^c)\\ \end{align*}\]