Bayes' theorem is a fundamental concept in the field of probability. It allows us to update our beliefs about the likelihood of an event based on new evidence. In the context of the urn problem discussed, we're interested in reversing the conditional probability — that is, we know the color of the second ball and want to find out the probability regarding the color of the first ball drawn.
Mathematically, Bayes' theorem is expressed as:
\[\begin{equation} P(A | B) = \frac{P(B | A) \times P(A)}{P(B)}\end{equation}\]
Where:
- P(A | B) is the probability of event A occurring given that B is true.
- P(B | A) is the probability of event B given event A is true.
- P(A) is the probability of event A.
- P(B) is the total probability of event B happening.
The theorem allows us to adjust prior probability estimates,
P(A), in light of the probabilities of observed events,
P(B | A) and
P(B). In the exercise, after using Bayes' theorem we find that the probability the first ball was black given the second ball drawn is red is \[\begin{equation} \frac{b}{b + r + c}\end{equation}\], which is a classic application of Bayes' theorem in solving conditional probability problems.