Conditional Probability vs Probability

Both terms below come up in the same part of the course, and students mix them up. Here is each one defined on its own, side by side, so you can see where they part company.

Conditional probability

Probability

Conditional probability is the chance one event happens when you count only the cases where a second event holds, so that event is the denominator.

Conditional probability shrinks the sample space. P(AB)P(A \mid B), read the probability of A given B, is defined as P(AB)P(B)\frac{P(A \cap B)}{P(B)} whenever P(B)>0P(B) > 0: the outcomes where both happen, divided by the outcomes where the condition holds. The event after the bar is the denominator. Nothing in that definition requires BB to happen first in time, only that you are counting inside it.

Take 1,000 drivers followed for a year. 200 texted at the wheel and 800 did not; 40 of the texting drivers had an accident and 10 of the others did.

AccidentNo accidentTotal
Texting40160200
Not texting10790800
Total509501000

Both conditional probabilities are built from the same 40. P(textingaccident)=40/50=0.80P(\text{texting} \mid \text{accident}) = 40/50 = 0.80, while P(accidenttexting)=40/200=0.20P(\text{accident} \mid \text{texting}) = 40/200 = 0.20. Same numerator, different denominator, a factor of four apart.

Here is the sentence readers actually get wrong: 80 percent of accidents involved a texting driver, so texting gives you an 80 percent chance of crashing. The first clause is P(textingaccident)P(\text{texting} \mid \text{accident}) and the second is P(accidenttexting)P(\text{accident} \mid \text{texting}), which is 0.20. Flipping the bar is not a rephrasing, it is a different quantity, and news copy makes that swap constantly.

As long as both events can occur together, the two directions agree only when the events are equally likely, since dividing the definitions gives P(AB)P(BA)=P(A)P(B)\frac{P(A \mid B)}{P(B \mid A)} = \frac{P(A)}{P(B)}. Here that ratio is 0.05/0.20=0.250.05/0.20 = 0.25, matching 0.20/0.800.20/0.80. So the gap is widest exactly where it does the most damage: a rare outcome conditioned on a common behavior, or the reverse. Topic 2.6 is where the course takes this up.

Full entry for conditional probability

Probability

Probability

Probability is a number between 0 and 1 that measures how likely an event is: an impossible event has probability 0 and a certain event has probability 1.

Every probability is a number in the interval from 0 to 1, and the probabilities of all the outcomes in the sample space add to exactly 1. P(A)P(A), read "the probability of A", is the long-run relative frequency of the event AA: the share of trials on which AA happens, once the number of trials is large. When every outcome is equally likely you can reach that number by counting, dividing the outcomes in AA by the total, but counting is a special case rather than the definition.

Draw a single digit at random from 0 through 9, each with probability 0.1. Let AA be "the digit is 0, 1, or 2". Then P(A)=3/10=0.30P(A) = 3/10 = 0.30.

"A probability of 0.30 means three out of every ten." Read ten digits from a random digit table and the chance that exactly three of them fall in AA is 0.2668, so that reading is wrong about 73 percent of the time, and roughly 2.8 percent of ten-digit runs contain none from AA at all. A probability is a rate the results approach over a long run, not a quota each block of ten has to fill. What the long run does and does not promise is the content of the law of large numbers.

Two boundaries are worth naming. Counting outcomes gives the right answer only when the outcomes really are equally likely, which rules out a loaded die or a thumbtack. And probability 0 does not always mean impossible: for a continuous random variable every single exact value has probability 0, yet the variable still lands somewhere.

Probability is introduced in topic 2.4, Introduction to Probability, after simulation has already given you an empirical version of the same quantity.

Full entry for probability

Where each one fits in the course