Chapter 6 of 8

Discrete Probability Distributions

Bernoulli trials and Binomial distribution

An experiment often involves repeated trials, each resulting in one of two possible outcomes, commonly labeled as success or failure. A typical example is testing items on an assembly line, where each item is classified as either defective or nondefective. Either outcome can be defined as a success, depending on the context. This type of experiment is known as a Bernoulli process, and each individual trial is referred to as a Bernoulli trial.

It is important to note that for a sequence of trials to qualify as Bernoulli trials, the probability of success must remain constant from one trial to the next.

For instance, consider tossing a fair coin multiple times. The probability of getting a head (which we define as success) is: \[ P(\text{Head}) = \frac{1}{2} \] This probability remains the same for each toss, satisfying the condition for Bernoulli trials.

However, if we consider drawing balls from a bag without replacement, the probability changes with each draw. For example, suppose a bag contains 3 red balls and 2 blue balls. The probability of drawing a red ball on the first draw is: \[ P(\text{Red on first draw}) = \frac{3}{5} \] If a red ball is drawn and not replaced, the probability of drawing another red ball on the second draw becomes: \[ P(\text{Red on second draw}) = \frac{2}{4} = \frac{1}{2} \] Since the probability changes from one trial to the next, this process does not meet the criteria for a Bernoulli process.

Properties of a Bernoulli Process

A Bernoulli process must satisfy the following conditions:

  1. The experiment consists of repeated trials.

  2. Each trial results in an outcome that may be classified as a success or a failure.

  3. The probability of success, denoted by \( p \), remains constant from trial to trial.

  4. The repeated trials are independent.

Binomial Distribution

A Bernoulli trial results in:

  • Success with probability \( p \)

  • Failure with probability \( q = 1 - p \)

The probability distribution of the Binomial random variable \( X \), representing the number of successes in \( n \) independent trials, is given by:

\[ b(x; n, p) = \binom{n}{x} p^x (1 - p)^{n - x}, \quad \text{for } x = 0, 1, 2, \ldots, n \]

Mean and Variance of Binomial Distribution

The mean and variance of the binomial distribution \( b(x; n, p) \) are given by: \[ \mu = np \quad \text{and} \quad \sigma^2 = npq \] where \( q = 1 - p \).

Tips to Identify Binomial Distribution Problems

A probability distribution problem is likely a Binomial Distribution if the following conditions (and keywords) are present:

  1. Fixed number of trials ($n$): Look for phrases like:

    • “out of 10 attempts”, “for 20 customers”, “tested 5 items”

  2. Each trial has two possible outcomes (Success/Failure): Keywords may include:

    • “defective/non-defective”, “pass/fail”, “survive/die”, “hit/miss”

  3. Constant probability of success ($p$) in each trial: Phrases like:

    • “with probability 0.3”, “each has a 60% chance”

  4. Independent trials: Often stated or implied as:

    • “each trial is independent”, “randomly chosen”

  5. Questions asking “exactly $x$ successes”, “at least $x$ successes”, or “between $a$ and $b$ successes” often indicate binomial distribution.

Hint: If you're counting the number of times something happens in a fixed number of identical and independent trials with a fixed success probability, you're likely dealing with a binomial distribution.

Example 1: Tossing a Fair Coin

A fair coin is tossed 5 times. What is the probability of getting exactly 3 heads? Also compute the mean and variance of the distribution.

Solution:
Here, \( n = 5, p = 0.5, q = 0.5 \)
Let \( X \) be the number of heads. Then, \[ P(X = 3) = \binom{5}{3} (0.5)^3 (0.5)^2 = 10 \times 0.125 \times 0.25 = 0.3125 \] Mean: \( \mu = np = 5 \times 0.5 = 2.5 \)
Variance: \( \sigma^2 = npq = 5 \times 0.5 \times 0.5 = 1.25 \)

Example 2: Defective Bulbs

A machine produces bulbs with a 10% defect rate. If 8 bulbs are chosen at random, what is the probability that exactly 2 are defective? Also find the mean and variance.

Solution:
Here, \( n = 8, p = 0.1, q = 0.9 \) \[ P(X = 2) = \binom{8}{2} (0.1)^2 (0.9)^6 = 28 \times 0.01 \times 0.531441 = 0.1488 \] Mean: \( \mu = np = 8 \times 0.1 = 0.8 \)
Variance: \( \sigma^2 = npq = 8 \times 0.1 \times 0.9 = 0.72 \)

Example 3: Multiple Choice Test

A student guesses on a multiple choice question with 4 options. If there are 10 questions, what is the probability of getting exactly 4 correct answers by guessing?

Solution:
Here, \( n = 10, p = \frac{1}{4} = 0.25, q = 0.75 \) \[ P(X = 4) = \binom{10}{4} (0.25)^4 (0.75)^6 = 210 \times 0.00390625 \times 0.1779785 \approx 0.146 \] Mean: \( \mu = np = 10 \times 0.25 = 2.5 \)
Variance: \( \sigma^2 = npq = 10 \times 0.25 \times 0.75 = 1.875 \)

Example 4: Pass Rate in Exam

The probability of a student passing an exam is 0.6. If 7 students appear for the exam, find the probability that exactly 5 pass. Also calculate mean and variance.

Solution:
Here, \( n = 7, p = 0.6, q = 0.4 \) \[ P(X = 5) = \binom{7}{5} (0.6)^5 (0.4)^2 = 21 \times 0.07776 \times 0.16 = 0.2613 \] Mean: \( \mu = np = 7 \times 0.6 = 4.2 \)
Variance: \( \sigma^2 = npq = 7 \times 0.6 \times 0.4 = 1.68 \)

Example 5: Product Quality Check

In a quality control check, the probability that an item is of good quality is 0.85. If 12 items are tested, find the probability that exactly 10 are of good quality. Also find the mean and variance.

Solution:
Here, \( n = 12, p = 0.85, q = 0.15 \) \[ P(X = 10) = \binom{12}{10} (0.85)^{10} (0.15)^2 = 66 \times 0.19687 \times 0.0225 \approx 0.292 \] Mean: \( \mu = np = 12 \times 0.85 = 10.2 \)
Variance: \( \sigma^2 = npq = 12 \times 0.85 \times 0.15 = 1.53 \)

Example 6

The probability that a student passes a final exam is $0.6$. If $12$ students take the exam, what is the probability that

  1. [(a)] at least $8$ pass,

  2. [(b)] between $4$ and $9$ pass, and

  3. [(c)] exactly $6$ pass?

Solution:
Let $X$ be the number of students who pass. Then $X$ follows a binomial distribution with parameters $n = 12$, $p = 0.6$.

(a) Probability that at least 8 pass: \[ P(X \geq 8) = 1 - P(X \leq 7) = 1 - \sum_{x=0}^{7} b(x; 12, 0.6) \] Using cumulative binomial values: \[ P(X \geq 8) = 1 - 0.7831 = \boxed{0.2169} \]

(b) Probability that between 4 and 9 pass: \[ P(4 \leq X \leq 9) = \sum_{x=4}^{9} b(x; 12, 0.6) = \sum_{x=0}^{9} b(x; 12, 0.6) - \sum_{x=0}^{3} b(x; 12, 0.6) \] \[ P(4 \leq X \leq 9) = 0.9450 - 0.0635 = \boxed{0.8815} \]

(c) Probability that exactly 6 pass: \[ P(X = 6) = b(6; 12, 0.6) = \sum_{x=0}^{6} b(x; 12, 0.6) - \sum_{x=0}^{5} b(x; 12, 0.6) \] \[ P(X = 6) = 0.6100 - 0.4070 = \boxed{0.2030} \]

Poisson Distribution

Experiments that result in numerical values of a random variable \( X \), which counts the number of occurrences during a specific time interval or within a designated region, are referred to as Poisson experiments. The time interval can be of any duration — for instance, a minute, hour, day, week, month, or even a year.

Examples:

  • \( X \): Number of phone calls received per hour in an office.

  • Number of school closures due to snow in a winter season.

  • Number of baseball games postponed due to rain over a season.

The region could also be spatial:

  • Number of field mice per acre.

  • Number of bacteria in a culture.

  • Number of typing errors per page.

Such problems are modeled using a Poisson process, and the experiment satisfies the following properties:

Properties of the Poisson Process

  1. Independence Across Disjoint Intervals or Regions:
    The number of events occurring in one time interval or region is independent of those in any non-overlapping interval or region. The process has no memory.

  2. Proportionality:
    The probability of a single event occurring in a very small time interval or tiny region is:

    • Proportional to the length/size of the interval or region.

    • Independent of events outside that interval or region.

  3. Negligible Multiple Events in Small Intervals:
    The probability that more than one event occurs in a very short interval or small region is negligible.

Poisson Random Variable and Distribution

The random variable \( X \), representing the number of outcomes in the given interval or region, is called a Poisson random variable. The associated probability distribution is known as the Poisson distribution.

Poisson Distribution

The probability distribution of a Poisson random variable \( X \), representing the number of outcomes occurring in a given time interval or specified region of size \( t \), is given by:

\[ P(X = x; \lambda t) = \frac{e^{-\lambda t}(\lambda t)^x}{x!}, \quad x = 0, 1, 2, \ldots \]

Where:

  • \( \lambda \) = average number of occurrences per unit time, area, or volume.

  • \( t \) = time interval or region size.

  • \( \lambda t \) = expected number of events in interval \( t \).

  • \( e \approx 2.71828 \).

Mean and Variance: \[ \text{Mean: } \mu = \lambda t \qquad \text{Variance: } \sigma^2 = \lambda t \]

Poisson Distribution Example

Problem: During a laboratory experiment, the average number of radioactive particles passing through a counter in 1 millisecond is 4. What is the probability that exactly 6 particles enter the counter in a given millisecond?

Solution:

This is a Poisson distribution problem with:

\[ \lambda = 4, \quad x = 6 \]

\[ P(X = 6) = \frac{e^{-\lambda} \lambda^x}{x!} = \frac{e^{-4} \cdot 4^6}{6!} = \frac{e^{-4} \cdot 4096}{720} \]

\[ e^{-4} \approx 0.0183 \quad \Rightarrow \quad P(X = 6) \approx \frac{0.0183 \cdot 4096}{720} \approx \frac{74.9568}{720} \approx 0.1041 \]

Answer: The probability is approximately \( \boxed{0.1041} \).

Tips to Identify Poisson Distribution in Word Problems

Look for the following keywords and features:

  • Fixed time/space/area/volume: Mentions like "per minute", "per km", "per hour", "per unit", or "within an area".

  • Rare/Random Events: Events that occur randomly, such as arrival of customers, system failures, or radioactive emissions.

  • Average rate is known: Given as a mean number (e.g., "on average 3 per hour").

  • Discrete counts: The variable counts how many events occur (not how long or how big).

  • Independence of events: The occurrence of one event does not affect the others.

Common phrases in problems:

  • "The average number of ..."

  • "Occurs randomly over time/area"

  • "Find the probability that exactly \( x \) events happen ..."

  • "In a given time frame/region ..."

Key Formula: \[ P(X = x) = \frac{e^{-\lambda t} (\lambda t)^x}{x!} \]

Remember: Poisson is ideal when you're dealing with counts of rare events in a continuous domain.

Example 1: Emails Received

On average, a person receives 3 emails per hour. What is the probability that they receive exactly 5 emails in an hour?

Given: \( \lambda = 3, x = 5 \)

Mean: \( \mu = \lambda = 3 \),    Variance: \( \sigma^2 = \lambda = 3 \)

\[ P(X = 5) = \frac{e^{-3} \cdot 3^5}{5!} = \frac{e^{-3} \cdot 243}{120} \approx 0.1008 \]

Example 2: Typos in a Page

An editor finds on average 2 typos per printed page. What is the probability that a page contains no typos?

Given: \( \lambda = 2, x = 0 \)

Mean: \( \mu = 2 \),    Variance: \( \sigma^2 = 2 \)

\[ P(X = 0) = \frac{e^{-2} \cdot 2^0}{0!} = e^{-2} \approx 0.1353 \]

Example 3: Website Hits

A website gets 10 hits per minute on average. What is the probability of getting exactly 7 hits in a minute?

Given: \( \lambda = 10, x = 7 \)

Mean: \( \mu = 10 \),    Variance: \( \sigma^2 = 10 \)

\[ P(X = 7) = \frac{e^{-10} \cdot 10^7}{7!} = \frac{e^{-10} \cdot 10000000}{5040} \approx 0.0901 \]

Example 4: Machine Breakdowns

A machine breaks down on average 1.5 times per month. What is the probability that it breaks down 3 times this month?

Given: \( \lambda = 1.5, x = 3 \)

Mean: \( \mu = 1.5 \),    Variance: \( \sigma^2 = 1.5 \)

\[ P(X = 3) = \frac{e^{-1.5} \cdot 1.5^3}{3!} = \frac{e^{-1.5} \cdot 3.375}{6} \approx 0.1255 \]

Example 5: Car Accidents at a Junction

On average, 0.8 accidents occur at a junction daily. What is the probability that exactly 2 accidents occur tomorrow?

Given: \( \lambda = 0.8, x = 2 \)

Mean: \( \mu = 0.8 \),    Variance: \( \sigma^2 = 0.8 \)

\[ P(X = 2) = \frac{e^{-0.8} \cdot 0.8^2}{2!} = \frac{e^{-0.8} \cdot 0.64}{2} \approx 0.1144 \]

Uniform Distribution

Discrete Uniform Distribution

A discrete uniform distribution has a finite number of outcomes that are equally likely.

PMF: \[ P(X = x) = \frac{1}{n}, \quad x = x_1, x_2, \dots, x_n \]

Number of outcomes: \[ n = \frac{b-a}{d} + 1, \quad d = \text{spacing between consecutive numbers} \]

Mean: \[ E[X] = \frac{a+b}{2} \]

Variance: \[ \mathrm{Var}(X) = \frac{(n^2 - 1)d^2}{12} \]

Tips to Identify Discrete Uniform Problems
  • Problem states all outcomes are "equally likely"

  • Finite number of possible outcomes

  • Often includes phrases like:

    • "Choose a number at random from 1 to n"

    • "Fair die / coin / card deck"

    • "Equally probable outcomes"

Example 1: Die Roll Probability

Problem: A fair 12-sided die is rolled. Compute the expected value, variance, and the probability that the outcome is greater than 8.

Solution:

  • Here $a=1, b=12, d=1, n=12$ (numbers 1 to 12)

  • Mean: $E[X] = \frac{a+b}{2} = \frac{1+12}{2} = 6.5$

  • Variance: $\text{Var}(X) = \frac{(n^2-1)d^2}{12} = \frac{(12^2-1)\cdot1^2}{12} = \frac{143}{12} \approx 11.92$

  • Probability $X>8$: favorable outcomes $\{9,10,11,12\} \Rightarrow 4$ out of 12 \[ P(X>8) = \frac{4}{12} = \frac{1}{3} \approx 0.333 \]

Example 2: Random Number Selection

Problem: A number is chosen randomly from integers 10 to 25. Compute the expected value, variance, and the probability that the number is $\le 15$.

Solution:

  • $a=10, b=25, d=1, n = b-a+1 = 16$

  • Mean: $E[X] = \frac{a+b}{2} = \frac{10+25}{2} = 17.5$

  • Variance: $\text{Var}(X) = \frac{(n^2-1)d^2}{12} = \frac{(16^2-1)\cdot1^2}{12} = \frac{255}{12} = 21.25$

  • Probability $X\le 15$: numbers 10 to 15 $\Rightarrow 6$ out of 16 \[ P(X\le15) = \frac{6}{16} = \frac{3}{8} = 0.375 \]

Example 3: Colored Card Draw

Problem: A deck contains 6 cards numbered 1 to 6. Compute the expected value, variance, and probability that the card number is $>4$.

Solution:

  • $a=1, b=6, d=1, n=6$

  • Mean: $E[X] = \frac{1+6}{2} = 3.5$

  • Variance: $\text{Var}(X) = \frac{(6^2-1)\cdot1^2}{12} = \frac{35}{12} \approx 2.92$

  • Probability $X>4$: favorable outcomes $\{5,6\} \Rightarrow 2/6$ \[ P(X>4) = \frac{2}{6} = \frac{1}{3} \approx 0.333 \]

Example 4: Raffle Ticket Draw

Problem: A raffle ticket is randomly selected from tickets numbered 20 to 60. Compute expected value, variance, and probability ticket $\ge 50$.

Solution:

  • $a=20, b=60, d=1, n = b-a+1 = 41$

  • Mean: $E[X] = \frac{20+60}{2} = 40$

  • Variance: $\text{Var}(X) = \frac{(41^2-1)\cdot1^2}{12} = \frac{1680}{12} = 140$

  • Probability $X\ge50$: numbers 50 to 60 $\Rightarrow 11/41$ \[ P(X\ge50) = \frac{11}{41} \approx 0.268 \]

Example 5: Even Numbers Selection

Problem: A number is picked randomly from \(\{2,4,6,8,10,12\}\). Compute expected value, variance, probability $<7$.

Solution:

  • $a=2, b=12, d=2, n = \frac{b-a}{d}+1 = \frac{12-2}{2}+1 = 6$

  • Mean: $E[X] = \frac{2+12}{2} = 7$

  • Variance: $\text{Var}(X) = \frac{(6^2-1)\cdot2^2}{12} = \frac{35\cdot4}{12} \approx 11.667$

  • Probability $X<7$: numbers 2,4,6 $\Rightarrow 3/6$ \[ P(X<7) = \frac{3}{6} = 0.5 \]