Skip to Main Content
COM4CJ205 • Business Statistics
Module 4 Notes

MODULE IV: THEORETICAL DISTRIBUTIONS

Module Architectural Focus: This module delivers an exhaustive, mathematically rigorous exposition of Theoretical Probability Distributions. In empirical business contexts, actual observed frequency distributions are compared against theoretical mathematical models to predict stochastic behavior, control industrial quality, evaluate financial risk, and conduct statistical inference. The module examines the mathematical foundations of Random Variables, Probability Mass Functions (PMF), Probability Density Functions (PDF), and Mathematical Expectation. It explores the three fundamental theoretical distributions: (1) the Binomial Distribution (discrete Bernoulli trials), (2) the Poisson Distribution (discrete distribution of rare events and limiting form of the Binomial), and (3) the Normal Distribution (continuous Gaussian distribution, bell curve geometry, and standard normal (Z)-score transformations).

1. RANDOM VARIABLES & PROBABILITY DISTRIBUTIONS

An empirical frequency distribution is derived through actual experimental observation and tallying. In contrast, a Theoretical Probability Distribution is a mathematical rule or function that assigns a probability to each conceivable numerical value that a random variable can assume under specified theoretical assumptions.

Concept of a Random Variable ((X))

A random variable (or stochastic variable) is a real-valued mathematical function defined over the sample space (S) of a random experiment: (X: S → mathbb{R}). It maps each qualitative sample point (omega in S) to a unique numerical value (X(omega)). E.g., counting defective components in a production lot.

Mathematical Expectation ((E[X]))

The expected value represents the long-run theoretical arithmetic mean of the random variable:

Taxonomy: Discrete vs. Continuous Probability Distributions

Analytical Dimension Discrete Probability Distribution Continuous Probability Distribution
1. Nature of Variable The random variable assumes isolated, countable values (integers: (0, 1, 2, dots)). The random variable assumes any value within an unbroken continuous interval ().
2. Governing Function Probability Mass Function (PMF): (P(X = x) = p(x)). Probability Density Function (PDF): (f(x)).
3. Fundamental Conditions 1. (p(x_i) ≥ 0 orall i)
2. (∑ p(x_i) = 1.0)
1. (f(x) ≥ 0 orall x in mathbb{R})
2. (int_{-∞}^{∞} f(x) dx = 1.0)
4. Exact Point Probability Non-zero: (P(X = k) = p(k) > 0). Strictly zero: (P(X = c) = int_c^c f(x) dx = 0). Probability exists only over intervals: (P = int_a^b f(x) dx).
5. Variance Formulation (Var(X) = ∑ (x_i - mu)^2 p(x_i) = E[X^2] - (E[X])^2) (Var(X) = int_{-∞}^{∞} (x - mu)^2 f(x) dx = E[X^2] - (E[X])^2)
6. Primary Exemplars Binomial Distribution, Poisson Distribution. Normal (Gaussian) Distribution, Exponential, Student's (t).
+-----------------------------------------------------------------------------------+ | THEORETICAL PROBABILITY DISTRIBUTION ARCHITECTURE | +-----------------------------------------------------------------------------------+ | | | [THEORETICAL DISTRIBUTIONS] | | | | | +---> 1. DISCRETE DISTRIBUTIONS (Countable integer outcomes) | | | | | | | +---> BINOMIAL DISTRIBUTION: B(n, p) | | | | ├── Parameters: n (trials), p (success probability) | | | | ├── Mean: np, Variance: npq (Mean > Variance) | | | | └── Condition: Finite trials, constant probability | | | | | | | +---> POISSON DISTRIBUTION: P(λ) | | | ├── Parameter: λ = np (Mean = Variance = λ) | | | ├── Nature: Law of Rare Events (n -> ∞, p -> 0) | | | └── Applications: Queuing, defects, arrivals | | | | | +---> 2. CONTINUOUS DISTRIBUTIONS (Infinite measurable continuum) | | | | | +---> NORMAL (GAUSSIAN) DISTRIBUTION: N(μ, σ²) | | ├── Parameters: μ (location), σ (dispersion) | | ├── Geometry: Symmetrical, bell-shaped, mesokurtic | | ├── Coincidence: Mean = Median = Mode | | └── Standard Normal Variate: Z = (X - μ) / σ | +-----------------------------------------------------------------------------------+

2. THE BINOMIAL DISTRIBUTION (BERNOULLI DISTRIBUTION)

Formulated by Swiss mathematician James Bernoulli in 1713, the Binomial Distribution is the foremost discrete probability distribution modeling repeated independent trials with binary outcomes.

The Four Postulates of Bernoulli Trials

MATHEMATICAL AXIOMS
  1. Finite Number of Trials: The experiment is repeated for a fixed, predetermined number of trials denoted by (n).
  2. Dichotomous Outcomes: Each individual trial results in exactly one of two mutually exclusive and exhaustive outcomes, conventionally designated as Success ((S)) and Failure ((F)).
  3. Constancy of Success Probability: The probability of success, denoted by (p), remains strictly constant from trial to trial. Consequently, the probability of failure (q = 1 - p) is also constant.
  4. Statistical Independence: All trials are statistically independent. The outcome of any single trial exerts zero influence on any subsequent trial.

Probability Mass Function of the Binomial Distribution

Master PMF Formula:
The probability of obtaining exactly (r) successes in (n) independent Bernoulli trials is given by:
Where:
  • (n) = Total number of trials.
  • (r) = Number of successful outcomes ().
  • (p) = Probability of success in a single trial.
  • (q = 1 - p) = Probability of failure in a single trial.
Expansion Property: The sum of probabilities equals the binomial algebraic expansion:

Crucial Mathematical Properties of the Binomial Distribution

1. Parameters: Dual ((n) and (p))

The Binomial distribution is completely characterized by two parameters: (n) (number of trials) and (p) (probability of success). Knowledge of (n) and (p) allows calculation of all probabilities.

2. Mean ((mu)) & Variance ()

• Mean: (mu = E[X] = np)
• Variance: (σ^2 = Var(X) = npq)
• Standard Deviation:

3. Universal Inequity: Mean > Variance

Since (q = 1 - p < 1.0), it follows that:
In a Binomial distribution, the variance is always strictly less than the arithmetic mean.

4. Shape & Skewness ()

• If (p = 0.5), the distribution is perfectly symmetrical ().
• If (p < 0.5), it is positively skewed ((gamma_1 > 0)).
• If (p > 0.5), it is negatively skewed ((gamma_1 < 0)).

Fitting of a Theoretical Binomial Distribution

Fitting a Binomial distribution to empirical data entails calculating expected frequencies:

Fitting Procedure:
1. Calculate the empirical sample mean: .
2. Equate theoretical mean to sample mean: , and (q = 1 - p).
3. Compute (P(X = 0) = q^n), and calculate subsequent probabilities via the Recurrence Relation:
4. Compute theoretical expected frequencies: (E(r) = N × P(X = r)), where .

3. THE POISSON DISTRIBUTION (LAW OF RARE EVENTS)

Introduced in 1837 by French mathematician Siméon Denis Poisson, the Poisson Distribution is a discrete probability distribution applicable when the probability of occurrence of an event is extremely small, but the total number of opportunities for occurrence is exceedingly large.

Poisson as Limiting Form of the Binomial Distribution

MATHEMATICAL DERIVATION

The Poisson distribution emerges as the mathematical limit of the Binomial distribution (B(n, p)) under three simultaneous asymptotic conditions:

  1. The number of trials (n) tends to infinity: .
  2. The probability of success (p) tends to zero: (p → 0) (a rare event).
  3. The expected value remains a constant finite positive quantity: .
Limit Proof:
lim_{n to ∞} P(X = r) = lim_{n to ∞} (n!) / (r!(n - r)!) ≤ft((λ) / (n)right)^r ≤ft(1 - (λ) / (n)right)^{n - r} = (λ^r) / (r!) lim_{n to ∞} ≤ft[ (n(n-1)dots(n-r+1)) / (n^r) ≤ft(1 - (λ) / (n)right)^n ≤ft(1 - (λ) / (n)right)^{-r} right
= (e^{-λ} λ^r) / (r!) ]

Probability Mass Function of the Poisson Distribution

Master Poisson PMF:
Where:
  • (r) = Number of occurrences of the rare event ((r = 0, 1, 2, dots)).
  • = Average rate or expected number of occurrences in a specified unit of time or space ().
  • (e) = Base of natural logarithms ().
Recurrence Formula for Successive Probabilities:

Key Mathematical Properties of the Poisson Distribution

1. Single Parameter ()

The Poisson distribution has only one parameter: (or (m)). Once is known, the entire distribution is completely determined.

2. Identity of Mean and Variance

A unique defining mathematical characteristic of the Poisson distribution is that its mean equals its variance:
Standard deviation is .

3. Positive Skewness

The Poisson distribution is always positively skewed:
As , skewness approaches zero, making the distribution asymptotically normal.

4. Additive (Reproductive) Property

If (X_1 sim Poisson) and (X_2 sim Poisson) are independent, then:
The sum of independent Poisson variates is itself a Poisson variate.

4. THE NORMAL DISTRIBUTION (GAUSSIAN DISTRIBUTION)

First discovered by Abraham de Moivre in 1733 and later developed independently by Carl Friedrich Gauss (1809) and Pierre-Simon Laplace, the Normal Distribution is the sovereign distribution of continuous probability and inferential statistics.

Probability Density Function (PDF):
A continuous random variable (X) is normally distributed with parameters (mu) (mean) and (standard deviation), denoted (X sim N), if its PDF is:
Where and .

The Standard Normal Variate ((Z))

Because computing the integral of the normal density function directly is analytically intractable, any normal variate (X sim N) is standardized via the (Z)-transformation:

Standard Normal Transformation Formula:
The resulting Standard Normal Variate (Z) has a Mean of 0 ((mu_z = 0)) and a Standard Deviation of 1 ().
Its probability density function simplifies to:

Exhaustive Geometric & Mathematical Properties of the Normal Curve

Property Dimension Mathematical & Geometric Description
1. Bell-Shaped Symmetry The normal curve is perfectly symmetrical and bell-shaped about the vertical axis passing through (x = mu). The skewness coefficient is strictly zero ().
2. Coincidence of Averages The three measures of central tendency coincide exactly at the central axis:
3. Asymptotic Tails The curve extends infinitely in both directions ( to ), approaching the horizontal axis asymptotically. The tails never touch or cross the horizontal axis.
4. Unimodal Peak The curve has a single maximum peak at (x = mu), with maximum ordinate height:
5. Points of Inflexion The curve changes its curvature from concave downward to convex upward at points precisely one standard deviation from the mean:
6. Total Area Under Curve The total area beneath the normal curve above the horizontal axis is exactly equal to 1.0 (100%). Symmetry dictates that exactly 0.50 (50%) of the area lies on each side of the mean.
7. Kurtosis (Mesokurtic) The normal distribution serves as the universal standard benchmark for kurtosis:
8. Inter-Quartile & Deviation Relations • Quartile Deviation ((QD)):
• Mean Deviation ((MD)):
• Ratio of Dispersion Measures:
• Quartile Positions:

Empirical Area Properties Under the Normal Curve (The Empirical Rule)

+-----------------------------------------------------------------------------------+ | STANDARD NORMAL CURVE AREA COVERAGE | +-----------------------------------------------------------------------------------+ | | | f(z) | | | | | / | | | / | | | / | | | / | | | / | | | ------/ | ------ | | ----+---------+---------+-------------+-------------+---------+---------+-----> | | μ-3σ μ-2σ μ-1σ μ μ+1σ μ+2σ μ+3σ Z | | -3.0 -2.0 -1.0 0 +1.0 +2.0 +3.0 | | | | |<------------- 68.27% (μ ± 1.0σ) ------------->| | | |<----------------------- 95.45% (μ ± 2.0σ) ----------------------->| | | |<----------------- 95.00% (μ ± 1.96σ) ----------------->| | | |<----------------- 99.00% (μ ± 2.58σ) ------------------------->| | | |<----------------------------- 99.73% (μ ± 3.0σ) -------------------------->| +-----------------------------------------------------------------------------------+

5. COMPARATIVE SYNTHESIS OF THE THREE THEORETICAL DISTRIBUTIONS

Feature Binomial Distribution Poisson Distribution Normal Distribution
Variable Type Discrete ((r = 0, 1, dots, n)) Discrete () Continuous ()
Parameters Two: (n) and (p) One: Two: (mu) and
Mean (np) (mu)
Variance (npq)
Mean vs. Variance Mean > Variance ((np > npq)) Mean = Variance () Independent parameters ()
Skewness Symmetric if (p = 0.5); skewed otherwise Always positively skewed ((gamma_1 > 0)) Strictly zero / symmetric ((gamma_1 = 0))
Kurtosis (Leptokurtic) (Mesokurtic)
Commercial Use Lot acceptance sampling, consumer survey acceptance, binary risk Queueing at teller counters, IT server requests, rare insurance claims Financial asset returns, employee test scoring, manufacturing tolerances

6. STEP-BY-STEP SOLVED NUMERICAL ILLUSTRATIONS

ILLUSTRATION 1: Binomial Distribution in Manufacturing Quality Control
An automated electronics assembly facility manufactures high-definition LED instrument display panels. Historical quality audits indicate that 10% of the produced panels are defective ((p = 0.10)). A quality control engineer randomly draws a sample of 6 display panels from the production floor for rigorous testing.

Required: Compute the exact theoretical probability that the sample contains:
1. Exactly zero defective panels.
2. Exactly 2 defective panels.
3. At most 1 defective panel.
4. At least 2 defective panels.
5. Calculate the theoretical mean, variance, and standard deviation of defective panels in the sample.

Solution & Step-by-Step Working Notes:

This scenario conforms strictly to Bernoulli trials: (n = 6), (p = 0.10), and (q = 1 - p = 0.90).
The Binomial PMF is:

2. Probability of exactly 2 defectives ((r = 2)):

3. Probability of at most 1 defective ():
"At most 1" signifies (r = 0) OR (r = 1):

4. Probability of at least 2 defectives ():
Applying the complementary probability rule:

5. Mean, Variance, and Standard Deviation:
• Mean:
• Variance:
• Standard Deviation:

ILLUSTRATION 2: Poisson Distribution in Banking Operations & Queuing
The central digital customer support desk of a commercial bank receives incoming priority corporate transactions at an average Poisson rate of 3.0 inquiries per minute ().

Required: Compute the probability that in any randomly chosen operating minute, the desk receives:
1. Exactly zero customer inquiries.
2. Exactly 2 customer inquiries.
3. Exactly 4 customer inquiries.
4. At least 3 customer inquiries.
(Given: (e^{-3} = 0.049787))

Solution & Step-by-Step Working Notes:

Parameter , .
The Poisson PMF is:

1. Exactly zero inquiries ((r = 0)):

2. Exactly 2 inquiries ((r = 2)):

3. Exactly 4 inquiries ((r = 4)):

4. At least 3 inquiries ():

] We already have (P(X = 0) = 0.049787) and (P(X = 2) = 0.224042).
Now compute (P(X = 1)):
Sum of probabilities for (X < 3):
Therefore:

ILLUSTRATION 3: Normal Distribution in Human Resource Selection & Salary Administration
A multinational banking group conducted an All-India Management Trainee Aptitude Assessment for 10,000 applicants. The test scores are normally distributed with an arithmetic mean score of (mu = 65) marks and a standard deviation of marks.

Required:
1. What percentage and how many candidates scored above 80 marks?
2. What percentage and how many candidates scored between 55 and 75 marks?
3. If the bank decides to invite only the top 10% of candidates for personal interview, what is the minimum qualifying cut-off score?
4. If the minimum pass mark is fixed at 45 marks, how many applicants failed the examination?

Standard Normal Table Values:
• Area from (Z = 0) to (Z = 1.50) is 0.4332.
• Area from (Z = 0) to (Z = 1.00) is 0.3413.
• Area from (Z = 0) to (Z = 2.00) is 0.4772.
• For an upper tail area of 0.10 (area from 0 to (Z = 0.40)), (Z = 1.28).

Solution & Step-by-Step Working Notes:

Total candidates (N = 10,000), (mu = 65), . Standard Normal Variate .

1. Candidates scoring above 80 marks ((X > 80)):
For (X = 80):

Expected number of candidates = .

2. Candidates scoring between 55 and 75 marks ():
For (X_1 = 55): .
For (X_2 = 75): .
By symmetry of the normal curve:

Expected number of candidates = .

3. Minimum cut-off score for Top 10% of candidates:
Let the qualifying cut-off score be (X_c). The top 10% corresponds to an area of 0.10 in the extreme right-hand tail.
Area from (Z = 0) to (Z_c = 0.5000 - 0.1000 = 0.4000).
From standard normal distribution tables, the critical (Z)-value corresponding to area 0.4000 is (Z_c = +1.28).
Substituting into the standardization equation:

Candidates must score at least 77.8 marks (or 78 rounded) to qualify for the personal interview.

4. Number of applicants who failed the examination ((X < 45)):
For (X = 45):

Expected number of failed applicants = .

7. COMPREHENSIVE SELF-ASSESSMENT MODULE

SECTION A: CONCEPTUAL & QUANTITATIVE MCQS

Select the most appropriate option. Complete solution key with mathematical rationale follows.

1. In a Binomial distribution, if the mean is 12 and the variance is 4, the number of trials (n) is equal to:
(a) 16     (b) 18     (c) 24     (d) 36

2. Which theoretical distribution has the unique mathematical property that its arithmetic mean is identically equal to its variance?
(a) Binomial     (b) Normal     (c) Poisson     (d) Geometric

3. The shape of the Normal Probability Curve is universally classified as:
(a) Platykurtic ()     (b) Mesokurtic ()     (c) Leptokurtic ()     (d) Asymmetrical

4. In a continuous normal distribution with mean (mu = 50) and , the exact point probability (P(X = 50)) is:
(a) 0.50     (b) 1.00     (c) 0.00     (d) 0.3989

5. The points of inflexion of a normal distribution curve with mean (mu) and standard deviation occur at:
(a)     (b)     (c)     (d)

6. Under which limiting conditions does the Binomial distribution tend toward the Poisson distribution?
(a)     (b)     (c) (n → 0, p → 0)     (d)

7. The total area under the standard normal curve enclosed between (Z = -1.96) and (Z = +1.96) is exactly:
(a) 68.27%     (b) 95.00%     (c) 95.45%     (d) 99.73%

8. If (X sim Poisson), its standard deviation is:
(a) 4     (b) 16     (c) 2     (d) 1

9. The ratio between the Quartile Deviation ((QD)), Mean Deviation ((MD)), and Standard Deviation () in a normal distribution is approximately:
(a) (1 : 2 : 3)     (b) (10 : 12 : 15)     (c) (15 : 12 : 10)     (d) (2 : 3 : 4)

10. For a Binomial distribution with (n = 10) and (p = 0.5), the distribution is:
(a) Positively skewed     (b) Negatively skewed     (c) Perfectly symmetrical     (d) Leptokurtic

Answers & Conceptual Rationale for Section A:
1. (b) 18: Mean (mu = np = 12), Variance . Dividing gives . Thus . Since (np = 12 implies nleft(2) / (3)right = 12 implies n = 12 × (3) / (2) = 18).
2. (c) Poisson: The Poisson distribution is the only distribution where .
3. (b) Mesokurtic (): The normal curve has moment coefficient of kurtosis .
4. (c) 0.00: In any continuous distribution, the probability of an exact isolated real number point is mathematically zero.
5. (c) : The second derivative of the normal PDF vanishes at , changing curvature.
6. (b): Poisson is the law of rare events where , (p → 0), and .
7. (b) 95.00%: Exactly 95% of the total area lies between (two-tailed 5% critical boundary).
8. (c) 2: In a Poisson distribution, .
9. (b) 10 : 12 : 15: Since and , multiplying by 15 gives (10 : 12 : 15).
10. (c) Perfectly symmetrical: When (p = q = 0.5), the Binomial distribution is symmetrical with skewness .
SECTION B: ANALYTICAL & THEORETICAL ESSAY QUESTIONS
  1. State the fundamental assumptions underlying Bernoulli trials. Derive the mathematical formulas for the mean and variance of the Binomial distribution.
  2. Show mathematically that the Poisson distribution is a limiting case of the Binomial distribution. Clearly specify the three asymptotic conditions under which this convergence occurs.
  3. Enumerate ten essential geometric and mathematical properties of the Normal Distribution curve. Explain why the normal distribution occupies a central role in statistical quality control and modern portfolio theory.
  4. Differentiate between the Binomial, Poisson, and Normal distributions. Construct a comparative matrix evaluating them on variable type, parameters, mean-variance relationship, skewness, and industrial business applications.
  5. Explain the procedure for fitting a Theoretical Normal Distribution to an observed continuous frequency distribution. How is the goodness-of-fit evaluated?
SECTION C: ADVANCED QUANTITATIVE PROBLEMS

Problem 1: Fitting a Binomial Distribution to Experimental Data
Four coins were tossed simultaneously 160 times, and the number of heads appearing on each toss was recorded as follows:
Number of Heads ((X)): 0, 1, 2, 3, 4
Observed Frequency ((f)): 17, 52, 54, 31, 6     (Total (N = 160))

Required:
1. Calculate the observed sample mean number of heads.
2. Assuming the coins are unbiased ((p = q = 0.5)), calculate the theoretical binomial probabilities for (X = 0, 1, 2, 3, 4).
3. Compute the theoretical expected frequencies.
4. Compare the observed and expected frequencies and comment on the fairness of the coins.

Problem 2: Normal Distribution in Quality Specification & Warranty Claims
An industrial automotive component manufacturing firm produces high-pressure fuel injector valves. The operational life of these valves before mechanical failure is normally distributed with a mean life of and a standard deviation of .

Required:
1. What percentage of fuel injector valves will fail prior to reaching 3,400 hours of continuous operation?
2. If the manufacturer provides a free replacement warranty for valves that fail before 3,200 hours, what percentage of manufactured valves will generate warranty replacement claims?
3. What proportion of valves will deliver an operational life between 3,600 hours and 4,600 hours?
4. The executive committee seeks to advertise a guaranteed operational lifespan such that no more than 2% of valves fail before the guaranteed limit. What guaranteed lifespan should the company declare?
(Given: Area between (Z = 0) and (Z = 1.50) is 0.4332; between (0) and (2.00) is 0.4772; between (0) and (1.00) is 0.3413; for lower tail area of 0.02, (Z = -2.05)).

Acing your exams is just a click away!
Visit www.degreelive.in to download the next module for free.

Finished reading Module 4?

Save this module as a PDF for offline study or advance to the next module.