MODULE IV: THEORETICAL DISTRIBUTIONS
1. RANDOM VARIABLES & PROBABILITY DISTRIBUTIONS
An empirical frequency distribution is derived through actual experimental observation and tallying. In contrast, a Theoretical Probability Distribution is a mathematical rule or function that assigns a probability to each conceivable numerical value that a random variable can assume under specified theoretical assumptions.
Concept of a Random Variable ((X))
Mathematical Expectation ((E[X]))
Taxonomy: Discrete vs. Continuous Probability Distributions
| Analytical Dimension | Discrete Probability Distribution | Continuous Probability Distribution |
|---|---|---|
| 1. Nature of Variable | The random variable assumes isolated, countable values (integers: (0, 1, 2, dots)). | The random variable assumes any value within an unbroken continuous interval (). |
| 2. Governing Function | Probability Mass Function (PMF): (P(X = x) = p(x)). | Probability Density Function (PDF): (f(x)). |
| 3. Fundamental Conditions |
1. (p(x_i) ≥ 0 orall i) 2. (∑ p(x_i) = 1.0) |
1. (f(x) ≥ 0 orall x in mathbb{R}) 2. (int_{-∞}^{∞} f(x) dx = 1.0) |
| 4. Exact Point Probability | Non-zero: (P(X = k) = p(k) > 0). | Strictly zero: (P(X = c) = int_c^c f(x) dx = 0). Probability exists only over intervals: (P = int_a^b f(x) dx). |
| 5. Variance Formulation | (Var(X) = ∑ (x_i - mu)^2 p(x_i) = E[X^2] - (E[X])^2) | (Var(X) = int_{-∞}^{∞} (x - mu)^2 f(x) dx = E[X^2] - (E[X])^2) |
| 6. Primary Exemplars | Binomial Distribution, Poisson Distribution. | Normal (Gaussian) Distribution, Exponential, Student's (t). |
2. THE BINOMIAL DISTRIBUTION (BERNOULLI DISTRIBUTION)
Formulated by Swiss mathematician James Bernoulli in 1713, the Binomial Distribution is the foremost discrete probability distribution modeling repeated independent trials with binary outcomes.
The Four Postulates of Bernoulli Trials
- Finite Number of Trials: The experiment is repeated for a fixed, predetermined number of trials denoted by (n).
- Dichotomous Outcomes: Each individual trial results in exactly one of two mutually exclusive and exhaustive outcomes, conventionally designated as Success ((S)) and Failure ((F)).
- Constancy of Success Probability: The probability of success, denoted by (p), remains strictly constant from trial to trial. Consequently, the probability of failure (q = 1 - p) is also constant.
- Statistical Independence: All trials are statistically independent. The outcome of any single trial exerts zero influence on any subsequent trial.
Probability Mass Function of the Binomial Distribution
The probability of obtaining exactly (r) successes in (n) independent Bernoulli trials is given by:
- (n) = Total number of trials.
- (r) = Number of successful outcomes ().
- (p) = Probability of success in a single trial.
- (q = 1 - p) = Probability of failure in a single trial.
Crucial Mathematical Properties of the Binomial Distribution
1. Parameters: Dual ((n) and (p))
2. Mean ((mu)) & Variance ()
• Variance: (σ^2 = Var(X) = npq)
• Standard Deviation:
3. Universal Inequity: Mean > Variance
4. Shape & Skewness ()
• If (p < 0.5), it is positively skewed ((gamma_1 > 0)).
• If (p > 0.5), it is negatively skewed ((gamma_1 < 0)).
Fitting of a Theoretical Binomial Distribution
Fitting a Binomial distribution to empirical data entails calculating expected frequencies:
1. Calculate the empirical sample mean: .
2. Equate theoretical mean to sample mean: , and (q = 1 - p).
3. Compute (P(X = 0) = q^n), and calculate subsequent probabilities via the Recurrence Relation:
3. THE POISSON DISTRIBUTION (LAW OF RARE EVENTS)
Introduced in 1837 by French mathematician Siméon Denis Poisson, the Poisson Distribution is a discrete probability distribution applicable when the probability of occurrence of an event is extremely small, but the total number of opportunities for occurrence is exceedingly large.
Poisson as Limiting Form of the Binomial Distribution
The Poisson distribution emerges as the mathematical limit of the Binomial distribution (B(n, p)) under three simultaneous asymptotic conditions:
- The number of trials (n) tends to infinity: .
- The probability of success (p) tends to zero: (p → 0) (a rare event).
- The expected value remains a constant finite positive quantity: .
Probability Mass Function of the Poisson Distribution
- (r) = Number of occurrences of the rare event ((r = 0, 1, 2, dots)).
- = Average rate or expected number of occurrences in a specified unit of time or space ().
- (e) = Base of natural logarithms ().
Key Mathematical Properties of the Poisson Distribution
1. Single Parameter ()
2. Identity of Mean and Variance
3. Positive Skewness
4. Additive (Reproductive) Property
4. THE NORMAL DISTRIBUTION (GAUSSIAN DISTRIBUTION)
First discovered by Abraham de Moivre in 1733 and later developed independently by Carl Friedrich Gauss (1809) and Pierre-Simon Laplace, the Normal Distribution is the sovereign distribution of continuous probability and inferential statistics.
A continuous random variable (X) is normally distributed with parameters (mu) (mean) and (standard deviation), denoted (X sim N), if its PDF is:
The Standard Normal Variate ((Z))
Because computing the integral of the normal density function directly is analytically intractable, any normal variate (X sim N) is standardized via the (Z)-transformation:
Its probability density function simplifies to:
Exhaustive Geometric & Mathematical Properties of the Normal Curve
| Property Dimension | Mathematical & Geometric Description |
|---|---|
| 1. Bell-Shaped Symmetry | The normal curve is perfectly symmetrical and bell-shaped about the vertical axis passing through (x = mu). The skewness coefficient is strictly zero (). |
| 2. Coincidence of Averages | The three measures of central tendency coincide exactly at the central axis:
|
| 3. Asymptotic Tails | The curve extends infinitely in both directions ( to ), approaching the horizontal axis asymptotically. The tails never touch or cross the horizontal axis. |
| 4. Unimodal Peak | The curve has a single maximum peak at (x = mu), with maximum ordinate height:
|
| 5. Points of Inflexion | The curve changes its curvature from concave downward to convex upward at points precisely one standard deviation from the mean:
|
| 6. Total Area Under Curve | The total area beneath the normal curve above the horizontal axis is exactly equal to 1.0 (100%). Symmetry dictates that exactly 0.50 (50%) of the area lies on each side of the mean. |
| 7. Kurtosis (Mesokurtic) | The normal distribution serves as the universal standard benchmark for kurtosis:
|
| 8. Inter-Quartile & Deviation Relations |
• Quartile Deviation ((QD)): • Mean Deviation ((MD)): • Ratio of Dispersion Measures: • Quartile Positions: |
Empirical Area Properties Under the Normal Curve (The Empirical Rule)
5. COMPARATIVE SYNTHESIS OF THE THREE THEORETICAL DISTRIBUTIONS
| Feature | Binomial Distribution | Poisson Distribution | Normal Distribution |
|---|---|---|---|
| Variable Type | Discrete ((r = 0, 1, dots, n)) | Discrete () | Continuous () |
| Parameters | Two: (n) and (p) | One: | Two: (mu) and |
| Mean | (np) | (mu) | |
| Variance | (npq) | ||
| Mean vs. Variance | Mean > Variance ((np > npq)) | Mean = Variance () | Independent parameters () |
| Skewness | Symmetric if (p = 0.5); skewed otherwise | Always positively skewed ((gamma_1 > 0)) | Strictly zero / symmetric ((gamma_1 = 0)) |
| Kurtosis | (Leptokurtic) | (Mesokurtic) | |
| Commercial Use | Lot acceptance sampling, consumer survey acceptance, binary risk | Queueing at teller counters, IT server requests, rare insurance claims | Financial asset returns, employee test scoring, manufacturing tolerances |
6. STEP-BY-STEP SOLVED NUMERICAL ILLUSTRATIONS
An automated electronics assembly facility manufactures high-definition LED instrument display panels. Historical quality audits indicate that 10% of the produced panels are defective ((p = 0.10)). A quality control engineer randomly draws a sample of 6 display panels from the production floor for rigorous testing.
Required: Compute the exact theoretical probability that the sample contains:
1. Exactly zero defective panels.
2. Exactly 2 defective panels.
3. At most 1 defective panel.
4. At least 2 defective panels.
5. Calculate the theoretical mean, variance, and standard deviation of defective panels in the sample.
Solution & Step-by-Step Working Notes:
This scenario conforms strictly to Bernoulli trials: (n = 6), (p = 0.10), and (q = 1 - p = 0.90).
The Binomial PMF is:
2. Probability of exactly 2 defectives ((r = 2)):
3. Probability of at most 1 defective ():
"At most 1" signifies (r = 0) OR (r = 1):
4. Probability of at least 2 defectives ():
Applying the complementary probability rule:
5. Mean, Variance, and Standard Deviation:
• Mean:
• Variance:
• Standard Deviation:
The central digital customer support desk of a commercial bank receives incoming priority corporate transactions at an average Poisson rate of 3.0 inquiries per minute ().
Required: Compute the probability that in any randomly chosen operating minute, the desk receives:
1. Exactly zero customer inquiries.
2. Exactly 2 customer inquiries.
3. Exactly 4 customer inquiries.
4. At least 3 customer inquiries.
(Given: (e^{-3} = 0.049787))
Solution & Step-by-Step Working Notes:
Parameter , .
The Poisson PMF is:
1. Exactly zero inquiries ((r = 0)):
2. Exactly 2 inquiries ((r = 2)):
3. Exactly 4 inquiries ((r = 4)):
4. At least 3 inquiries ():
Now compute (P(X = 1)):
A multinational banking group conducted an All-India Management Trainee Aptitude Assessment for 10,000 applicants. The test scores are normally distributed with an arithmetic mean score of (mu = 65) marks and a standard deviation of marks.
Required:
1. What percentage and how many candidates scored above 80 marks?
2. What percentage and how many candidates scored between 55 and 75 marks?
3. If the bank decides to invite only the top 10% of candidates for personal interview, what is the minimum qualifying cut-off score?
4. If the minimum pass mark is fixed at 45 marks, how many applicants failed the examination?
Standard Normal Table Values:
• Area from (Z = 0) to (Z = 1.50) is 0.4332.
• Area from (Z = 0) to (Z = 1.00) is 0.3413.
• Area from (Z = 0) to (Z = 2.00) is 0.4772.
• For an upper tail area of 0.10 (area from 0 to (Z = 0.40)), (Z = 1.28).
Solution & Step-by-Step Working Notes:
Total candidates (N = 10,000), (mu = 65), . Standard Normal Variate .
1. Candidates scoring above 80 marks ((X > 80)):
For (X = 80):
2. Candidates scoring between 55 and 75 marks ():
For (X_1 = 55): .
For (X_2 = 75): .
By symmetry of the normal curve:
3. Minimum cut-off score for Top 10% of candidates:
Let the qualifying cut-off score be (X_c). The top 10% corresponds to an area of 0.10 in the extreme right-hand tail.
Area from (Z = 0) to (Z_c = 0.5000 - 0.1000 = 0.4000).
From standard normal distribution tables, the critical (Z)-value corresponding to area 0.4000 is (Z_c = +1.28).
Substituting into the standardization equation:
4. Number of applicants who failed the examination ((X < 45)):
For (X = 45):
7. COMPREHENSIVE SELF-ASSESSMENT MODULE
Select the most appropriate option. Complete solution key with mathematical rationale follows.
1. In a Binomial distribution, if the mean is 12 and the variance is 4, the number of trials (n) is equal to:
(a) 16 (b) 18 (c) 24 (d) 36
2. Which theoretical distribution has the unique mathematical property that its arithmetic mean is identically equal to its variance?
(a) Binomial (b) Normal (c) Poisson (d) Geometric
3. The shape of the Normal Probability Curve is universally classified as:
(a) Platykurtic () (b) Mesokurtic () (c) Leptokurtic () (d) Asymmetrical
4. In a continuous normal distribution with mean (mu = 50) and , the exact point probability (P(X = 50)) is:
(a) 0.50 (b) 1.00 (c) 0.00 (d) 0.3989
5. The points of inflexion of a normal distribution curve with mean (mu) and standard deviation occur at:
(a) (b) (c) (d)
6. Under which limiting conditions does the Binomial distribution tend toward the Poisson distribution?
(a) (b) (c) (n → 0, p → 0) (d)
7. The total area under the standard normal curve enclosed between (Z = -1.96) and (Z = +1.96) is exactly:
(a) 68.27% (b) 95.00% (c) 95.45% (d) 99.73%
8. If (X sim Poisson), its standard deviation is:
(a) 4 (b) 16 (c) 2 (d) 1
9. The ratio between the Quartile Deviation ((QD)), Mean Deviation ((MD)), and Standard Deviation () in a normal distribution is approximately:
(a) (1 : 2 : 3) (b) (10 : 12 : 15) (c) (15 : 12 : 10) (d) (2 : 3 : 4)
10. For a Binomial distribution with (n = 10) and (p = 0.5), the distribution is:
(a) Positively skewed (b) Negatively skewed (c) Perfectly symmetrical (d) Leptokurtic
1. (b) 18: Mean (mu = np = 12), Variance . Dividing gives . Thus . Since (np = 12 implies nleft(2) / (3)right = 12 implies n = 12 × (3) / (2) = 18).
2. (c) Poisson: The Poisson distribution is the only distribution where .
3. (b) Mesokurtic (): The normal curve has moment coefficient of kurtosis .
4. (c) 0.00: In any continuous distribution, the probability of an exact isolated real number point is mathematically zero.
5. (c) : The second derivative of the normal PDF vanishes at , changing curvature.
6. (b): Poisson is the law of rare events where , (p → 0), and .
7. (b) 95.00%: Exactly 95% of the total area lies between (two-tailed 5% critical boundary).
8. (c) 2: In a Poisson distribution, .
9. (b) 10 : 12 : 15: Since and , multiplying by 15 gives (10 : 12 : 15).
10. (c) Perfectly symmetrical: When (p = q = 0.5), the Binomial distribution is symmetrical with skewness .
- State the fundamental assumptions underlying Bernoulli trials. Derive the mathematical formulas for the mean and variance of the Binomial distribution.
- Show mathematically that the Poisson distribution is a limiting case of the Binomial distribution. Clearly specify the three asymptotic conditions under which this convergence occurs.
- Enumerate ten essential geometric and mathematical properties of the Normal Distribution curve. Explain why the normal distribution occupies a central role in statistical quality control and modern portfolio theory.
- Differentiate between the Binomial, Poisson, and Normal distributions. Construct a comparative matrix evaluating them on variable type, parameters, mean-variance relationship, skewness, and industrial business applications.
- Explain the procedure for fitting a Theoretical Normal Distribution to an observed continuous frequency distribution. How is the goodness-of-fit evaluated?
Problem 1: Fitting a Binomial Distribution to Experimental Data
Four coins were tossed simultaneously 160 times, and the number of heads appearing on each toss was recorded as follows:
Number of Heads ((X)): 0, 1, 2, 3, 4
Observed Frequency ((f)): 17, 52, 54, 31, 6 (Total (N = 160))
Required:
1. Calculate the observed sample mean number of heads.
2. Assuming the coins are unbiased ((p = q = 0.5)), calculate the theoretical binomial probabilities for (X = 0, 1, 2, 3, 4).
3. Compute the theoretical expected frequencies.
4. Compare the observed and expected frequencies and comment on the fairness of the coins.
Problem 2: Normal Distribution in Quality Specification & Warranty Claims
An industrial automotive component manufacturing firm produces high-pressure fuel injector valves. The operational life of these valves before mechanical failure is normally distributed with a mean life of and a standard deviation of .
Required:
1. What percentage of fuel injector valves will fail prior to reaching 3,400 hours of continuous operation?
2. If the manufacturer provides a free replacement warranty for valves that fail before 3,200 hours, what percentage of manufactured valves will generate warranty replacement claims?
3. What proportion of valves will deliver an operational life between 3,600 hours and 4,600 hours?
4. The executive committee seeks to advertise a guaranteed operational lifespan such that no more than 2% of valves fail before the guaranteed limit. What guaranteed lifespan should the company declare?
(Given: Area between (Z = 0) and (Z = 1.50) is 0.4332; between (0) and (2.00) is 0.4772; between (0) and (1.00) is 0.3413; for lower tail area of 0.02, (Z = -2.05)).