Overview

5 Sample size superpowers

In practice, statistics usually begins with imperfect samples rather than complete populations, so the goal is to make the best possible estimate while being honest about uncertainty. This chapter shows how the central limit theorem supports that goal by describing how sample means form a bell-shaped distribution centered on the population mean, with spread that shrinks as sample size grows. That shrinking spread is the key to why larger samples produce more stable, predictable results and why confidence intervals are more precise when more data are available.

The chapter then turns this theory into a practical tool for estimating unknown population means. A point estimate gives a single best guess, but a confidence interval gives a range that is likely to contain the true value, built from the sample mean, a critical value, and the standard error. For large samples, the normal distribution is used to find the critical value; for smaller samples, the t-distribution is preferred because it accounts for extra uncertainty. The chapter emphasizes that a higher confidence level makes the interval wider, while a larger sample size makes it narrower.

The same logic is extended to population proportions. When the outcome is categorical, such as yes/no behavior, the sample proportion can be modeled with the central limit theorem if the sample is large enough and the usual conditions are met. Confidence intervals for proportions follow the same general structure as those for means, but use the proportion-based standard error. Across all cases, the central message is that statistical inference is about describing uncertainty well, not pretending to know the truth with certainty.

Plotting the sample means and visualizing the probability of a sample mean being less than 98 degrees
Increasing the sample size n narrows the bell curve and decreases uncertainty in the sample means.
What range of Z-values (on the horizontal axis) will give me a center, symmetrical area of .95?
Breaking down the center .95 area in the bell curve and demonstrating the symmetry
We need to look up the Z-value that captures the .025 area.
To find that right edge Z-value, we can add up .95 and .025 and look up that area, .975, in the PPF.
We have now captured our critical Z-value of ±1.959964.
The t-distribution with different degrees of freedom (DOF). Note that as the degrees of freedom approach 30, the distribution converges to a normal distribution.
Modeling the sampling distribution of sample proportions, assigning different likelihoods to proportions of a sample

Summary

  • The central limit theorem (CLT) allows us to tie a sample to a distribution of sample means or sample proportions, enabling tools such as confidence intervals (CIs) to estimate population parameters.
  • Critical Z-values allow us to find a central, symmetrical area in a standard normal distribution, which can be utilized for CIs.
  • CIs allow us to estimate a population’s mean or proportion from a sample using a range of values with a specified level of confidence, such as 95% or 99%.
  • The t-distribution allows us to handle smaller samples when trying to estimate a population mean.

FAQ

What does the central limit theorem say about the distribution of sample means?The central limit theorem says that the mean of the sample means equals the population mean, and the distribution of sample means becomes approximately normal when the sample size is large enough. If the population is already normal, then the sample means are normally distributed as well.
How do you calculate the standard deviation of sample means?You calculate it by dividing the population standard deviation by the square root of the sample size: σx̄ = σ / √n. This is also called the standard error for sample means.
Why does a larger sample size make results more predictable?Because as sample size increases, the standard error decreases, which narrows the sampling distribution. That means sample means cluster more tightly around the population mean and there is less variability in the results.
What is a confidence interval?A confidence interval is a range of values used to estimate a population parameter from a sample. Instead of giving just one number, it expresses both an estimate and the uncertainty around it.
What is a point estimate?A point estimate is a single-number estimate of a population parameter. For example, if a sample mean is 6.5 hours of sleep, then 6.5 is the point estimate for the population mean.
How do you find a critical Z-value for a 95% confidence interval?You use the inverse CDF, or PPF, for the standard normal distribution. For a 95% confidence interval, you look up the value that leaves 2.5% in each tail, which gives a critical Z-value of about ±1.96.
What happens to a confidence interval when the confidence level increases?The interval gets wider. A higher confidence level, such as 99% or 99.9%, requires a larger range to be more likely to contain the true population parameter.
When should you use the t-distribution instead of the normal distribution?You use the t-distribution when the sample size is small, typically 30 or fewer, and the population is reasonably normal. The t-distribution has fatter tails and accounts for extra uncertainty from smaller samples.
How do you calculate a confidence interval for a sample mean with a small sample?You use the sample mean, the sample standard deviation, the t-critical value, and the standard error s / √n. Then you compute the margin of error as t × s / √n and add/subtract it from the sample mean.
How do you create a confidence interval for a population proportion?Use the sample proportion p̂, the critical Z-value, and the standard error √[p̂(1 - p̂) / n]. Then compute the margin of error and form the interval as p̂ ± margin of error.

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more


choose your plan

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime
  • renews annually, pause or cancel renewal anytime
  • Grokking Statistics ebook for free
choose your plan

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime
  • renews annually, pause or cancel renewal anytime
  • Grokking Statistics ebook for free
choose your plan

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • renews monthly, pause or cancel renewal anytime
  • renews annually, pause or cancel renewal anytime
  • Grokking Statistics ebook for free