Mathematics

Statistical inference

Sampling techniques, distribution of sample means and proportions (CLT), and confidence intervals for parameter estimation.

Concepts
  • Population: set of elements on which a certain study is carried out. Its number is designated by N\mathbf{N}.
  • Sample: any selected subset of the population. Its number is designated by n\mathbf{n}.
  • Sampling: the method followed to select the sample.

Probabilistic sampling
  • Simple random sampling: the population is numbered from 1 to NN, and nn numbers are drawn for the sample.
  • Systematic random sampling: the first number is chosen at random among the first kk and the rest every kk, where k=N/nk = N/n.
  • Stratified random sampling: The total population is divided into kk strata of size N1,N2,,NkN_1, N_2, \dots, N_k. The sample nn is selected following two criteria:
    • Uniform allocation: the same number of elements from each stratum is selected, equal to N/kN/k.
    • Proportional allocation: the number of elements of each stratum is proportional to its size. It is a problem of proportional distribution.
Example: We want to select a sample of 60 people in 3 populations of size 1600, 1200 and 2400 people. Calculate the sampling with proportional allocation.
The total population size is N=5200N = 5200.
Pop. APop. BPop. C
Size NiN_i160012002400
Pop. fraction4/133/136/13
Sample size41360=18\frac{4}{13} \cdot 60 = 183136014\frac{3}{13} \cdot 60 \approx 146136028\frac{6}{13} \cdot 60 \approx 28
Distribution of sample means
Let NN be a population with mean μ\mu and standard deviation σ\sigma. Samples of size nn and mean Xˉ\bar{X} are taken. Let the variable Xˉ\bar{X} describe the distribution of sample means:
Central Limit Theorem: The mean of the variable Xˉ\bar{X} is equal to the mean of the population μ\mu. The standard deviation of Xˉ\bar{X} is σ/n\sigma/\sqrt{n}, then the distribution of sample means follows a normal distribution:
N(μ,σn)N\left(\mu, \frac{\sigma}{\sqrt{n}}\right)

Distribution of sample proportions
Let NN be a binomial population, with proportion pp of a certain characteristic. Samples of size nn with proportion p^\hat{p} of this characteristic are taken. Let P^\hat{P} be the variable that describes the distribution of sample proportions:
Central Limit Theorem: P^\hat{P} approximates a normal distribution defined as:
N(p,pqn)for n30N\left(p, \sqrt{\frac{p \cdot q}{n}}\right) \quad \text{for } n \ge 30
It is about obtaining an interval that includes the mean μ\mu of a certain variable XX that we want to investigate in the population, with a confidence level (1α)(1-\alpha). The parameter α\alpha is called the significance level and is equivalent to the probability or risk that the parameter is outside the calculated confidence interval.

Confidence intervals for the mean
Population confidence interval for μ\mu:
(xˉZα/2σn,  xˉ+Zα/2σn)\left( \bar{x} - Z_{\alpha/2} \cdot \frac{\sigma}{\sqrt{n}} , \; \bar{x} + Z_{\alpha/2} \cdot \frac{\sigma}{\sqrt{n}} \right)
Where xˉ\bar{x} is the sample mean, σ\sigma is the population standard deviation, nn is the sample size and Zα/2Z_{\alpha/2} is the critical value obtained from the table.
Maximum error made in the estimation will be:
Emax=Zα/2σnE_{\max} = Z_{\alpha/2} \cdot \frac{\sigma}{\sqrt{n}}
The minimum sample size based on the maximum error to be assumed is:
n=(Zα/2σEmax)2n = \left( Z_{\alpha/2} \cdot \frac{\sigma}{E_{\max}} \right)^2

Confidence intervals for the proportion
Population confidence interval for pp:
(p^Zα/2p^q^n,  p^+Zα/2p^q^n)\left( \hat{p} - Z_{\alpha/2} \cdot \sqrt{\frac{\hat{p} \cdot \hat{q}}{n}} , \; \hat{p} + Z_{\alpha/2} \cdot \sqrt{\frac{\hat{p} \cdot \hat{q}}{n}} \right)
Where p^\hat{p} is the sample proportion (probability of success), q^=1p^\hat{q} = 1 - \hat{p} is the probability of failure.
Maximum error made in the estimation will be:
Emax=Zα/2p^q^nE_{\max} = Z_{\alpha/2} \cdot \sqrt{\frac{\hat{p} \cdot \hat{q}}{n}}
The minimum sample size based on the maximum error to be assumed is:
n=(Zα/2p^q^Emax)2n = \left( Z_{\alpha/2} \cdot \frac{\sqrt{\hat{p} \cdot \hat{q}}}{E_{\max}} \right)^2
Table to obtain the critical value Zα/2Z_{\alpha/2} based on the desired significance level α\alpha:
Z Critical Values Table