30.10 Summary
To test a hypothesis about a difference between two population means μ1−μ2, based on the value of the difference between two sample mean ˉx1−ˉx2, assume the value of μ1−μ2 in the null hypothesis to be true (usually zero). Then, the difference between the sample means varies from sample to sample and, under certain statistical validity conditions, varies with an approximate normal distribution centered around the hypothesised value of μ1−μ2, with a standard deviation of s.e.(ˉx1−ˉx2). This distribution describes what values of the sample mean could be expected in the sample if the value of μ in the null hypothesis was true. The test statistic is
t=(ˉx1−ˉx2)−(μ1−μ2)s.e.(ˉx1−ˉx2), where μ1−μ2 is the hypothesised value given in the null hypothesis. This describes the observations. The t-value is like a z-score, and so an approximate P-value is estimated using the 68–95–99.7 rule, which is how we weigh the evidence to determine if it is consistent with the assumption.
The following short video may help explain some of these concepts: