Statistics
Textbooks
Boundless Statistics
A Closer Look at Tests of Significance
Which Test?
Statistics Textbooks Boundless Statistics A Closer Look at Tests of Significance Which Test?
Statistics Textbooks Boundless Statistics A Closer Look at Tests of Significance
Statistics Textbooks Boundless Statistics
Statistics Textbooks
Statistics
Concept Version 8
Created by Boundless

One, Two, or More Groups?

Different statistical tests are required when there are different numbers of groups (or samples).

Learning Objective

  • Identify the appropriate statistical test required for a group of samples


Key Points

    • One-sample tests are appropriate when a sample is being compared to the population from a hypothesis. The population characteristics are known from theory or are calculated from the population.
    • Two-sample tests are appropriate for comparing two samples, typically experimental and control samples from a scientifically controlled experiment.
    • Paired tests are appropriate for comparing two samples where it is impossible to control important variables.
    • $F$-tests (analysis of variance, also called ANOVA) are used when there are more than two groups. They are commonly used when deciding whether groupings of data by category are meaningful.

Terms

  • z-test

    Any statistical test for which the distribution of the test statistic under the null hypothesis can be approximated by a normal distribution.

  • t-test

    Any statistical hypothesis test in which the test statistic follows a Student's $t$-distribution if the null hypothesis is supported.


Full Text

Depending on how many groups (or samples) with which we are working, different statistical tests are required.

One-sample tests are appropriate when a sample is being compared to the population from a hypothesis. The population characteristics are known from theory, or are calculated from the population. Two-sample tests are appropriate for comparing two samples, typically experimental and control samples from a scientifically controlled experiment. Paired tests are appropriate for comparing two samples where it is impossible to control important variables. Rather than comparing two sets, members are paired between samples so the difference between the members becomes the sample. Typically the mean of the differences is then compared to zero.

The number of groups or samples is also an important deciding factor when determining which test statistic is appropriate for a particular hypothesis test. A test statistic is considered to be a numerical summary of a data-set that reduces the data to one value that can be used to perform a hypothesis test. Examples of test statistics include the $z$-statistic, $t$-statistic, chi-square statistic, and $F$-statistic.

A $z$-statistic may be used for comparing one or two samples or proportions. When comparing two proportions, it is necessary to use a pooled standard deviation for the $z$-test. The formula to calculate a $z$-statistic for use in a one-sample $z$-test is as follows:

$z = \dfrac{\bar{x} - \mu_0}{\sigma} \sqrt{n}$

where $\bar{x}$ is the sample mean, $\mu$ is the population mean, $\sigma$ is the population standard deviation, and $n$ is the sample size.

A $t$-statistic may be used for one sample, two samples (with a pooled or unpooled standard deviation), or for a regression $t$-test. The formula to calculate a $t$-statistic for a one-sample $t$-test is as follows:

$t = \dfrac{\bar{x} - \mu_0}{s/\sqrt{n})}$

where $\bar{x}$ is the sample mean, $\mu$ is the population mean, $s$ is the sample standard deviation, and $n$ is the sample size.

$F$-tests (analysis of variance, also called ANOVA) are used when there are more than two groups. They are commonly used when deciding whether groupings of data by category are meaningful. If the variance of test scores of the left-handed in a class is much smaller than the variance of the whole class, then it may be useful to study lefties as a group. The null hypothesis is that two variances are the same, so the proposed grouping is not meaningful.

[ edit ]
Edit this content
Prev Concept
Quantitative or Qualitative Data?
Was the Result Significant?
Next Concept
Subjects
  • Accounting
  • Algebra
  • Art History
  • Biology
  • Business
  • Calculus
  • Chemistry
  • Communications
  • Economics
  • Finance
  • Management
  • Marketing
  • Microbiology
  • Physics
  • Physiology
  • Political Science
  • Psychology
  • Sociology
  • Statistics
  • U.S. History
  • World History
  • Writing

Except where noted, content and user contributions on this site are licensed under CC BY-SA 4.0 with attribution required.