1.5 Two approaches to RQs

RQs can be approached in one of two ways:

  • For estimation (confidence intervals): These RQs are concerned with, for example, estimating a value in a population. This value may be the size of a difference (probably a RQ with a Comparison), or strength of a relationship (probably a RQ with a Connection).
  • For making decisions (hypothesis testing): These RQs are concerned with making a decision about an unknown population value: for example, is the percentage the same in two different groups of the population?

Lemma 1.7 (RQ type) What approach do these RQs take: Decision-making, or Estimation?

  1. Among Australian upper-limb amputees, is the percentage wearing prosthesis 'all the time' the same for transradial and transhumeral amputations? (Davidson 2002)
  2. In New York, what is the difference between the average height of oaks trees (ten weeks after planting) comparing trees planted in a concrete sidewalk and a grassed sidewalk? (Grabosky and Bassuk 2016)
  3. What is the average response time of paramedics to emergency calls? (Pons et al. 2005)
  4. Is there a relationship between the average weekly hours of physical activity in children and the weekly maximum temperature? (Edwards et al. 2015)
1: Decision making; 2: Estimation; 3: Estimation; 4: Decision making.

1.5.1 Estimation: Confidence intervals questions

Sometimes, the RQ concerns how precisely a value in the population is estimated by the sample. This value may measure a difference, or the strength of a relationship.

These types of RQs are studied in more depth later on in this subject.

Example 1.19 (Estimation RQs) Consider this RQ (based on Barrett et al. (2010)):

Among Australian teens with a common cold, how much shorter are cold symptoms, on average, for teens taking a daily dose of echinacea compared to teens taking no medication?

This RQ asks about size of the difference (in the population) between the average duration of cold symptoms.

Only sample data are available, and there may be no difference (on average) at all in the population.

1.5.2 Making decisions: Hypothesis testing questions

Sometimes, RQs are not about the precision with which a population value is estimated by the sample, but instead about deciding if a difference or a relationship exists in the population.

These RQs often are associated with hypotheses: statements that suggest possible answers to the RQ. Based on the sample, the hypothesis best supported by the data is to be chosen.

These types of RQs are studied in more depth later on in this subject.

Example 1.20 (Making decisions with samples) Consider this RQ (based on Barrett et al. (2010)):

Among Australian teens with a common cold, is the average duration of cold symptoms shorter for teens taking a daily dose of echinacea compared to teens taking no medication?

This is a decision-type RQ, with two possible answers (Fig. 1.3): Either echinacea does result in shorter average cold durations, or it doesn't. In practice the answer is rarely clear cut, and instead how much evidence there is in the sample to support a particular hypothesis about the population is reported.

Evidence may support or contradict a hypothesis; evidence rarely proves a hypothesis (at least, without any other support, such as theortical support). Ultimately, after collecting data from a sample, a decision must be made about which explanation about the population is more consistent with the data collected.
Two possible answers to the RQ about echinacea

Figure 1.3: Two possible answers to the RQ about echinacea

References

Barrett, Bruce, Roger Brown, Dave Rakel, Marlon Mundt, Kerry Bone, Shari Barlow, and Tola Ewers. 2010. “Echinacea for Treating the Common Cold: A Randomized Trial.” Annals of Internal Medicine 153 (12): 769–77.
Davidson, Judith. 2002. “A Survey of the Satisfaction of Upper Limb Amputees with Their Prostheses, Their Lifestyles, and Their Abilities.” Journal of Hand Therapy 15 (1): 62–70.
Edwards, Nicholas M., Gregory D. Myer, Heidi J. Kalkwarf, Jessica G. Woo, Philip R. Khoury, Timothy E. Hewett, and Stephen R. Daniels. 2015. “Outdoor Temperature, Precipitation, and Wind Speed Affect Physical Activity Levels in Children: A Longitudinal Cohort Study.” Journal of Physical Activity and Health 12 (8): 1074–81.
Grabosky, J., and N. Bassuk. 2016. “Seventeen Years’ Growth of Street Trees in Structural Soil Compared with a Tree Lawn in New York City.” Urban Forestry & Urban Greening 16: 103–9.
Pons, Peter T., Jason S. Haukoos, Whitney Bludworth, Thomas Cribley, Kathryn A. Pons, and Vincent J. Markovchick. 2005. “Paramedic Response Time: Does It Affect Patient Survival?” Academic Emergency Medicine 12 (7): 594–600.