1.7 The importance of design

Choosing the type of study is only a small part of research design. Planning the data collection process, and actually collecting the data, is still required. Data may be obtained by:

Using data already available: This is called secondary data.
Collecting new data: This is called primary data.

Either way, knowing how the data are obtained is important. The design phase is concerned with planning the best way to obtaining the data to ensure the study is internally and externally valid, as far as possible.

External validity considerations include:

Sampling: Since we can't study the whole population, who or what do we study in the population? And how many do we need to study? (We need to learn more before we can answer these critical questions.)

Internal validity considerations include:

What else might influence the values of the response variable, apart from the explanatory variable? (Next topic)
Effectiveness: How can the study be designed effectively to maximise internal validity? (Next topic)
Data collection: How exactly will the data be collected? (Next topic)

Ethical issues must also be considered Previous topic, and the limitations of the study understood when the results are interpreted (Next topic).

The following short (humourous) video demonstrates the importance of understanding the design!