Randomized Controlled Trials

In any research program, especially those using human subjects, these external factors can skew the results wildly and attempts by researchers to isolate and neutralize the influence of these variables can be counter-productive and magnify them.

Any experiment that relies upon selecting subjects and placing them into groups is always at risk if the researcher is biased or simply incorrect. The researcher may fail to take into account all of the potential confounding variables, causing severe validity issues.

The Advantage of Randomized Controlled Trials

Randomized controlled trials completely remove these extraneous variables without the researcher even having to isolate them or even be aware of them. Randomized experiment designs completely remove any accusations of conscious or subconscious bias from the researcher and practically guarantee external validity.

As an example, imagine that a school seeks to test whether introducing a healthy meal at lunchtime improves the overall fitness of the children. It decides to do this by giving half of the children healthy salads and wholesome meals, whilst the control group carries on as before. At regular intervals, the researchers note the cardiovascular fitness of the children, looking to see if it improves.

The number of extraneous factors and potential confounding variables for such a study is enormous. Age, gender, weight, what the children eat at home, and activity level are just some of the factors that could make a difference. In addition, if the teachers, generally a health-conscious bunch, are involved in the selection of children, they might subconsciously pick those who are most likely to adapt to the healthier regime and show better results. Such a pre-determined bias destroys the chance of obtaining useful results.

By using pure randomized controlled trials and allowing chance to select children into one of the two groups, it can be assumed that any confounding variables are cancelled out, as long as you have a large enough sample group.

The Disadvantages of Randomized Controlled Trials

Ideally, randomized controlled trials would be used for most experiments, but there are some disadvantages. Firstly, researchers often choose subjects because they do not have the resources, or time, to test larger groups, so they have to try to find a sample that is representative of the population as a whole. This select sampling means that it becomes very difficult to generalize the results to the population as a whole.

Secondly, randomized experiment designs, especially when combined with crossover studies, are extremely powerful at understanding underlying trends and causalities. However, they are a poor choice for research where temporal factors are an issue, for which a repeated measures design is better.

Whilst randomized controlled trials are regarded as the most accurate experimental design in the social sciences, education, medicine and psychology, they can be extremely resource heavy, requiring very large sample groups, so are rarely used. Instead, researchers sacrifice generalization for convenience, leaving large scale randomized controlled trials for researchers with bigger budgets and research departments.