What threats to validity are inherent in the research design and how may these be overcome

Details[ edit ] Inferences are said to possess internal validity if a causal relation between two variables is properly demonstrated. In this example, the researcher wants to make a causal inference, namely, that different doses of the drug may be held responsible for observed changes or differences. When the researcher may confidently attribute the observed changes or differences in the dependent variable to the independent variable, and when the researcher can rule out other explanations or rival hypothesesthen the causal inference is said to be internally valid. Internal validity, therefore, is more a matter of degree than of either-or, and that is exactly why research designs other than true experiments may also yield results with a high degree of internal validity.

O3 O4 This design controls for all of the seven threats to validity described in detail so far. An explanation of how this design controls for these threats is below. History--this is controlled in that the general history events which may have contributed to the O1 and O2 effects would also produce the O3 and O4 effects.

This is true only if the experiment is run in a specific manner--meaning that you may not test the treatment and control groups at different times and in vastly different settings as these differences may effect the results. Rather, you must test simultaneously the control and experimental groups.

Intrasession history must also be taken into consideration. For example if the groups truly are run simultaneously, then there must be different experimenters involved, and the differences between the experimenters may contribute to effects.

A solution to history in this case is the randomization of experimental occasions--balanced in terms of experimenter, time of day, week and etc. Maturation and testing--these are controlled in that they are manifested equally in both treatment and control groups.

Internal validity - Wikipedia

Instrumentation--this is controlled where conditions control for intrasession history, especially where fixed tests are used. However when observers or interviewers are being used, there exists a potential for problems. If there are insufficient observers to be randomly assigned to experimental conditions, the care must be taken to keep the observers ignorant of the purpose of the experiment.

Regression--this is controlled by the mean differences regardless of the extremety of scores or characteristics, if the treatment and control groups are randomly assigned from the same extreme pool. If this occurs, both groups will regress similarly, regardless of treatment.

Selection--this is controlled by randomization.

Social Research Methods - Knowledge Base - Threats to Construct Validity

Mortality--this was said to be controlled in this design, however upon reading the text, it seems it may or may not be controlled for. Unless the mortality rate is equal in treatment and control groups, it is not possible to indicate with certainty that mortality did not contribute to the experiment results.

Even when even mortality actually occurs, there remains a possibility of complex interactions which may make the effects drop-out rates differ between the two groups.

Conditions between the two groups must remain similar--for example, if the treatment group must attend treatment session, then the control group must also attend sessions where either not treatment occurs, or a "placebo" treatment occurs.

However even in this there remains possibilities of threats to validity. For example, even the presence of a "placebo" may contribute to an effect similar to the treatment, the placebo treatment must be somewhat believable and therefore may end up having similar results!

The factors described so far effect internal validity. These factors could produce changes which may be interpreted as the result of the treatment. These are called main effects which have been controlled in this design giving it internal validity. However, in this design, there are threats to external validity also called interaction effects because they involve the treatment and some other variable the interaction of which cause the threat to validity.Selection biases and external validity.

Since one of the main goals of dissertations that adopt quantitative research designs is to make generalisations from the sample being studied to (a) the population the sample is drawn from, and (b) in some cases, across populations, selection biases are arguably one of the most significant threats to external validity.

This design controls for all of the seven threats to validity described in detail so far.

What threats to validity are inherent in the research design and how may these be overcome

An explanation of how this design controls for these threats is below. History --this is controlled in that the general history events which may have contributed to the O 1 and O 2 effects would also produce the O 3 and O 4 effects.

•Development of a research design •Choice of data collection techniques Threats to Internal Validity Threats to external validity Threats to External Validity •Reactive effects of testing •Observations meeting these criteria may still lead to unwarranted conclusions Data analysis Data Analysis.

Construct validity is the quality of choices about the particular forms of the independent and dependent variables. These choices will affect the quality of research findings. Threats to construct validity can arise from the choice of treatment (the operationalization of the IV, and the.

Threats to validity of Research Design.

Inadequate Preoperational Explication of Constructs

An explanation of how this design controls for these threats is below. The factors described so far affect internal validity. These factors could produce changes, which may be interpreted as the result of the treatment. These cohort studies combine elements of observational and experimental research methods.

Quasi-experimental designs are similar to experimental designs in that there is a specific investigator-defined intervention for the “exposed” group in the study, but individuals are .

What threats to validity are inherent in the research design and how may these be overcome
Social Research Methods - Knowledge Base - Threats to Construct Validity