Therefore it is important to take steps to minimize the errors and also to understand them in order to be better able to understand the results of the experiment. This entails a study of the type and degree of errors in experimentation.
Statistical tests contain experimental errors that can be classified as either Type-I or Type-II errors. It is important to study both these effects in order to be able to manage error and report it, so that the conclusion of the experiment can be rightly interpreted.
Type I Error - False Positive
Type II Error - False Negative
Type I Error
The Type I error (α-error, false positives) occurs when a the null hypothesis (H0) is rejected in favor of the research hypothesis (H1), when in reality the 'null' is correct. This can be understood in terms of medical tests. For example, suppose there is a test that is used to detect a disease in a person. If a Type I error occurs in the test, it means that the test will say the person is suffering from that disease even though he is healthy.
Type II Error
Type II errors (β-errors, false negatives) on the other hand, imply that we reject the research hypothesis, when in fact it is correct. In the similar example of a medical test for a disease, if a Type-II error occurs, then it means that the test will not detect the disease in the person even though he is actually suffering from it.
In case of Type-I errors, the research hypothesis is accepted even though the null hypothesis is correct. Type-I errors are a false positive that lead to the rejection of the null hypothesis when in fact it may be true.
When a Type-II error occurs, the research hypothesis is not detected as the correct conclusion and is therefore passed off. In terms of the null hypothesis, this kind of an error might lead to accepting the null hypothesis when in fact it is false.
The significance level refers only to the Type-I error. This is because we ask the question "What is the probability that the correlation we observed is purely by chance?" and when this question yields an answer of below a significance level (typically 5% or 1%), we state that the result wasn't a chance process and that the parameters under study are indeed related.
Reason for Errors
Scientific experiments involve a different type of error analysis than a statistical experiment. In science, experimental errors may be caused due to human inaccuracies like a wrong experimental setup in a science experiment or choosing the wrong set of people for a social experiment.
Systematic error refers to that error which is inherent in the system of experimentation. For example, if you want to calculate the value of acceleration due to gravity by swinging a pendulum, then your result will invariably be affected by air resistance, friction at the point of suspension and finite mass of the thread.
Random errors occur because it is impossible to practically achieve infinite precision. Since the value is higher or lower in a random fashion, averaging several readings will reduce random errors.