Share this page on your website:

Don't miss these related articles:

Let us first consider an experiment where two samples are measured and their means are found to be different. Now this may happen due to two reasons- either the populations have different means or the populations have the same mean, but the difference may be due to the randomness in drawing the samples.

P-value is a measure of how much evidence we have against the null hypothesis.

The most important thing to remember about p-value is that it is used to test hypotheses.

It is a measure of how much evidence we have against the null hypothesis, which is the hypothesis of no change or no difference. The smaller the p-value, the more evidence we have against the null hypothesis.

Very often, a p-value less than 0.05 leads us to conclude that there is evidence against the null hypothesis and we say that we reject the same at 5%. A p-value less than 0.01 will under normal circumstances mean that there is substantial evidence against the null hypothesis.

P-values may either be one-tailed or two-tailed. A one-tail p-value is used when we can predict which group will have the larger mean even before collecting any data.

But if the other group ends up with the larger mean, we should attribute that difference to chance, even if the difference is large. For this reason it is usually best to use a two-tail p-value as such a situation leads us to conclude that the difference is not statistically significant.

This can be avoided by using two-tail p-values from the very beginning. Also a two-tail p-value is more consistent with the p-values reported by tests which compare three or more groups.

The main disadvantage of a p-value is that it is commonly misinterpreted. Many people misunderstand what question p-value answers.

For instance, if the p-value is 0.03, then what it means is that there is a 3% chance of observing a difference as large as observed in the particular experiment between the sample means even if the population means are identical.

It does not, in any way imply that there is a 97% chance that the differences observed is due to real differences between populations and a 3% chance that the difference is due to chance.

Simply put, it means that if population means are identical then randomness in sampling would lead to smaller differences between sample means than we observed in 97% of experiments and larger differences in 3% of experiments.

So, it simply refers to the percentages of experiments in which the sample differences would be larger or smaller than we observed.

There are certain do's and don'ts that should be kept in mind while using p-values.

The p-value should not be interpreted as the probability that the null hypothesis is true. A hypothesis is not a random event that can have a probability. We do not predict the happening of a hypothesis.

Rather, we try to infer whether it is true or not. We should be cautious while dealing with a small p-value. Also, a large p-value should not be taken as evidence in support of the null hypothesis as an inadequate sample size may have resulted in such a value.

Search over 500 articles on psychology, science, and experiments.

How to cite this article:

Explorable.com (Jun 23, 2009). P-Value. Retrieved Sep 29, 2016 from Explorable.com: https://explorable.com/p-value

Don't miss these related articles:

Subscribe / Share

- Subscribe to our RSS Feed
- Like us on Facebook
- Follow us on Twitter
- Founder:
- Oskar Blakstad Blog
- Oskar Blakstad on Twitter

Explorable.com - Copyright © 2008-2016. All Rights Reserved.