Explorable.com 206.1K reads

Share this page on your website:

Don't miss these related articles:

- 1Statistical Hypothesis Testing
- 2Relationships
- 3Correlation
- 4Regression
- 5Student’s T-Test
- 6ANOVA
- 7Nonparametric Statistics
- 8Other Ways to Analyse Data

More precisely, multiple regression analysis helps us to predict the value of Y for given values of X_{1}, X_{2}, …, X_{k}.

For example the yield of rice per acre depends upon quality of seed, fertility of soil, fertilizer used, temperature, rainfall. If one is interested to study the joint affect of all these variables on rice yield, one can use this technique.

An additional advantage of this technique is it also enables us to study the individual influence of these variables on yield.

By multiple regression, we mean models with just one dependent and two or more independent (exploratory) variables. The variable whose value is to be predicted is known as the dependent variable and the ones whose known values are used for prediction are known independent (exploratory) variables.

In general, the multiple regression equation of Y on X_{1}, X_{2}, …, X_{k} is given by:

Y = b

_{0}+ b_{1}X_{1}+ b_{2 }X_{2}+ …………………… + b_{k}X_{k}

Here b_{0} is the intercept and b_{1}, b_{2}, b_{3}, …, b_{k} are analogous to the slope in linear regression equation and are also called regression coefficients. They can be interpreted the same way as slope. Thus if b_{i} = 2.5, it would indicates that Y will increase by 2.5 units if X_{i} increased by 1 unit.

The appropriateness of the multiple regression model as a whole can be tested by the F-test in the ANOVA table. A significant F indicates a linear relationship between Y and at least one of the X's.

Once a multiple regression equation has been constructed, one can check how good it is (in terms of predictive ability) by examining the coefficient of determination (R2). R2 always lies between 0 and 1.

R

_{2}- coefficient of determination

All software provides it whenever regression procedure is run. The closer R_{2} is to 1, the better is the model and its prediction.

A related question is whether the independent variables individually influence the dependent variable significantly. Statistically, it is equivalent to testing the null hypothesis that the relevant regression coefficient is zero.

This can be done using t-test. If the t-test of a regression coefficient is significant, it indicates that the variable is in question influences Y significantly while controlling for other independent explanatory variables.

Multiple regression technique does not test whether data are linear. On the contrary, it proceeds by assuming that the relationship between the Y and each of X_{i}'s is linear. Hence as a rule, it is prudent to always look at the scatter plots of (Y, X_{i}), i= 1, 2,…,k. If any plot suggests non linearity, one may use a suitable transformation to attain linearity.

Another important assumption is non existence of multicollinearity- the independent variables are not related among themselves. At a very basic level, this can be tested by computing the correlation coefficient between each pair of independent variables.

Other assumptions include those of homoscedasticity and normality.

Multiple regression analysis is used when one is interested in predicting a continuous dependent variable from a number of independent variables. If dependent variable is dichotomous, then logistic regression should be used.

Full reference:

Explorable.com (Jun 18, 2009). Multiple Regression Analysis. Retrieved Oct 17, 2017 from Explorable.com: https://explorable.com/multiple-regression-analysis

Search over 500 articles on psychology, science, and experiments.

Don't miss these related articles:

- 1Statistical Hypothesis Testing
- 2Relationships
- 3Correlation
- 4Regression
- 5Student’s T-Test
- 6ANOVA
- 7Nonparametric Statistics
- 8Other Ways to Analyse Data

Subscribe / Share

- Subscribe to our RSS Feed
- Like us on Facebook
- Follow us on Twitter
- Founder:
- Oskar Blakstad Blog
- Oskar Blakstad on Twitter

Explorable.com - 2008-2017

You are free to copy, share and adapt any text in the article, as long as you give *appropriate credit* and *provide a link/reference* to this page.