what is the difference between collinearity and interaction?

I cannot differentiate clearly between “interaction” and “collinearity” in multiple linear regression. For me these terms are related but not the same.

I have searched the forum but could not find the answer. Please share your answer if you have. If you know there is an answer somewhere in the forum for this kind of question, please share the link.

Answer

An interaction may arise when considering the relationship among three or more variables, and describes a situation in which the simultaneous influence of two variables on a third is not additive. Most commonly, interactions are considered in the context of regression analyses.

The presence of interactions can have important implications for the interpretation of statistical models. If two variables of interest interact, the relationship between each of the interacting variables and a third “dependent variable” depends on the value of the other interacting variable. In practice, this makes it more difficult to predict the consequences of changing the value of a variable, particularly if the variables it interacts with are hard to measure or difficult to control.


Collinearity is a statistical phenomenon in which two or more predictor variables in a multiple regression model are highly correlated, meaning that one can be linearly predicted from the others with a non-trivial degree of accuracy. In this situation the coefficient estimates of the multiple regression may change erratically in response to small changes in the model or the data. Collinearity does not reduce the predictive power or reliability of the model as a whole, at least within the sample data themselves; it only affects calculations regarding individual predictors. That is, a multiple regression model with correlated predictors can indicate how well the entire bundle of predictors predicts the outcome variable, but it may not give valid results about any individual predictor, or about which predictors are redundant with respect to others.


Bottom line: Interactions don’t imply collinearity and collinearity does not imply there are interactions.

Attribution
Source : Link , Question Author : qocande , Answer Author : Dan

Leave a Comment