Saturday, 2 March 2019

Advantages and Disadvantages of Logistic Regression in Machine Learning

Logistic Regression Model is a generalized form of Linear Regression Model. It is a very good Discrimination Tool. Following are the advantages and disadvantage of Logistic Regression:

Advantages of Logistic Regression

1. Logistic Regression performs well when the dataset is linearly separable.

2. Logistic regression is easier to implement, interpret and very efficient to train. 

3. Logistic regression is less prone to over-fitting.

4. Logistic Regression is well suited while dealing with high dimensional data. You should consider Regularization (L1 and L2) techniques to avoid over-fitting while handling high dimensional features.

5. The Logistic Regression not only gives a measure of how relevant a predictor is (coefficient size) but also its direction of association (positive or negative).

Disadvantages of Logistic Regression

1. Main limitation of Logistic Regression is the assumption of linearity between the dependent variable and the independent variables. In the real world, the data is rarely linearly separable. Most of the time data would be a jumbled mess.

2. If number of data objects are less than the number of features, Logistic Regression should not be used.

3. Logistic Regression can only be used to predict discrete functions. Therefore, the dependent variable of Logistic Regression is restricted to the discrete number set. This restriction itself is problematic, as it is prohibitive to the prediction of continuous data.

No comments:

Post a Comment