5 Parameters estimation

  • Depending on the model type, an appropriate estimator which gives the “best” parameter estimates should be used

  • Commonly used estimator is the least squares estimator which originates from the OLS method (Ordinary Least Squares)

  • Other methods based on OLS have been developed: Weighted Least Squares WLS, Generalized Least Squares GLS, Two Step Least Squares 2SLS, etc.

  • In a bivariate model, OLS method is used to find the regression line that best fits the data points by minimizing residual sum of squares, hence the term “least squares”

  • When the OLS method cannot be applied analytically, it is recommended to use an alternative estimator, such as the Maximum Likelihood Estimator MLE

  • Both OLS and MLE provide the same parameter estimates if the normality assumption is met