21

I have the following linear regression:

import statsmodels.formula.api as sm

model = sm.ols(formula = 'a ~ b + c', data = data).fit()

I want to add a quadratic term for b in this model.

Is there a simple way to do this with statsmodels.ols?
Is there a better package I should be using to achieve this?

Andrea Blengino
  • 4,144
  • 22
  • 35
  • 57
datavoredan
  • 2,696
  • 6
  • 26
  • 41

3 Answers3

38

The simplest way is

model = sm.ols(formula = 'a ~ b + c + I(b**2)', data = data).fit()

The I(...) basically says "patsy, please stop being clever here and just let Python handle everything inside kthx". (More detailed explanation)

Community
  • 1
  • 1
Nathaniel J. Smith
  • 9,038
  • 4
  • 35
  • 46
  • Doesn't work in Statsmodels 0.21.1: says "patsy.PatsyError: Error evaluating factor: ValueError: no field of name `I`" – ForceBru Jan 31 '21 at 15:17
35

Although the solution by Alexander is working, in some situations it is not very convenient. For example, each time you want to predict the outcome of the model for new values, you need to remember to pass both b**2 and b values which is cumbersome and should not be necessary. Although patsy does not recognize the notation "b**2", it does recognize numpy functions. Thus, you can use

import statsmodels.formula.api as sm
import numpy as np

data = {"a":[2, 3, 5], "b":[2, 3, 5], "c":[2, 3, 5]}
model = sm.ols(formula = 'a ~ np.power(b, 2) + b + c', data = data).fit()

In this way, latter, you can reuse this model without the need to specify a value for b**2

model.predict({"a":[1, 2], "b":[5, 2], "c":[2, 4]})
Christian O'Reilly
  • 1,469
  • 2
  • 15
  • 29
  • I know I'm late to the party here, but what does the tilde `~` mean in `formula = 'a ~ np.power(b, 2) + b + c'`? – Jim421616 Dec 09 '18 at 23:41
  • 1
    @Jim421616 like in R programming language, the `~` means that `a` is a linear combination of `np.power(b, 2) + b + c` – Hemerson Tacon Feb 25 '19 at 01:53
1

This should work:

data['b2'] = data.b ** 2
model = sm.ols(formula = 'a ~ b2 + b + c', data=data).fit()
Alexander
  • 87,529
  • 23
  • 162
  • 169
  • do you know if this depends on a certain version? for me the b**2 term is just skipped – datavoredan Aug 13 '15 at 03:38
  • Creating a design matrix from the formulas is done by patsy and will be independent of the statsmodels version. (I don't know how patsy treats the power operation in a formula.) – Josef Aug 13 '15 at 04:34