Course module
⬇ Download PDF
01 / 01
No reading today

Four tables you have already met

Session 02 · Hanson and Sigman

Tables 4 and 5 test whether Capacity predicts development outcomes once wealth is held constant.

Session 05 · Cheibub and Limongi

Table 3 gives the yearly chance that a democracy breaks down, by regime, party system and coalition.

Session 06 · Carey and Hix

Tables 1 and 2 relate district magnitude to four outcomes, with and without country fixed effects.

Session 08 · Gilens and Page

Table 3 sets average citizens, economic elites and interest groups against each other.

Session 08 kept the coefficients rough. Today we read every line.

Ordinary least squares

What a regression does

Y = a + bX + errorThe points are invented

+2 IN X +1.03 IN Y INTERCEPT 1.93 RESIDUAL X Y
  1. OLS draws the straight line that makes the squared vertical gaps between points and line, the residuals, as small as possible.
  2. The slope is the coefficient. Here one more unit of X goes with about .52 more units of Y. The intercept is the constant, the predicted Y where X is zero.
  3. With several predictors, OLS fits all the slopes at once. Each coefficient is then the slope of its own X with the other predictors held constant.

Hanson and Sigman's and Carey and Hix's tables come from OLS. Every coefficient in them is a slope of this kind.

Coefficients

Say it as a sentence

One more unit of X goes with β more units of Y, the other predictors held constant

Hanson and Sigman · −12.15

One more point of Capacity in 1960, about one standard deviation, goes with about 12 fewer infant deaths per 1,000 births in 2010.

Carey and Hix · .01

"A jump from a median magnitude of 1 to 10 is expected to boost the fragmentation index by one-tenth of a unit."

Gilens and Page · .76

The predictors are transformed and squeezed into a 0 to 1 range. The authors call the magnitudes "difficult to interpret" and report predicted probabilities instead.

Check the units on both sides before you translate. When the units are opaque, look for predicted values.

Hypothesis tests

Is the coefficient far from zero?

Hanson and Sigman, Table 5, column 1

−1.96 0 1.96 2.5% 2.5% CAPACITY −3.88 DEMOCRACY −1.27 t IF THE TRUE COEFFICIENT WERE ZERO
  1. Start from the null hypothesis that the true coefficient is zero.
  2. Divide the coefficient by its standard error. The result, t, counts how many standard errors the estimate sits from zero.
  3. The p-value is the chance of a t at least this far out if the null were true. Below .05, the null is rejected and the table adds a star.

Capacity sits 3.88 standard errors from zero, Democracy only 1.27 (p ≈ .2). The p-value says how surprising the estimate would be under the null.

Two ways to be wrong

Type I and Type II errors

No real effectA real effect
Star, null rejectedType I error · false positiveCorrect
No starCorrectType II error · false negative
Type I

The cut-off, called α, sets its rate. At .05, one test in twenty of a true null earns a star by chance. Hanson and Sigman's Table 5 runs 24 tests.

Type II

Its rate, called β, rises with smaller effects, noisier data and fewer cases. Power, 1 − β, is the chance of catching an effect that is there.

The trade-off

A stricter cut-off such as .01 buys fewer false positives with more false negatives. With 1,779 cases, Gilens and Page have the power to star a correlation of .12.

Democracy's −9.40 across 148 countries could be a real effect the test was too weak to detect. A missing star is weak evidence when power is low.

Confidence intervals

What 95 percent means

20 invented samples, one interval each

MISSES TRUE COEFFICIENT
  1. Go 1.96 standard errors either side of the coefficient. Two is close enough for reading in your head.
  2. The 95 percent describes the method. Across repeated samples, 19 of every 20 intervals built this way contain the true coefficient.
  3. Interval and test agree. A 95 percent interval that excludes zero means p < .05 for that coefficient.

Hanson and Sigman's Capacity runs from about −18 to −6 deaths per 1,000. An interval shows the size and the precision of an effect at once.

Control variables

What holding constant does

Gilens and Page, Tables 2 and 3

AVERAGE CITIZENS ECONOMIC ELITES POLICY ADOPTED ALONE .64 WITH ELITES .03 WITH CITIZENS .76 r = .78
  1. Model 1 asks whether policies citizens favor pass more often. Model 4 asks whether citizens' views still matter among policies that the affluent and the groups rate the same.
  2. Leaving out a variable that shapes both the predictor and the outcome biases the coefficient. Model 1 credits citizens with the pull of the affluent, who agree with them and drive adoption.
  3. A control that is itself a result of the predictor soaks up part of its effect. Ask when each control was measured.

Hanson and Sigman call their controls for wealth, democracy and taxes "a very challenging test." Ask what each control takes away.

Interaction terms

When slopes differ by group

Y = a + b₁X + b₂D + b₃X×DInvented example · Y = 3 + .3X − 2D + .6X×D

D = 0 D = 1 SLOPE b₁ = .3 SLOPE b₁ + b₃ = .3 + .6 b₂ = −2 AT X = 0 X Y
  1. Without the product term, OLS gives both groups the same slope and the lines run parallel.
  2. With it, b₁ is the slope of X where D = 0, and b₁ + b₃ is the slope where D = 1.
  3. b₂ is the gap between the groups at X = 0. Here D = 1 starts 2 lower and ends higher, so b₂ alone misleads.

D could be a regime type and X a level of party fragmentation. Read b₁ and b₃ together.

Cheibub and Limongi · Interaction terms

When does a coalition help?

Presidential democracies · yearly chance of breakdown, percent

Effective partiesNo coalitionCoalitionDifference
3.5 to 4.53.8511.32+7.47
Above 4.55.553.39−2.16

Breakdown = 3.85 + 7.47 C + 1.70 H − 9.63 C×HC = coalition government · H = more than 4.5 effective parties

  1. "It seems to be the level of party fractionalization that determines the effect of coalition formation on the survival of presidential democracies."
  2. The interaction term, −9.63, is the gap between the two differences, the b₃ of the last slide.
  3. With an interaction in the model, +7.47 is the effect of a coalition only where H is zero. Where H is one, the effect is 7.47 − 9.63 = −2.16.

The regression line is our arithmetic on Table 3. With an interaction, read the main effects together with it.

Carey and Hix · Table 2

Fixed effects in Carey and Hix

Outcome · effective number of parties by seats

(9) Pooled(11) Country fixed effects
Median district magnitude.01***(.002).003(.006)
Legal threshold, percent−.02(.03)−.34***(.09)
Mixed-member compensatory.44***(.14)1.62***(.34)
Latitude, colonial past, regionControlledAbsorbed
R².31.18 within
  1. Model 9 compares countries with each other. Model 11 compares each country with itself, so only electoral reforms count.
  2. Latitude, colonial past and region never change inside a country, so they drop out of Model 11.
  3. Reforms are rare, so standard errors grow. Magnitude shrinks and loses its stars, and legal thresholds gain theirs.

Legal thresholds show no link across countries and a clear one within them. Ask which comparison answers your policy question.

Take-away

Six questions for any table

  1. What is the outcome, and in what units?
  2. What does one unit of each predictor mean?
  3. How wide is the interval, and does it include zero?
  1. Could a star be a false positive, or a missing star a false negative?
  2. What is held constant, and was any control measured after the predictor?
  3. Does the comparison run across cases, within them, or only under some condition?

Complement 01 asked whether a number measures what it claims. Today's questions assume it does.

Next up

Before Thursday 19 November

Week 10. Welfare states and redistribution.

Read

Iversen, Torben, and David Soskice. 2006. "Electoral Institutions and the Politics of Coalitions: Why Some Democracies Redistribute More Than Others." American Political Science Review 100(2), 165-181.

Read · new

Lupu, Noam, and Jonas Pontusson. 2011. "The Structure of Inequality and the Politics of Redistribution." American Political Science Review 105(2), 316-336.

  1. Quiz 4 opens the class. It covers Weeks 07 and 09.
  2. Complement on exam reviewM2170
  3. Complement on hypotheses and how they are evaluatedM2170