Personal tools
You are here: Home / Publications / Testing the statistical significance of microsimulation results: often easier than you think. A technical note

Skip to content. | Skip to navigation

Testing the statistical significance of microsimulation results: often easier than you think. A technical note

Goedemé, Tim; van den Bosch, Karel; Salanauskaite, Lina; & Verbist, Gerlinde. (2013). Testing the statistical significance of microsimulation results: often easier than you think. A technical note. EUROMOD Working Paper Series. Institute for Social and Economic Research (ISER) University of Essex.

Goedemé, Tim; van den Bosch, Karel; Salanauskaite, Lina; & Verbist, Gerlinde. (2013). Testing the statistical significance of microsimulation results: often easier than you think. A technical note. EUROMOD Working Paper Series. Institute for Social and Economic Research (ISER) University of Essex.

Octet Stream icon 2187.ris — Octet Stream, 1 kB (1,557 bytes)

In the microsimulation literature, it is still uncommon to test the statistical significance of results. In this paper we argue that this situation is both undesirable and unnecessary. Provided the parameters used in the microsimulation are exogenous, as is often the case in static microsimulation of the first-order effects of policy changes, simple statistical tests can be sufficient. Moreover, standard routines have been developed which enable applied researchers to calculate the sampling variance of microsimulation results, while taking the sample design into account, even of relatively complex statistics such as relative poverty, inequality measures and indicators of polarization, with relative ease and a limited time investment. We stress that when comparing simulated and baseline variables, as well as when comparing two simulated variables, it is crucial to take account of the covariance between those variables. Due to this covariance, the mean difference between the variables can generally (though not always) be estimated with much greater precision than the means of the separate variables.




RPRT

EUROMOD Working Paper Series


Goedemé, Tim
van den Bosch, Karel
Salanauskaite, Lina
Verbist, Gerlinde



2013




18/13





Institute for Social and Economic Research (ISER) University of Essex


18/13




2187