Political Analysis, 11:3
© 2003 by the Society for Political Methodology
Replication with Attention to Numerical Accuracy
Harvard-MIT Data Center Harvard University, Cambridge, MA 02138 e-mail: micah_altman{at}harvard.edu
Department of Public and International Affairs, George Mason University, 4400 University Drive3F4, Fairfax, VA 22030-4444 e-mail: mmcdona5{at}gmu.edu
Numerical issues matter in statistical analysis. Small errors occur when numbers are translated from paper and pencil into the binary world of computers. Surprisingly, these errors may be propagated and magnified through binary calculations, eventually producing statistical estimates far from the truth. In this replication and extension article, we look at one method of verifying the accuracy of statistical estimates by running these same data and models on multiple statistical packages. We find that for two published articles, Nagler (1994, American Journal of Political Science 38:230255) and Alvarez and Brehm (1995, American Journal of Political Science 39:10551089), results are dependent on the statistical package used. In the course of our replications, we uncover other pitfalls that may prevent accurate replication, and make recommendations to ensure the ability for future researchers to replicate results.