Main Page

From ReplicationWiki
Jump to: navigation, search
3,049 articles
Slide1.png
Slide2.png
Slide3.png
Slide4.png
Slide5.png
Slide6.png
Slide7.png
Slide8.png
Slide9.png
Slide10.png
Slide11.png

About the project

For scientific progress, it is pivotal to review research findings by independently replicating results, thus making the findings more reliable. However, in econometric research, it is not yet common practice to publish replication findings. This wiki serves as a database of empirical studies, the availability of replication material for them and of replication studies. It can help teaching replication to students. Seminars at several faculties internationally were already taught for which the information of this database was used.
So far the focus has been on some leading journals in economics. Replication results can be published as replication working papers of the University of Göttingen's Center for Statistics.
Teaching and providing access to information will raise awareness for the need for replications, provide a basis for research about the reasons why replications so often fail and how this can be changed, and educate future generations of economists about how to make research replicable. The starting phase of this project was funded by the Institute for New Economic Thinking (INET).

Join the project

You can join the project by entering a new replication or empirical studies that could be replicated. For the latter you can vote which ones you find most relevant to be replicated. Furthermore, you can improve the articles in the wiki and make comments. Under current events you can announce news and upcoming events. The community portal lists open tasks and suggestions for the wiki.

Latest replication

News

The American Journal of Political Science publishes Guidelines for Preparing Replication Files and announces that "submitted replication materials will be verified" by the University of North Carolina’s Odum Institute for Research in Social Science "to guarantee that they do, in fact, properly reproduce the analysis results". March 26, 2015.

The 3ie Replication Programme accepts expressions of interest for its call on replications on HIV prevention until May 31, 2015.

Working paper: "The Meaning of Failed Replications: A Review and Proposal" by Michael Clemens, April 9, 2015 - response: "Replication Talk Costs Lives: Why are economists so concerned about the reputational effects of replications?" by Richard Palmer-Jones, April 24, 2015

Working paper: "Pre Analysis Plans Help (only) when Replications are Infeasible" by Lucas C. Coffman and Muriel Niederle, February 14, 2015

Agenda for Open Research calls for reviewers to, "beginning January 1, 2016, [...] make open practices a pre-condition for more comprehensive review."

Since during the 2014 Research Transparency Forum of the Berkeley Initiative for Transparency in the Social Sciences we received the valuable feedback that our traffic lights could be misinterpreted as a judgment on quality of the studies we now changed the red one to a warning triangle. Feel free to discuss!

RePEc bibliography on replication started

Article "The Need for Replications" in Public Finance Review by James Alm and W. Robert Reed in special issue with replications

ideas/RePEc now links back to studies of ReplicationWiki

Quality evidence for policymaking: I’ll believe it when I see the replication - 3ie Replication Paper (3ie Replication Programme Candidate Studies List for impact evaluations now integrated in the ReplicationWiki)

Article about unreliable research - The Economist

Paper about Teaching Replication in Quantitative Empirical Economics - updated for Econometric Society European Meeting - 28th August 2014

INET blog: Economics needs replication

Working paper online: Replication in the narrow sense of Banzhaf/Walsh (2008)

Working paper online: Narrow Replication of Ashcraft (2005): Are Banks Really Special?

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox