Main Page

From ReplicationWiki
(Difference between revisions)
Jump to: navigation, search
m
 
(22 intermediate revisions by one user not shown)
Line 5: Line 5:
 
{| style="width:280px; border:none; background:none;"
 
{| style="width:280px; border:none; background:none;"
 
| style="width:280px; text-align:center; white-space:nowrap; color:#000;" |
 
| style="width:280px; text-align:center; white-space:nowrap; color:#000;" |
<div style="font-size:162%; border:none; margin:0; padding:.1em; color:#000;">Welcome to <br />[[Replication in Economics]]!
+
<div style="font-size:162%; border:none; margin:0; padding:.1em; color:#000;">Welcome to <br />[[Replication in economics|Replication in the social sciences, particularly economics]]!
 
</div>
 
</div>
 
<div id="articlecount" style="font-size:85%;">[[Special:Statistics|{{NUMBEROFARTICLES}}]] articles</div>
 
<div id="articlecount" style="font-size:85%;">[[Special:Statistics|{{NUMBEROFARTICLES}}]] articles</div>
Line 34: Line 34:
 
     <td width="19%" height="50" align="center" valign="top" bgcolor="#cedef7">'''Browse in {{PAGESINCAT:Journal}} [[:Category:Journal|journal]]s,<br/ >{{PAGESINCAT:Working paper series & blogs}} [[:Category:Working paper series & blogs|Working paper series & blogs]] and {{PAGESINCAT:Book}} [[:Category:Book|book]]s'''</td>
 
     <td width="19%" height="50" align="center" valign="top" bgcolor="#cedef7">'''Browse in {{PAGESINCAT:Journal}} [[:Category:Journal|journal]]s,<br/ >{{PAGESINCAT:Working paper series & blogs}} [[:Category:Working paper series & blogs|Working paper series & blogs]] and {{PAGESINCAT:Book}} [[:Category:Book|book]]s'''</td>
 
     <td width="17%" height="50" align="center" valign="top" bgcolor="#cedef7">'''Browse by [[:Category:Article methods and estimation|methods]],  [[:Category:Article software used|software]] used, [[:Category:Article JEL codes|JEL codes]], [[:Category:Article keywords|keywords]], [[:Category:Article authors|authors]], [[:Category:Article data type|data type]],<br/ >[[:Category:Geographical origin of data|geographical origin of data]], and [[:Category:Article data source|data source]]'''</td>
 
     <td width="17%" height="50" align="center" valign="top" bgcolor="#cedef7">'''Browse by [[:Category:Article methods and estimation|methods]],  [[:Category:Article software used|software]] used, [[:Category:Article JEL codes|JEL codes]], [[:Category:Article keywords|keywords]], [[:Category:Article authors|authors]], [[:Category:Article data type|data type]],<br/ >[[:Category:Geographical origin of data|geographical origin of data]], and [[:Category:Article data source|data source]]'''</td>
     <td width="4%" height="50" align="center" valign="top" bgcolor="#cedef7">'''Find one of {{#expr:{{PAGESINCAT:Replication}}+{{PAGESINCAT:Replication of more than one study}}+{{PAGESINCAT:Replication that was also replicated}}-2}} [[:Category:Replication |replication]]s and {{PAGESINCAT:Corrigendum}} [[:Category:Corrigendum|Corrections]]'''</td>
+
     <td width="10%" height="50" align="center" valign="top" bgcolor="#cedef7">'''Find one of {{#expr:{{PAGESINCAT:Replication}}+{{PAGESINCAT:Replication of more than one study}}+{{PAGESINCAT:Replication that was also replicated}}-2}} [[:Category:Replication |replication]]s, {{PAGESINCAT:Corrigendum}} [[:Category:Corrigendum|Corrections]]''' & '''{{PAGESINCAT:Retracted study}} [[:Category:Retracted study|Retraction]]'''</td>
 
     <td width="10%" height="50" align="center" valign="top" bgcolor="#cedef7">'''{{#formlink:form=New_Replication|link text=replication}}''' </td>
 
     <td width="10%" height="50" align="center" valign="top" bgcolor="#cedef7">'''{{#formlink:form=New_Replication|link text=replication}}''' </td>
 
     <td width="13%" height="50" align="center" valign="top" bgcolor="#cedef7">'''{{#formlink:form=New_Replicated_study|link text=replicated study}}''' </td>
 
     <td width="13%" height="50" align="center" valign="top" bgcolor="#cedef7">'''{{#formlink:form=New_Replicated_study|link text=replicated study}}''' </td>
Line 73: Line 73:
 
| style="color:#000; padding:2px 5px 5px" |  
 
| style="color:#000; padding:2px 5px 5px" |  
 
<div id="mp-tfa" style="width:55%; >For scientific progress, it is pivotal to review research findings by independently replicating results, thus making the findings more reliable. However, in econometric research, it is not yet common practice to publish replication findings. This wiki serves as a database of empirical studies, the availability of replication material for them and of replication studies. It can help teaching replication to students. Seminars at several faculties internationally were already taught for which the information of this database was used.<br>
 
<div id="mp-tfa" style="width:55%; >For scientific progress, it is pivotal to review research findings by independently replicating results, thus making the findings more reliable. However, in econometric research, it is not yet common practice to publish replication findings. This wiki serves as a database of empirical studies, the availability of replication material for them and of replication studies. It can help teaching replication to students. Seminars at several faculties internationally were already taught for which the information of this database was used.<br>
So far the focus has been on some leading journals in economics. Replication results can be published as [https://ideas.repec.org/s/stg/wpaper.html replication working papers] of the University of Göttingen's [http://www.uni-goettingen.de/en/420023.html Center for Statistics].<br/>Teaching and providing access to information will raise awareness for the need for replications, provide a basis for research about the reasons why replications so often fail and how this can be changed, and educate future generations of economists about how to make research replicable. The starting phase of this project was [https://www.ineteconomics.org/research/grants/replication-in-empirical-economics funded by the Institute for New Economic Thinking (INET)].<br/></div>
+
So far the focus has been on some leading journals in economics. Replication results can be published as [https://ideas.repec.org/s/stg/wpaper.html replication working papers] of the University of Göttingen's [http://www.uni-goettingen.de/en/420023.html Center for Statistics].<br/>Teaching and providing access to information will raise awareness for the need for replications, provide a basis for research about the reasons why replications so often fail and how this can be changed, and educate future generations of economists about how to make research replicable. The starting phase of this project was [https://www.ineteconomics.org/research/grants/replication-in-empirical-economics funded by the Institute for New Economic Thinking (INET)].<br/><br/>
 +
<big>'''Please cite as:'''</big><br/>
 +
If you mention the ReplicationWiki in your research, especially when you use data from it, do not forget to cite the study describing it: [http://www.dlib.org/dlib/march17/hoeffler/03hoeffler.html ReplicationWiki - Improving Transparency in the Social Sciences], by [[User:Jan H. Höffler|Jan H. Höffler]], ''[http://www.dlib.org/ D-Lib Magazine]'', March/April 2017, Volume 23, Number 3/4, doi: [https://doi.org/10.1045/march2017-hoeffler 10.1045/march2017-hoeffler].
 +
<br/></div>
 
|-
 
|-
 
! style="padding:2px;" |  
 
! style="padding:2px;" |  
Line 99: Line 102:
 
|-  
 
|-  
 
| style="color:#000; padding:2px 5px 5px;" | <div id="mp-otd">
 
| style="color:#000; padding:2px 5px 5px;" | <div id="mp-otd">
The journal [[:Category:Energy Economics]] posted a [http://www.journals.elsevier.com/energy-economics/call-for-papers/special-issue-on-replication-in-energy-economics call for contributions to a Special Issue on Replication in Energy Economics] (in which it mentions the ReplicationWiki). Submission deadline is July 2017.
+
A [https://www.fun-mooc.fr/courses/course-v1:inria+41016+session01bis/about MOOC on Reproducible Research] is offered by the [https://www.inria.fr/en/ French Institute for Research in Computer Science and Automation (INRIA)] in French and English from October 22  to December 19, 2018.  
  
[https://www.aeaweb.org/conference/2017/preliminary/1530?sessionType%5Bsession%5D=1&search_terms=replication Replication Session at the American Economic Association Annual Meeting], Chicago, USA, January 6-8, 2017
+
A session ''[http://tinyurl.com/y8kt66ak Openness and Integrity in Methods Teaching and Research] '', including a [http://tinyurl.com/yb5l559b talk that suggests to use the ReplicationWiki], was held at the [https://connect.apsanet.org/apsa2018/ American Political Sciences Assocation Annual Meeting ], August 30 – September 2, 2018, in Boston, USA.
  
[[Replication Session at the First Plenary Conference of the Institute for New Economic Thinking Young Scholars Initiative|Session on Replication]] during the [https://www.ineteconomics.org/events/ysi-plenary-budapest Institute for New Economic Thinking Young Scholar Initiative Plenary Conference, Budapest, Hungary, October 19-22, 2016]
+
[[3ie Replication Programme|3ie]] and the [https://www.ifad.org/ International Fund for Agricultural Development (IFAD)] are hosting an event on replication and research transparency on [http://www.3ieimpact.org/en/events/external-events/verifying-evidence-policymaking-assessing-financial-services-poo/ Programmes on financial services for the poor: what does the evidence say?] on April 23, 2018 in Rome, Italy.
  
[http://www.3ieimpact.org/en/funding/replication-window/replication-window-4-fcp/ 3ie funding for replication of evaluations of financial service interventions for the poor]: [http://www.3ieimpact.org/media/filer_public/2016/06/28/eoi-fsp-rw4.pdf?ct=t(RW4_FSP_launch6_28_2016)&mc_cid=c2f460d09e&mc_eid=%5bUNIQID%5d Deadline for submitting expressions of interest is 2 August 2016].
+
The journal [[:Category:Review of Development Finance|Review of Development Finance]] posted a [https://www.journals.elsevier.com/review-of-development-finance/call-for-papers/call-for-papers-reproducibility-studz call for Reproducibility Studies in Development Finance]. They plan to publish them regularly as well as in special issues.
  
Article [http://www.theatlantic.com/science/archive/2016/03/save-psychology-by-replicating-studies-before-theyre-published/475983/ How to Make Psychology Studies More Reliable], Ed Yong, The Atlantic, March 31, 2016
+
[http://www.airleap.org/ AIRLEAP] Conference “[http://www.airleap.org/SL_Conference_Flyer.pdf An Urgency for Evidence and Transparency in Economic Analysis and Policy], St Louis, USA, October 13th-14th had a [[AIRLEAP 2017 conference session on replication|session on replication in empirical economics]]
  
Letter "[http://dx.doi.org/10.1126/science.351.6280.1405-b A research symbiont]", Benedikt Fecher, Gert G. Wagner, Science, 25 Mar 2016.
+
The journal [[:Category:Energy Economics|Energy Economics]] posted a [http://www.journals.elsevier.com/energy-economics/call-for-papers/special-issue-on-replication-in-energy-economics call for contributions to a Special Issue on Replication in Energy Economics] (in which it mentions the ReplicationWiki). Submission deadline was July 2017.
  
Article [http://dx.doi.org/10.1126/science.aaf0918 Evaluating replicability of laboratory experiments in economics, Science,  25 March 2016]
+
[https://www.aeaweb.org/conference/2017/preliminary/1530?sessionType%5Bsession%5D=1&search_terms=replication Replication Session at the American Economic Association Annual Meeting], Chicago, USA, January 6-8, 2017
 
+
Article [http://dx.doi.org/10.1016/j.jesp.2015.10.001 The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline, Journal of Experimental Social Psychology,  available online since 24 March 2016, in press]
+
 
+
Article [http://www.economist.com/blogs/freeexchange/2016/01/fudging-hell Are results in top journals to be trusted?, S.K., The Economist, Jan 21st 2016]
+
 
+
Blog post [http://johnhcochrane.blogspot.com/2016/01/secret-data-encore.html Secret Data Encore by John Cochrane], January 5, 2016
+
 
+
[http://johnhcochrane.blogspot.com/2015/12/secret-data.html Secret Data by John Cochrane, December 28, 2015]
+
 
+
[https://www.ineteconomics.org/perspectives/blog/replication-and-transparency Replication and Transparency in Economic Research, INET blog post by Jan H. Höffler, December 3, 2015]
+
 
+
[[2016 YSI BITSS project TIER ReplicationWiki Workshop on Replication and Transparency in Economic Research|Workshop on Replication and Transparency in Economic Research]] at Mozilla San Francisco, January 6-7, 2016, with the [http://ineteconomics.org/community/young-scholars Young Scholars Initiative] of the [http://ineteconomics.org/ Institute for New Economic Thinking], [https://www.haverford.edu/users/rball Richard Ball] of the project [https://www.haverford.edu/tier Teaching Integrity in Empirical Reseach], [https://sites.google.com/site/pfeiferecon/ Johannes Pfeifer], Edward Miguel of the [http://bitss.org/ Berkeley Initiative for Transparency in the Social Sciences], [http://replication.uni-goettingen.de/wiki/index.php/User:J.Hoeffler Jan H. Höffler] of the ReplicationWiki, and [https://ideas.repec.org/f/phe474.html Thomas Herndon] of the [[Does High Public Debt Consistently Stifle Economic Growth? A Critique of Reinhart and Rogoff (CambJE 2014)|Public Debt and Growth replication debate]], materials available [https://osf.io/tk36j/ here]
+
  
 
:::::::::::::::::::::'''''[[ReplicationWiki:Current_events|Archive]]'''''
 
:::::::::::::::::::::'''''[[ReplicationWiki:Current_events|Archive]]'''''

Latest revision as of 14:41, 23 September 2018

9,959 articles
Slide1.png
Slide2.png
Slide3.png
Slide4.png
Slide5.png
Slide6.png
Slide7.png
Slide8.png
Slide9.png
Slide10.png
Slide11.png

About the project

For scientific progress, it is pivotal to review research findings by independently replicating results, thus making the findings more reliable. However, in econometric research, it is not yet common practice to publish replication findings. This wiki serves as a database of empirical studies, the availability of replication material for them and of replication studies. It can help teaching replication to students. Seminars at several faculties internationally were already taught for which the information of this database was used.

So far the focus has been on some leading journals in economics. Replication results can be published as replication working papers of the University of Göttingen's Center for Statistics.
Teaching and providing access to information will raise awareness for the need for replications, provide a basis for research about the reasons why replications so often fail and how this can be changed, and educate future generations of economists about how to make research replicable. The starting phase of this project was funded by the Institute for New Economic Thinking (INET).

Please cite as:
If you mention the ReplicationWiki in your research, especially when you use data from it, do not forget to cite the study describing it: ReplicationWiki - Improving Transparency in the Social Sciences, by Jan H. Höffler, D-Lib Magazine, March/April 2017, Volume 23, Number 3/4, doi: 10.1045/march2017-hoeffler.


Join the project

You can join the project by entering a new replication or empirical studies that could be replicated. For the latter you can vote which ones you find most relevant to be replicated. Furthermore, you can improve the articles in the wiki and make comments. Under current events you can announce news and upcoming events. The community portal lists open tasks and suggestions for the wiki.

Most recently added replication studies

News

A MOOC on Reproducible Research is offered by the French Institute for Research in Computer Science and Automation (INRIA) in French and English from October 22 to December 19, 2018.

A session Openness and Integrity in Methods Teaching and Research , including a talk that suggests to use the ReplicationWiki, was held at the American Political Sciences Assocation Annual Meeting , August 30 – September 2, 2018, in Boston, USA.

3ie and the International Fund for Agricultural Development (IFAD) are hosting an event on replication and research transparency on Programmes on financial services for the poor: what does the evidence say? on April 23, 2018 in Rome, Italy.

The journal Review of Development Finance posted a call for Reproducibility Studies in Development Finance. They plan to publish them regularly as well as in special issues.

AIRLEAP Conference “An Urgency for Evidence and Transparency in Economic Analysis and Policy”, St Louis, USA, October 13th-14th had a session on replication in empirical economics

The journal Energy Economics posted a call for contributions to a Special Issue on Replication in Energy Economics (in which it mentions the ReplicationWiki). Submission deadline was July 2017.

Replication Session at the American Economic Association Annual Meeting, Chicago, USA, January 6-8, 2017

Archive
Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox