Journal publication policies

From ReplicationWiki
Jump to: navigation, search

By defining publication policies, scientific journals state conditions articles have to meet in order to get published.

Contents

Publication policies in economics

American Economic Review

At least since 2001 the AER publishes papers only if the data are clearly and precisely documented and readily available. Details of the computations sufficient to permit replication must be provided.[1] In 2005 the AER established a mandatory online archive and strengthened its publication policies. Authors are expected to send their data, programs, and sufficient details to permit replication.[2] End of 2007 the AER added instructions for Sending Data etc. The actual Data Availabilty Policy[3] has the following requirements:
(1) publication of all data and code necessary to replicate the results of the final models as a minimum requirement
(2) either publication of "a description of how previous intermediate data sets and programs were employed to create the final data set(s)" or full cooperation regarding requests by investigators attempting to replicate a publication
(3) publication of a Readme file "documenting the purpose and format of each file provided, as well as instructing a user on how replication can be conducted".
The Papers and Proceedings issue that contains short papers based on presentations at the annual meeting of the American Economic Association was exempted from the data availability policy until about 2013. In 2019 a rule was added that raw data and descriptions how to derive the final data from it need to be made available to the data editor.

American Economic Journals, AER: Insights, AEA Papers and Proceedings

For the four American Economic Journals (Applied Economics, Economic Policy, Macroeconomics, Microeconomics), AER: Insights and AEA Papers and Proceedings the same Data Availabilty Policy applies as for the American Economic Review (with the exception that for AEA Papers and Proceedings replication material only has to be provided until August while the issue is published in May).

Econometrica

The policy of Econometrica is that all empirical, experimental and simulation results must be replicable and authors must send all material to permit replication. Since 2004 the material is available on the Econometrica supplementary material web-page. Exceptions can be made ​​for confidential proprietary datasets e.g..[4]

Journal of Applied Econometrics

Since 1995 authors of all accepted papers are expected to deposit a complete set of data used in the Journal's Data Archive, unless they are confidential. Authors of papers published prior to 1995 can voluntarily submit their data.[5] Authors are also invited to provide computer programs and other materials to ensure that their results can be replicated with low effort.[6]

Journal of Political Economy

The JPE has adopted the AER data availability policy and since 2005 supplements are available on the JPE webpage.[7]

The Review of Economic Studies

In 2005 the Review of Economic Studies established a Data Policy.[8] Accepted papers will be published only if the authors send their data, programs, and sufficient details to permit replication. In case of proprietary data authors need an exception by the editor.

The Economic Journal

Empirical papers are only published if sufficient information is supplied to the reader about the nature of the data and how it was constructed. Furthermore, upon publication, data, programmes and instructions how to use them to replicate all of the results in the paper are required as well as information on "any manipulation that was carried out to obtain the data from the publicly available sources of the data". Exemptions can be made if data was used that cannot be made publicly available.[9]

The Review of Economics and Statistics

Authors of papers accepted for publication will be required to post code and programs, post and document their data (or document their data and include instructions for how other researchers can obtain the data when the data have been obtained under an arrangement that precludes the posting of the data), and post detailed readme files on-line before publication. Proprietary data is allowed as long as (1) there exists some way to apply for the data, (2) it is expected that reasonable applications will be accepted, (3) the authors will provide all the information necessary to go from the raw data to the results of the paper (including code). The Board of Editors will consider publishing an "Expression of Concern" for accepted papers whose authors fail to comply with the Review's Data Availability Policy.[10] Replication material is archived in a dataverse.[11]

Quarterly Journal of Economics

The Quarterly Journal of Economics adopted the AER data availability policy. Replication material is archived in the QJE Dataverse since end of 2016.[12]

Econometrics Journal

"We will only publish papers if they are accompanied by a complete replication package." ... "Requests for exemptions from providing materials or restricting their usage must be stated clearly at first submission. The editorial board will then decide whether the submission can be considered. The Econometrics Journal discourages papers that rely on completely proprietary data. As with other practical difficulties, authors who feel that their paper might constitute an exception should forward the case to the editorial office. Papers that are based on data that are only available at some cost (either monetary or because access to the data is limited, e.g., at a National Statistics office) and can therefore not be included in the package may in exceptional cases be considered. However, the authors will then still be required to provide all programs and instructions a researcher would require to replicate their results once the researcher has access to the data. The source of the data must be described in enough detail so that researchers can apply to obtain access to them. The authors will also be required to supply code that simulates data, as much as possible mimicking the actual data that were used in the application, as well as a file running the analysis on the simulated data. Alternatively, synthetic data can be provided."[13]

American Journal of Agricultural Economics

"authors are expected to submit their datasets and associated documentation (perhaps in a readme file), for readers to download from the AJAE website. Authors are also expected to provide whatever other material is needed to ensure that their results can be replicated (this might include code or pseudo-code used in estimation). Authors are encouraged to comply with all of this policy, but the editors would prefer partial compliance over non-compliance. The submitted files will be accessible as clickable links to the online version of the published paper. It is understood that in cases where the data are proprietary or confidential authors cannot fully satisfy this policy. Such cases should be brought to the attention of the editor at the time of initial submission."[14]

Further information

In 2012, the project EDaWaX assembled an overview of journal data policies including a dataset. They updated their database in 2015 and provided another dataset.

The American Economic Association has a link collection of resources for economists that includes a list of Journal Data and Program Archives.


References

  1. http://web.archive.org/web/200101280030/http://www.aeaweb.org/aer/submissions.html
  2. http://web.archive.org/web/20050214131803/http://www.aeaweb.org/aer/data_availability_policy.html
  3. http://www.aeaweb.org/aer/data.php Retrieved July 31, 2012.
  4. http://www.econometricsociety.org/submissioninstructions.asp#replication Retrieved July 31, 2012
  5. http://qed.econ.queensu.ca/jae/
  6. http://onlinelibrary.wiley.com/journal/10.1002/%28ISSN%291099-1255/homepage/ForAuthors.html
  7. http://www.journals.uchicago.edu/journals/jpe/datapolicy Retrieved April 19, 2016
  8. http://www.restud.com/submissions/
  9. http://www.res.org.uk/view/datapolicyEconomic.html
  10. Review of Economics and Statistics replication policy
  11. Review of Economics and Statistics dataverse
  12. https://academic.oup.com/qje/pages/Data_Policy
  13. https://www.res.org.uk/journals/the-econometrics-journal/submissions/replication-policy.html
  14. https://academic.oup.com/ajae/pages/Author_Guidelines
Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox