Confessions of a researchaholic

February 22, 2018

Replicability stamp

Filed under: Real — liyiwei @ 10:47 am
Tags:

The replicability stamp requires more than just the source code, such as datasets and scripts to replicate all results and timing information in the paper.

That may seem a lot of work, but is totally worth it.

First of all, it is a good practice to manage a research project from day one for replicability; a script that can reproduce all current results can help debugging and collaboration. I did that even for my single authored projects.

Even if we have not started the project in that way, it is still worth doing due to the amount of leverage as Andy Grove called in his seminal book “High Output Management”. A single unit of efforts we put in for replicability can potentially benefit many people who want to apply, reproduce, or compare against your works.
You would be more popular, your papers would get more citations and follow-ups, and nowadays many recruiters look at GitHub repos.
🙂

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Your email address will not be published. Required fields are marked *

 

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Theme: Rubric. Get a free blog at WordPress.com