The replicability stamp requires more than just the source code, such as datasets and scripts to replicate all results and timing information in the paper.
That may seem a lot of work, but is totally worth it.
First of all, it is a good practice to manage a research project from day one for replicability; a script that can reproduce all current results can help debugging and collaboration. I did that even for my single authored projects.
Even if we have not started the project in that way, it is still worth doing due to the amount of leverage as Andy Grove called in his seminal book “High Output Management”. A single unit of efforts we put in for replicability can potentially benefit many people who want to apply, reproduce, or compare against your works.
You would be more popular, your papers would get more citations and follow-ups, and nowadays many recruiters look at GitHub repos.
🙂