Confessions of a researchaholic

February 26, 2024

Cherry picking batch-generated results

Filed under: Real — liyiwei @ 6:30 pm

An interactive UI that lets users manually input data and parameters to produce results is more suitable for iterative exploration (if you can wait for a few minutes) than mass production (which take take hours if not days), so I built a scripting environment from the same codebase.
I set up an experiment to run over 20+ inputs with a few values at each of the 3 parameter dimensions, and ended up with more than 4000 results which (dawned on me afterwards) are too many to examine one by one.
So I followed the path of iterating exploration as with the UI but with the already batched results without knowing for sure if I have missed any good ones.

Maybe we also need (semi)automatic tools to help us with cherry picking.

Leave a Comment »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Your email address will not be published. Required fields are marked *


This site uses Akismet to reduce spam. Learn how your comment data is processed.

Theme: Rubric. Get a free blog at