An interactive UI that lets users manually input data and parameters to produce results is more suitable for iterative exploration (if you can wait for a few minutes) than mass production (which take take hours if not days), so I built a scripting environment from the same codebase.
I set up an experiment to run over 20+ inputs with a few values at each of the 3 parameter dimensions, and ended up with more than 4000 results which (dawned on me afterwards) are too many to examine one by one.
So I followed the path of iterating exploration as with the UI but with the already batched results without knowing for sure if I have missed any good ones.
Maybe we also need (semi)automatic tools to help us with cherry picking.
Leave a Reply