We have lots of tutorials about our glacier model on MyBinder. The model per default checks the number of CPUs available with
multiprocessing.cpu_count() and then use all of them. On a standard MyBinder env that’d be 16.
But that’s not the true resources given the user, right? What would be the right number of processes I can start as a user in a MyBinder env? Or should we switch off multiprocessing altogether?
I’m asking because we went from a standard pool to one created with a context object (for obscure reasons you don’t want to know about), and creating the new pool (which stores plenty of variables to be shared across processes) now takes ages (or freezes the notebook, I never had the patience to wait for it to be created).