I recently collected a list of “flow control” / batch processing / etc types of infrastructure, in particular in the notebook ecosystem. Just sharing them below in case they are useful! Please feel free to suggest something new if I missed something!
- rstudio launcher
- elyra pipelines
- mlflow on jupyterhub
- facebook submitit
- papermillhub (papermill on jupyterhub)