Hi,
Does anyone know if we can set culling at an individual single user pod and overwrite the global culling settings?
I have tried setting c.MappingKernelManager.cull_idle_timeout value in jupyter_notebook_settings under ~/.jupyter directory in an actual pod and restarting the pod, but it doesn’t seem to be take effect.
Thank you,
Alisa
manics
July 11, 2024, 10:35pm
2
There’s two ways to cull pods. Either they can stop themselves, or they can be stopped by an external process:
While the two aim in general to solve the same category of problem (wasted resources), they have different metrics available and different levels of action to take.
The notebook-environment configuration should in general produce better, more fine-grained results because it can do things like cull unused kernels and be aware of things like idle/busy or connected status. This lets the notebook server make more intelligent choices like “shutdown a kernel if it’s been idle for 5 minutes BUT not if…
If you’re using jupyter-server instead of jupyter-notebook you’ll need to use jupyter_server_config.py
as your config file:
Since this is independent of JupyterHub you can test and debug it by running your container locally (e.g. with docker) until you get it working.
The external culler does not allow user configuration.
1 Like