Memory and cpu horizontal scaling kubernetes

JupyterHub
1

Hi all,

I’ve been reading the docs but I can’t quite find an answer to this. Can the memory and cpu limits of a single notebook exceed the limits of a single worker node on kubernetes. That is, if I try to generate a 16gb jupyter notebook and each of my workers has 8gb of ram will the process scale across 2 workers?

Best

Craig

2

Hi Craig

There’s no direct support. However several people have integrated Dask with their JupyterHub deployments which would allow scaleable analysis.

1 Like