Kubernets JupyterHub Glue

JupyterHub
1

Hi there community!

I’m trying to deploy an AWS Glue Image with JupyterHub on k8s.
I’ve used the Aws Glue base image according to this documentation

My dockerfile is basically this one

FROM amazon/aws-glue-libs:glue_libs_4.0.0_image_01

FROM Quay

ARG JUPYTERHUB_VERSION=4.1.5

ENV DISABLE_SSL=true

#ARG AWS_ACCESS_KEY_ID=“”
#ARG AWS_SECRET_ACCESS_KEY=“”
#ARG AWS_REGION=“”

USER root
RUN yum update -y &&
yum install -y
git
&& yum clean all

USER glue_user

RUN pip3 install --upgrade pip &&
pip3 install --no-cache
jupyterhub==$JUPYTERHUB_VERSION
jupyterlab-lsp
jupyterhub-idle-culler
sparkmagic
jupyterlab-widgets
jupyterlab-git
‘python-lsp-server[all]’

RUN pip3 install delta-spark==2.1.0 --no-deps --no-cache

RUN pip3 install awscli

COPY ./jupyter_start.sh /home/glue_user/jupyter/jupyter_start.sh

CMD [“/home/glue_user/jupyter/jupyter_start.sh”]

But whenever I try to start the Jupyterlab using this image i’m getting this

Defaulted container “notebook” out of: notebook, block-cloud-metadata (init) /usr/bin/id: cannot find name for user ID 1000
/usr/bin/id: cannot find name for user ID 1000
bash: jupyterhub-singleuser: No such file or directory

It seems that the jupyterhub cannot find the jupyterhub-singleuser CMD and so my pod start fails.

Any idea?
Thanks in advance

2

You’ve got several errors here- the first one indicates you’re trying to run the container with a user ID that doesn’t exist. This means the environment may not be setup correctly, e.g. the home directory may not exist, and PATH may not be setup.

Try running the container with a built in user ID, or creating a user with ID 1000.