Tljh-reload stuck in infinite loop of Hub not ready: (HTTP status 502) InsecureRequestWarning: Unverified HTTPS request is being made to host while setting up azuread OAuthenticator

Mahesh_Mhatre · December 14, 2023, 9:18pm

While setting up OAuthenticator for azuread by following this documentation: Azure AD Setup — OAuthenticator

sudo tljh-config reload is stuck in infinite loop of: Hub not ready: (HTTP status 502)
/opt/tljh/hub/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host ‘127.0.0.1’. Adding certificate verification is strongly advised. See: Advanced Usage - urllib3 2.1.0 documentation
warnings.warn(

and
accessing the jupyterhub shows bad gateway exception in the browser. (mostly because relaod isn’t finished)

How to reproduce

Create a JupyterHub
Enable https for it
In JupyterHub config:

auth:
    OAuthenticator:
        client_id: <client id created in azure ad using app registration>
        client_secret: <client secret created in azure ad using app registration>
    type: azuread
AzureAdOAuthenticator:
  tenant_id: <tenant id created in azure ad using app registration>
  scope: '[Read]'

Run: ‘sudo tljh-config reload’

manics · December 15, 2023, 3:29pm

Can you show us your full configuration, and your JupyterHub logs?

Mahesh_Mhatre · December 15, 2023, 6:29pm

Sure,
the tljh-config file looks like:

and the logs show this:
Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub python3[2671]: Dec 15 18:18:45 JupyterHub systemd[1]: Dec 15 18:18:45 JupyterHub systemd[1]: Dec 15 18:18:46 JupyterHub systemd[1]: Dec 15 18:18:46 JupyterHub systemd[1]: Dec 15 18:18:46 JupyterHub systemd[1]: Dec 15 18:18:46 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub python3[2720]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: Dec 15 18:18:47 JupyterHub systemd[1]: File “/usr/lib/python3.6/importlib/init.py”, line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File “”, line 994, in _gcd_import
File “”, line 971, in _find_and_load
File “”, line 955, in _find_and_load_unlocked
File “”, line 665, in _load_unlocked
File “”, line 678, in exec_module
File “”, line 219, in _call_with_frames_removed
File “/opt/tljh/hub/lib/python3.6/site-packages/oauthenticator/azuread.py”, line
import jwt
ModuleNotFoundError: No module named ‘jwt’

jupyterhub.service: Main process exited, code=exited, status=1/FAILURE
jupyterhub.service: Failed with result ‘exit-code’.
jupyterhub.service: Service hold-off time over, scheduling restart.
jupyterhub.service: Scheduled restart job, restart counter is at 4.
Stopped jupyterhub.service.
Started jupyterhub.service.
/opt/tljh/hub/lib/python3.6/site-packages/jupyterhub/crypto.py:17: CryptographyDepreca
import cryptography
[E 2023-12-15 18:18:47.037 JupyterHub app:2991]
Traceback (most recent call last):
File “/opt/tljh/hub/lib/python3.6/site-packages/jupyterhub/app.py”, line 2988, i
await self.initialize(argv)
File “/opt/tljh/hub/lib/python3.6/site-packages/jupyterhub/app.py”, line 2478, i
self.load_config_file(self.config_file)
File “/opt/tljh/hub/lib/python3.6/site-packages/decorator.py”, line 232, in fun
return caller(func, *(extras + args), **kw)
File “/opt/tljh/hub/lib/python3.6/site-packages/traitlets/config/application.py”
return method(app, *args, **kwargs)
File “/opt/tljh/hub/lib/python3.6/site-packages/traitlets/config/application.py”
self.update_config(new_config)
File "/opt/tljh/hub/lib/python3.6/site-packages/traitlets/config/configurable.py
self._load_config(config)
File "/opt/tljh/hub/lib/python3.6/site-packages/traitlets/config/configurable.py
setattr(self, name, deepcopy(config_value))
File “/opt/tljh/hub/lib/python3.6/site-packages/traitlets/traitlets.py”, line 58
self.set(obj, value)
File “/opt/tljh/hub/lib/python3.6/site-packages/traitlets/traitlets.py”, line 55
new_value = self._validate(obj, value)
File “/opt/tljh/hub/lib/python3.6/site-packages/traitlets/traitlets.py”, line 59
value = self.validate(obj, value)
File “/opt/tljh/hub/lib/python3.6/site-packages/jupyterhub/traitlets.py”, line 1
value = registry[key].load()
File “/opt/tljh/hub/lib/python3.6/site-packages/entrypoints.py”, line 79, in loa
mod = import_module(self.module_name)
File “/usr/lib/python3.6/importlib/init.py”, line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File “”, line 994, in _gcd_import
File “”, line 971, in _find_and_load
File “”, line 955, in _find_and_load_unlocked
File “”, line 665, in _load_unlocked
File “”, line 678, in exec_module
File “”, line 219, in _call_with_frames_removed
File “/opt/tljh/hub/lib/python3.6/site-packages/oauthenticator/azuread.py”, line
import jwt
ModuleNotFoundError: No module named ‘jwt’

jupyterhub.service: Main process exited, code=exited, status=1/FAILURE
jupyterhub.service: Failed with result ‘exit-code’.
jupyterhub.service: Service hold-off time over, scheduling restart.
jupyterhub.service: Scheduled restart job, restart counter is at 5.
Stopped jupyterhub.service.
jupyterhub.service: Start request repeated too quickly.
jupyterhub.service: Failed with result ‘exit-code’.
Failed to start jupyterhub.service.

Mahesh_Mhatre · December 15, 2023, 6:30pm

looking at the ModuleNotFoundError: No module named ‘jwt’, installed the module but that didn’t help

mahendrapaipuri · December 15, 2023, 7:04pm

What are the errors in the logs after you installed jwt? Also, is it possible for you to upgrade Python? Your logs contain some deprecation errors from crypography maybe due to Python 3.6!!

Mahesh_Mhatre · December 20, 2023, 8:19pm

When I run python --version I get Python 3.9.7.

When I install PyJWT it gets installed in ./.local/lib/python3.9/site-packages

Why does oauthenticator installation happens inside python3.6/site-packages? I tried installing the PyJWT package for python3.6 to satisfy the requirement but running python3.6 -m pip install PyJWT still installs the package in python3.9.7

Mahesh_Mhatre · December 20, 2023, 9:10pm

Update: PyJWT module must be installed in the hub environment using sudo /opt/tljh/hub/bin/python3 -m pip install. I was installing this module in user environment which was not helping

Topic		Replies	Views
The little jupyter hub OAuthenticator by AzureAD The Littlest JupyterHub how-to	2	1251	December 14, 2023
OAuthenticator 500 internal server error The Littlest JupyterHub help-wanted	6	551	January 9, 2024
Problem logging in to Azure AD with MFA enabled Zero to JupyterHub on Kubernetes	14	3228	February 23, 2022
GenericOAuthenticator doesnt redirect to the Identity server The Littlest JupyterHub how-to , help-wanted	6	768	September 2, 2021
Problems with TLJH HTTPS / SSL problems JupyterHub jupyterhub	2	533	June 6, 2020

Tljh-reload stuck in infinite loop of Hub not ready: (HTTP status 502) InsecureRequestWarning: Unverified HTTPS request is being made to host while setting up azuread OAuthenticator

How to reproduce

Related Topics