I connected jupyterhub with LDAP AD authentication. Users with names containing . or - can log in. Example t.test
[I 2024-11-04 08:52:20.238 JupyterHub dockerspawner:1335] Starting service jupyter-t-2test(id: m3muwxk)
[I 2024-11-04 08:52:21.176 JupyterHub log:192] 302 GET /hub/spawn -> /hub/spawn-pending/t.test (t.test@::ffff:10.0.0.2) 1006.38ms
[I 2024-11-04 08:52:21.203 JupyterHub pages:397] t.test is pending spawn
[I 2024-11-04 08:52:21.207 JupyterHub log:192] 200 GET /hub/spawn-pending/t.test(t.test@::ffff:10.0.0.2) 16.03ms
[W 2024-11-04 08:52:21.294 JupyterHub _xsrf_utils:195] Skipping XSRF check for insecure request GET /hub/api/users/t.test/server/progress
[W 2024-11-04 08:52:30.176 JupyterHub base:1227] User t.test is slow to start (timeout=10)
08:57:04.380 [ConfigProxy] info: 200 GET /api/routes
[W 2024-11-04 08:57:20.207 JupyterHub user:999] t.test's server failed to start in 300 seconds, giving up.
Common causes of this timeout, and debugging tips:
1. Everything is working, but it took too long.
To fix: increase `Spawner.start_timeout` configuration
to a number of seconds that is enough for spawners to finish starting.
2. The server didn't finish starting,
or it crashed due to a configuration issue.
Check the single-user server's logs for hints at what needs fixing.
[E 2024-11-04 08:57:20.245 JupyterHub gen:629] Exception in Future <Task finished name='Task-44' coro=<BaseHandler.spawn_single_user.<locals>.finish_user_spawn() done, defined at /usr/local/lib/python3.10/dist-packages/jupyterhub/handlers/base.py:1115> exception=TimeoutError()> after timeout
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/tornado/gen.py", line 624, in error_callback
future.result()
File "/usr/local/lib/python3.10/dist-packages/jupyterhub/handlers/base.py", line 1122, in finish_user_spawn
await spawn_future
File "/usr/local/lib/python3.10/dist-packages/jupyterhub/user.py", line 1021, in spawn
raise e
File "/usr/local/lib/python3.10/dist-packages/jupyterhub/user.py", line 920, in spawn
await asyncio.wait_for(f, timeout=spawner.start_timeout)
File "/usr/lib/python3.10/asyncio/tasks.py", line 458, in wait_for
raise exceptions.TimeoutError() from exc
asyncio.exceptions.TimeoutError
manics
November 4, 2024, 12:40pm
2
Those error logs contain a couple of suggestions:
increasing the timeout
checking the singleuser logs
Have you already tried both of those? Are you using the most recent versions of JupyterHub and DockerSpawner?
If you’re still having problems please share your full JupyterHub config, and ideally give us enough information to reproduce your problem. Also turn on debug logging and share your logs.
Latest version of DockerSpawner
c.SwarmSpawner.http_timeout = 600
import os, pwd, grp
# pylint: disable=import-error
import shutil
import sys
import jupyterhub.spawner
from dockerspawner import SwarmSpawner
c.ConfigurableHTTPProxy.should_start = True
#c.JupyterHub.authenticator_class = 'dummyauthenticator.DummyAuthenticator'
#c.JupyterHub.authenticator_class = 'ldap'
c.JupyterHub.spawner_class = 'dockerspawner.SwarmSpawner'
c.SwarmSpawner.network_name = "swarm_jupyterhub-net"
c.SwarmSpawner.extra_host_config = { 'network_mode': "swarm_jupyterhub_net" }
c.SwarmSpawner.remove_containers = True
c.SwarmSpawner.debug = True
c.JupyterHub.hub_ip = '0.0.0.0'
c.JupyterHub.hub_port = 8081
c.SwarmSpawner.host_ip = "0.0.0.0"
c.JupyterHub.authenticator_class = 'ldapauthenticator.LDAPAuthenticator'
c.LDAPAuthenticator.server_address = '10.141.9.15'
c.LDAPAuthenticator.server_port = 389
c.LDAPAuthenticator.use_ssl = False
c.LDAPAuthenticator.tls_strategy="insecure"
c.LDAPAuthenticator.lookup_dn_search_user = 'user'
c.LDAPAuthenticator.lookup_dn_search_password = 'password'
c.LDAPAuthenticator.lookup_dn_search_filter = '({login_attr}={login})'
c.LDAPAuthenticator.lookup_dn = True
c.LDAPAuthenticator.user_search_base = 'cn=s-jupyterhub-1-p,ou=JupyterHub,ou=ServiceAccounts,ou=fl,dc=name,dc=local'
c.LDAPAuthenticator.user_search_base = 'ou=fl,dc=name,dc=local'
c.LDAPAuthenticator.user_attribute = 'sAMAccountName'
#c.LDAPAuthenticator.username_pattern = '[a-zA-Z0-9_.][a-zA-Z0-9_.-]{8,20}[a-zA-Z0-9_.$-]?'
#c.LDAPAuthenticator.valid_username_regex = '^[az][.a-z0-9@_-]*$'
c.LDAPAuthenticator.normalize_username = True
c.LDAPAuthenticator.create_user_home_dir = True
c.LDAPAuthenticator.lookup_dn_user_dn_attribute = 'cn'
c.LDAPAuthenticator.escape_userdn = True
c.LDAPAuthenticator.allowed_groups = []
c.Authenticator.allow_all = True
#Debug
c.Spawner.debug = True
c.SwarmSpawner.debug = True
#Allowed admins super
#admin = os.environ.get("JUPYTERHUB_ADMIN")
#if admin:
# c.Authenticator.admin_users = [admin]
def create_dir_hook(spawner):
username2 = spawner.user.name
username = username2.replace('.', '')
volume_path = os.path.join('/mnt/data', username)
data_dir = os.path.join(volume_path, 'work')
if not os.path.exists(volume_path):
os.mkdir(volume_path, 0o755)
if not os.stat(volume_path).st_uid == '1000':
os.chown(volume_path, 1000, 100)
if not os.path.exists(data_dir):
os.mkdir(data_dir, 0o755)
if not os.stat(data_dir).st_uid == '1000':
os.chown(data_dir, 1000, 100)
c.Spawner.pre_spawn_hook = create_dir_hook
c.SwarmSpawner.notebook_dir = '/home/jovyan/work'
c.SwarmSpawner.volumes = {
'/mnt/data/{username}': '/home/jovyan/',
}
c.Spawner.default_url = '/lab'
# TLS config
c.JupyterHub.port = 8000
#c.JupyterHub.ssl_key = os.environ['SSL_KEY']
#c.JupyterHub.ssl_cert = os.environ['SSL_CERT']
c.SwarmSpawner.http_timeout = 600
c.SwarmSpawner.start_timeout = 600
#c.JupyterHub.init_spawners_timeout = 60
c.JupyterHub.services = [
{
'name': 'idle-culler',
'command': [sys.executable, '-m', 'jupyterhub_idle_culler', '--timeout=3600', '--logging=debug'],
}
]
c.JupyterHub.load_roles = [
{
"name": "list-and-cull", # name the role
"services": [
"idle-culler", # assign the service to this role
],
"scopes": [
# declare what permissions the service should have
"list:users", # list users
"read:users:activity", # read user last-activity
"admin:servers", # start/stop servers
],
}
]
root@msk-dwh-juphub-1-t:/srv/jupyterhub#
The problem is with users who have “.” “-” in name
Thanks for the config. But we still need more logs, especially in DEBUG mode. The logs you posted are very limited to identify the issue.
1 Like
[I 2024-11-04 18:34:11.840 JupyterHub app:3346] Running JupyterHub version 5.2.1
[I 2024-11-04 18:34:11.841 JupyterHub app:3376] Using Authenticator: ldapauthenticator.ldapauthenticator.LDAPAuthenticator-2.0.1
[I 2024-11-04 18:34:11.841 JupyterHub app:3376] Using Spawner: dockerspawner.swarmspawner.SwarmSpawner-13.0.0
[I 2024-11-04 18:34:11.841 JupyterHub app:3376] Using Proxy: jupyterhub.proxy.ConfigurableHTTPProxy-5.2.1
[D 2024-11-04 18:34:11.854 JupyterHub app:1871] Generating new cookie_secret
[I 2024-11-04 18:34:11.854 JupyterHub app:1876] Writing cookie_secret to /srv/jupyterhub/jupyterhub_cookie_secret
[D 2024-11-04 18:34:11.854 JupyterHub app:1998] Connecting to db: sqlite:///jupyterhub.sqlite
[D 2024-11-04 18:34:11.892 JupyterHub orm:1477] Stamping empty database with alembic revision 4621fec11365
[I 2024-11-04 18:34:11.894 alembic.runtime.migration migration:215] Context impl SQLiteImpl.
[I 2024-11-04 18:34:11.894 alembic.runtime.migration migration:218] Will assume non-transactional DDL.
[I 2024-11-04 18:34:11.906 alembic.runtime.migration migration:623] Running stamp_revision -> 4621fec11365
[D 2024-11-04 18:34:11.906 alembic.runtime.migration migration:831] new branch insert 4621fec11365
[I 2024-11-04 18:34:12.025 JupyterHub proxy:556] Generating new CONFIGPROXY_AUTH_TOKEN
[W 2024-11-04 18:34:12.026 JupyterHub configurable:214] Config option `normalize_username` not recognized by `LDAPAuthenticator`. Did you mean `valid_username_regex`?
[W 2024-11-04 18:34:12.028 JupyterHub configurable:214] Config option `create_user_home_dir` not recognized by `LDAPAuthenticator`.
[W 2024-11-04 18:34:12.028 JupyterHub ldapauthenticator:70] LDAPAuthenticator.use_ssl is deprecated in 2.0 in favor of LDAPAuthenticator.tls_strategy, you can stop configuring use_ssl=False from now on as doing so has no effect.
[W 2024-11-04 18:34:12.028 JupyterHub ldapauthenticator:357] LDAPAuthenticator.escape_userdn was removed in 2.0 and no longer has any effect.
[D 2024-11-04 18:34:12.028 JupyterHub app:2338] Loading roles into database
[D 2024-11-04 18:34:12.029 JupyterHub app:2347] Loading role list-and-cull
[I 2024-11-04 18:34:12.042 JupyterHub roles:197] Role list-and-cull added to database
[I 2024-11-04 18:34:12.063 JupyterHub app:2919] Creating service idle-culler without oauth.
[D 2024-11-04 18:34:12.070 JupyterHub app:2685] Purging expired APITokens
[D 2024-11-04 18:34:12.073 JupyterHub app:2685] Purging expired OAuthCodes
[D 2024-11-04 18:34:12.075 JupyterHub app:2685] Purging expired Shares
[D 2024-11-04 18:34:12.078 JupyterHub app:2685] Purging expired ShareCodes
[D 2024-11-04 18:34:12.081 JupyterHub app:2459] Loading role assignments from config
[D 2024-11-04 18:34:12.111 JupyterHub app:2970] Initializing spawners
[D 2024-11-04 18:34:12.121 JupyterHub app:3120] Loaded users:
[I 2024-11-04 18:34:12.121 JupyterHub app:3416] Initialized 0 spawners in 0.010 seconds
[I 2024-11-04 18:34:12.127 JupyterHub metrics:373] Found 0 active users in the last ActiveUserPeriods.twenty_four_hours
[I 2024-11-04 18:34:12.128 JupyterHub metrics:373] Found 0 active users in the last ActiveUserPeriods.seven_days
[I 2024-11-04 18:34:12.128 JupyterHub metrics:373] Found 0 active users in the last ActiveUserPeriods.thirty_days
[W 2024-11-04 18:34:12.129 JupyterHub proxy:748] Running JupyterHub without SSL. I hope there is SSL termination happening somewhere else...
[I 2024-11-04 18:34:12.129 JupyterHub proxy:752] Starting proxy @ http://:8000
[D 2024-11-04 18:34:12.129 JupyterHub proxy:753] Proxy cmd: ['configurable-http-proxy', '--ip', '', '--port', '8000', '--api-ip', '127.0.0.1', '--api-port', '8001', '--error-target', 'http://09c6f48e66cf:8081/hub/error', '--log-level', 'info']
[D 2024-11-04 18:34:12.130 JupyterHub proxy:670] Writing proxy pid file: jupyterhub-proxy.pid
[D 2024-11-04 18:34:12.131 JupyterHub utils:272] Waiting 10s for server at 09c6f48e66cf:8000
[D 2024-11-04 18:34:12.131 JupyterHub utils:119] Server at 09c6f48e66cf:8000 not ready: [Errno 111] Connection refused
[D 2024-11-04 18:34:12.131 JupyterHub utils:272] Waiting 10s for server at 127.0.0.1:8001
[D 2024-11-04 18:34:12.131 JupyterHub utils:119] Server at 127.0.0.1:8001 not ready: [Errno 111] Connection refused
[D 2024-11-04 18:34:12.243 JupyterHub utils:119] Server at 127.0.0.1:8001 not ready: [Errno 111] Connection refused
[D 2024-11-04 18:34:12.281 JupyterHub utils:119] Server at 09c6f48e66cf:8000 not ready: [Errno 111] Connection refused
[D 2024-11-04 18:34:12.413 JupyterHub utils:119] Server at 127.0.0.1:8001 not ready: [Errno 111] Connection refused
18:34:12.441 [ConfigProxy] info: Proxying http://*:8000 to (no default)
18:34:12.445 [ConfigProxy] info: Proxy API at http://127.0.0.1:8001/api/routes
[D 2024-11-04 18:34:12.559 JupyterHub utils:280] Server at 09c6f48e66cf:8000 responded in 0.43s
[D 2024-11-04 18:34:12.662 JupyterHub utils:280] Server at 127.0.0.1:8001 responded in 0.53s
[D 2024-11-04 18:34:12.663 JupyterHub proxy:832] Proxy started and appears to be up
[D 2024-11-04 18:34:12.663 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
[I 2024-11-04 18:34:12.672 JupyterHub app:3739] Hub API listening on http://0.0.0.0:8081/hub/
[I 2024-11-04 18:34:12.672 JupyterHub app:3741] Private Hub API connect url http://09c6f48e66cf:8081/hub/
[I 2024-11-04 18:34:12.672 JupyterHub app:3615] Starting managed service idle-culler
[I 2024-11-04 18:34:12.672 JupyterHub service:423] Starting service 'idle-culler': ['/usr/bin/python3', '-m', 'jupyterhub_idle_culler', '--timeout=3600', '--logging=debug']
18:34:12.673 [ConfigProxy] info: 200 GET /api/routes
[I 2024-11-04 18:34:12.674 JupyterHub service:136] Spawning /usr/bin/python3 -m jupyterhub_idle_culler --timeout=3600 --logging=debug
[D 2024-11-04 18:34:12.675 JupyterHub spawner:1475] Polling subprocess every 30s
[D 2024-11-04 18:34:12.676 JupyterHub proxy:389] Fetching routes to check
[D 2024-11-04 18:34:12.676 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
18:34:12.677 [ConfigProxy] info: 200 GET /api/routes
[D 2024-11-04 18:34:12.677 JupyterHub proxy:392] Checking routes
[I 2024-11-04 18:34:12.677 JupyterHub proxy:477] Adding route for Hub: / => http://09c6f48e66cf:8081
[D 2024-11-04 18:34:12.677 JupyterHub proxy:925] Proxy: Fetching POST http://127.0.0.1:8001/api/routes/
18:34:12.679 [ConfigProxy] info: Adding route / -> http://09c6f48e66cf:8081
18:34:12.680 [ConfigProxy] info: Route added / -> http://09c6f48e66cf:8081
18:34:12.681 [ConfigProxy] info: 201 POST /api/routes/
[I 2024-11-04 18:34:12.681 JupyterHub app:3770] JupyterHub is now running at http://:8000
[D 2024-11-04 18:34:12.682 JupyterHub app:3339] It took 0.861 seconds for the Hub to start
[D 241104 18:34:12 selector_events:54] Using selector: EpollSelector
[D 2024-11-04 18:34:12.904 JupyterHub base:366] Recording first activity for <APIToken('1c63...', service='idle-culler', client_id='jupyterhub')>
[I 2024-11-04 18:34:12.909 JupyterHub log:192] 200 GET /hub/api/ (idle-culler@10.0.3.139) 7.40ms
[D 2024-11-04 18:34:12.912 JupyterHub scopes:1010] Checking access to /hub/api/users via scope list:users
[I 2024-11-04 18:34:12.965 JupyterHub log:192] 200 GET /hub/api/users?state=[secret] (idle-culler@10.0.3.139) 54.71ms
[D 241104 18:34:12 __init__:165] Fetched 0 items from http://09c6f48e66cf:8081/hub/api/users?state=ready in 1 pages
[D 241104 18:34:12 __init__:441] Got 0 users with ready servers
[I 2024-11-04 18:34:36.108 JupyterHub log:192] 302 GET / -> /hub/ (@::ffff:10.0.0.2) 1.54ms
[W 2024-11-04 18:34:36.126 JupyterHub base:482] Invalid or expired cookie token
[I 2024-11-04 18:34:36.128 JupyterHub log:192] 302 GET /hub/ -> /hub/login?next=%2Fhub%2F (@::ffff:10.0.0.2) 3.10ms
[I 2024-11-04 18:34:36.174 JupyterHub _xsrf_utils:125] Setting new xsrf cookie for b'0fe04b1756654c83a7413bef3125ad49:66b4mefatVulaJb7fdz-5s9Rd1s5kK_qaoTOVXmUESw=' {'path': '/hub/', 'max_age': 3600}
[I 2024-11-04 18:34:36.213 JupyterHub log:192] 200 GET /hub/login?next=%2Fhub%2F (@::ffff:10.0.0.2) 41.09ms
[D 2024-11-04 18:34:36.311 JupyterHub log:192] 304 GET /hub/static/components/@fortawesome/fontawesome-free/webfonts/fa-solid-900.woff2 (@::ffff:10.0.0.2) 9.94ms
[D 2024-11-04 18:34:51.993 JupyterHub ldapauthenticator:521] Attempting to bind s-jupyterhub-1-p
[D 2024-11-04 18:34:52.374 JupyterHub ldapauthenticator:538] Successfully bound s-jupyterhub-1-p
[D 2024-11-04 18:34:52.374 JupyterHub ldapauthenticator:446] Looking up user with:
search_base = 'ou=fl,dc=faberlic,dc=ru'
search_filter = '(sAMAccountName=p.shipilov)'
attributes = '[cn]'
[D 2024-11-04 18:34:52.650 JupyterHub ldapauthenticator:675] username:p.shipilov attributes:{}
[D 2024-11-04 18:34:52.653 JupyterHub roles:326] Assigning default role to User p.shipilov
[I 2024-11-04 18:34:52.659 JupyterHub roles:281] Adding role user for User: p.shipilov
[D 2024-11-04 18:34:52.670 JupyterHub roles:326] Assigning default role to User p.shipilov
[D 2024-11-04 18:34:52.673 JupyterHub base:685] Setting cookie for p.shipilov: jupyterhub-hub-login
[D 2024-11-04 18:34:52.673 JupyterHub base:681] Setting cookie jupyterhub-hub-login: {'httponly': True, 'path': '/hub/'}
[I 2024-11-04 18:34:52.674 JupyterHub _xsrf_utils:125] Setting new xsrf cookie for b'0fe04b1756654c83a7413bef3125ad49:0caaf2ff880447a6bbc6283fb84f52bf' {'path': '/hub/'}
[I 2024-11-04 18:34:52.674 JupyterHub base:973] User logged in: p.shipilov
[I 2024-11-04 18:34:52.676 JupyterHub log:192] 302 POST /hub/login?next=%2Fhub%2F -> /hub/ (p.shipilov@::ffff:10.0.0.2) 685.33ms
[D 2024-11-04 18:34:52.707 JupyterHub base:366] Recording first activity for <User(p.shipilov 0/1 running)>
[D 2024-11-04 18:34:52.710 JupyterHub user:496] Creating <class 'dockerspawner.swarmspawner.SwarmSpawner'> for p.shipilov:
[I 2024-11-04 18:34:52.713 JupyterHub log:192] 302 GET /hub/ -> /hub/spawn (p.shipilov@::ffff:10.0.0.2) 17.61ms
[D 2024-11-04 18:34:52.780 JupyterHub scopes:1010] Checking access to /hub/spawn via scope servers!server=p.shipilov/
[D 2024-11-04 18:34:52.780 JupyterHub pages:216] Triggering spawn with default options for p.shipilov
[D 2024-11-04 18:34:52.781 JupyterHub base:1095] Initiating spawn for p.shipilov
[D 2024-11-04 18:34:52.781 JupyterHub base:1099] 0/100 concurrent spawns
[D 2024-11-04 18:34:52.781 JupyterHub base:1104] 0 active servers
[I 2024-11-04 18:34:52.799 JupyterHub provider:661] Creating oauth client jupyterhub-user-p.shipilov
[D 2024-11-04 18:34:52.811 JupyterHub user:913] Calling Spawner.start for p.shipilov
[D 2024-11-04 18:34:52.811 JupyterHub dockerspawner:1247] Skipping pull of quay.io/jupyterhub/singleuser:5.2
[D 2024-11-04 18:34:52.811 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[I 2024-11-04 18:34:52.827 JupyterHub dockerspawner:1033] Service 'jupyter-p-2eshipilov' is gone
[I 2024-11-04 18:34:52.840 JupyterHub dockerspawner:1311] Created service jupyter-p-2eshipilov (id: ukq52no) from image quay.io/jupyterhub/singleuser:5.2
[I 2024-11-04 18:34:52.840 JupyterHub dockerspawner:1335] Starting service jupyter-p-2eshipilov (id: ukq52no)
[D 2024-11-04 18:34:52.840 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:52.840 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:52.845 JupyterHub swarmspawner:280] Service ukq52no state: pending
[I 2024-11-04 18:34:53.784 JupyterHub log:192] 302 GET /hub/spawn -> /hub/spawn-pending/p.shipilov (p.shipilov@::ffff:10.0.0.2) 1010.56ms
[D 2024-11-04 18:34:53.806 JupyterHub scopes:1010] Checking access to /hub/spawn-pending/p.shipilov via scope servers!server=p.shipilov/
[I 2024-11-04 18:34:53.806 JupyterHub pages:397] p.shipilov is pending spawn
[I 2024-11-04 18:34:53.810 JupyterHub log:192] 200 GET /hub/spawn-pending/p.shipilov (p.shipilov@::ffff:10.0.0.2) 12.28ms
[D 2024-11-04 18:34:53.845 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:53.846 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:53.857 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[W 2024-11-04 18:34:53.872 JupyterHub _xsrf_utils:195] Skipping XSRF check for insecure request GET /hub/api/users/p.shipilov/server/progress
[D 2024-11-04 18:34:53.872 JupyterHub scopes:1010] Checking access to /hub/api/users/p.shipilov/server/progress via scope read:servers!server=p.shipilov/
[D 2024-11-04 18:34:55.358 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:55.358 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:55.374 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[D 2024-11-04 18:34:57.625 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:57.625 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:34:57.639 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:35:01.015 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:01.015 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:01.031 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[W 2024-11-04 18:35:02.782 JupyterHub base:1227] User p.shipilov is slow to start (timeout=10)
[D 2024-11-04 18:35:06.095 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:06.095 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:06.106 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:35:13.700 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:13.701 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:13.712 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[D 2024-11-04 18:35:24.713 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:24.713 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:24.723 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:35:35.724 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:35.724 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:35.736 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:35:46.738 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:46.738 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:46.750 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[D 2024-11-04 18:35:57.750 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:57.750 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:35:57.763 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:36:08.764 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:08.764 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:08.777 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:36:19.778 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:19.778 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:19.788 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:36:30.789 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:30.789 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:30.796 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:36:41.798 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:41.798 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:41.803 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[D 2024-11-04 18:36:52.805 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:52.805 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:36:52.818 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:37:03.819 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:03.819 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:03.834 JupyterHub swarmspawner:280] Service ukq52no state: assigned
[D 2024-11-04 18:37:14.836 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:14.836 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:14.846 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:37:25.847 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:25.848 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:25.863 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:37:36.864 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:36.864 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:36.881 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:37:47.882 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:47.882 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:47.891 JupyterHub swarmspawner:280] Service ukq52no state: preparing
[D 2024-11-04 18:37:58.892 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:58.892 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:37:58.905 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:38:09.907 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:09.907 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:09.919 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:38:20.920 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:20.921 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:20.934 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:38:31.936 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:31.936 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:31.950 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:38:42.951 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:42.952 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:42.966 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:38:53.968 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:53.968 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:38:53.978 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:39:04.980 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:04.980 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:04.987 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:39:12.682 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
18:39:12.688 [ConfigProxy] info: 200 GET /api/routes
[D 2024-11-04 18:39:12.689 JupyterHub proxy:392] Checking routes
[D 2024-11-04 18:39:15.988 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:15.989 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:16.001 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:39:27.002 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:27.002 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:27.011 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:39:38.012 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:38.012 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:38.020 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:39:49.021 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:49.021 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:39:49.034 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:40:00.035 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:00.035 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:00.043 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:40:11.044 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:11.044 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:11.057 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:40:22.058 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:22.058 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:22.075 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:40:33.077 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:33.078 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:33.089 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:40:44.089 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:44.090 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:44.103 JupyterHub swarmspawner:280] Service ukq52no state: rejected
[D 2024-11-04 18:40:55.104 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:55.104 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
[D 2024-11-04 18:40:55.117 JupyterHub swarmspawner:280] Service ukq52no state: rejected
manics
November 4, 2024, 6:53pm
8
Docker Swarm is a bit more difficult to debug. Can you check the Docker logs?
If that doesn’t help can you try using DockerSpawner instead. If that works we can then go back to SwarmSpawner.
warm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.781 JupyterHub base:1104] 0 active servers
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:52.799 JupyterHub provider:661] Creating oauth client jupyterhub-user-p.shipilov
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.811 JupyterHub user:913] Calling Spawner.start for p.shipilov
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.811 JupyterHub dockerspawner:1247] Skipping pull of quay.io/jupyterhub/singleuser:5.2
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.811 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:52.827 JupyterHub dockerspawner:1033] Service 'jupyter-p-2eshipilov' is gone
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:52.840 JupyterHub dockerspawner:1311] Created service jupyter-p-2eshipilov (id: ukq52no) from image quay.io/jupyterhub/singleuser:5.2
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:52.840 JupyterHub dockerspawner:1335] Starting service jupyter-p-2eshipilov (id: ukq52no)
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.840 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.840 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:52.845 JupyterHub swarmspawner:280] Service ukq52no state: pending
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:53.784 JupyterHub log:192] 302 GET /hub/spawn -> /hub/spawn-pending/p.shipilov (p.shipilov@::ffff:10.0.0.2) 1010.56ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:53.806 JupyterHub scopes:1010] Checking access to /hub/spawn-pending/p.shipilov via scope servers!server=p.shipilov/
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:53.806 JupyterHub pages:397] p.shipilov is pending spawn
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:34:53.810 JupyterHub log:192] 200 GET /hub/spawn-pending/p.shipilov (p.shipilov@::ffff:10.0.0.2) 12.28ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:53.845 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:53.846 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:53.857 JupyterHub swarmspawner:280] Service ukq52no state: preparing
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [W 2024-11-04 18:34:53.872 JupyterHub _xsrf_utils:195] Skipping XSRF check for insecure request GET /hub/api/users/p.shipilov/server/progress
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:53.872 JupyterHub scopes:1010] Checking access to /hub/api/users/p.shipilov/server/progress via scope read:servers!server=p.shipilov/
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:55.358 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:55.358 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:55.374 JupyterHub swarmspawner:280] Service ukq52no state: preparing
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:34:57.625 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
1oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:02.349 JupyterHub swarmspawner:280] Service ukq52no state: rejected
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:12.683 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 18:44:12.687 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:12.687 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:13.349 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:13.349 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:13.363 JupyterHub swarmspawner:280] Service ukq52no state: rejected
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:24.365 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:24.365 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:24.378 JupyterHub swarmspawner:280] Service ukq52no state: rejected
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:35.378 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:35.379 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:35.392 JupyterHub swarmspawner:280] Service ukq52no state: rejected
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:46.393 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:46.393 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:46.409 JupyterHub swarmspawner:280] Service ukq52no state: rejected
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [W 2024-11-04 18:44:52.812 JupyterHub user:999] p.shipilov's server failed to start in 600 seconds, giving up.
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t |
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | Common causes of this timeout, and debugging tips:
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t |
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 1. Everything is working, but it took too long.
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | To fix: increase `Spawner.start_timeout` configuration
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | to a number of seconds that is enough for spawners to finish starting.
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 2. The server didn't finish starting,
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | or it crashed due to a configuration issue.
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | Check the single-user server's logs for hints at what needs fixing.
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t |
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.812 JupyterHub user:1100] Stopping p.shipilov
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.812 JupyterHub swarmspawner:155] Getting task of service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.812 JupyterHub dockerspawner:1027] Getting service 'jupyter-p-2eshipilov'
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.821 JupyterHub swarmspawner:144] Service ukq52no status: {'ContainerStatus': {'ContainerID': '', 'ExitCode': 0, 'PID': 0},
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 'Err': 'invalid mount config for type "bind": bind source path does not '
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 'exist: /mnt/data/p-2eshipilov',
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 'Message': 'preparing',
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 'PortStatus': {},
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 'State': 'rejected',
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 'Timestamp': '2024-11-04T18:44:35.020860397Z'}
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.834 JupyterHub user:1122] Deleting oauth client jupyterhub-user-p.shipilov
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.841 JupyterHub user:1125] Finished stopping p.shipilov
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:44:52.845 JupyterHub dockerspawner:972] Persisting state for p.shipilov: service name=jupyter-p-2eshipilov, id=ukq52nofj871p3xakmpwsx4f6
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [E 2024-11-04 18:44:52.848 JupyterHub gen:629] Exception in Future <Task finished name='Task-75' coro=<BaseHandler.spawn_single_user.<locals>.finish_user_spawn() done, defined at /usr/local/lib/python3.10/dist-packages/jupyterhub/handlers/base.py:1115> exception=TimeoutError()> after timeout
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | Traceback (most recent call last):
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | File "/usr/local/lib/python3.10/dist-packages/tornado/gen.py", line 624, in error_callback
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | future.result()
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | File "/usr/local/lib/python3.10/dist-packages/jupyterhub/handlers/base.py", line 1122, in finish_user_spawn
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | await spawn_future
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | File "/usr/local/lib/python3.10/dist-packages/jupyterhub/user.py", line 1021, in spawn
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | raise e
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | File "/usr/local/lib/python3.10/dist-packages/jupyterhub/user.py", line 920, in spawn
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | await asyncio.wait_for(f, timeout=spawner.start_timeout)
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | File "/usr/lib/python3.10/asyncio/tasks.py", line 458, in wait_for
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | raise exceptions.TimeoutError() from exc
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | asyncio.exceptions.TimeoutError
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t |
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 18:44:52.851 JupyterHub log:192] 200 GET /hub/api/users/p.shipilov/server/progress?_xsrf=[secret] (p.shipilov@::ffff:10.0.0.2) 598985.13ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:49:12.684 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 18:49:12.690 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:49:12.691 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:54:12.684 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 18:54:12.691 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:54:12.692 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:59:12.682 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 18:59:12.685 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 18:59:12.685 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:04:12.683 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:04:12.689 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:04:12.690 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:04:12.973 JupyterHub log:192] 200 GET /hub/api/ (idle-culler@10.0.3.139) 12.71ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:04:12.976 JupyterHub scopes:1010] Checking access to /hub/api/users via scope list:users
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:04:12.980 JupyterHub log:192] 200 GET /hub/api/users?state=[secret] (idle-culler@10.0.3.139) 5.36ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 241104 19:04:12 __init__:165] Fetched 0 items from http://09c6f48e66cf:8081/hub/api/users?state=ready in 1 pages
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 241104 19:04:12 __init__:441] Got 0 users with ready servers
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:09:12.684 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:09:12.690 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:09:12.692 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:14:12.684 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:14:12.691 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:14:12.693 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:19:12.682 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:19:12.688 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:19:12.688 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:24:12.684 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:24:12.689 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:24:12.690 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:29:12.683 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:29:12.688 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:29:12.689 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:34:10.365 JupyterHub metrics:373] Found 1 active users in the last ActiveUserPeriods.twenty_four_hours
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:34:10.366 JupyterHub metrics:373] Found 1 active users in the last ActiveUserPeriods.seven_days
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:34:10.367 JupyterHub metrics:373] Found 1 active users in the last ActiveUserPeriods.thirty_days
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.083 JupyterHub app:2685] Purging expired APITokens
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.085 JupyterHub app:2685] Purging expired OAuthCodes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.087 JupyterHub app:2685] Purging expired Shares
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.089 JupyterHub app:2685] Purging expired ShareCodes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.684 JupyterHub proxy:925] Proxy: Fetching GET http://127.0.0.1:8001/api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | 19:34:12.689 [ConfigProxy] info: 200 GET /api/routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.691 JupyterHub proxy:392] Checking routes
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:34:12.976 JupyterHub log:192] 200 GET /hub/api/ (idle-culler@10.0.3.139) 7.43ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 2024-11-04 19:34:12.980 JupyterHub scopes:1010] Checking access to /hub/api/users via scope list:users
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [I 2024-11-04 19:34:12.983 JupyterHub log:192] 200 GET /hub/api/users?state=[secret] (idle-culler@10.0.3.139) 5.16ms
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 241104 19:34:12 __init__:165] Fetched 0 items from http://09c6f48e66cf:8081/hub/api/users?state=ready in 1 pages
swarm_hub.1.q461oz52eb4q@msk-dwh-juphub-1-t | [D 241104 19:34:12 __init__:441] Got 0 users with ready servers
wolfktl
November 4, 2024, 7:41pm
10
The first logs were dokcer logs
manics
November 4, 2024, 10:16pm
11
Sorry I wasn’t clear. I meant the logs from the Docker Daemon:
Can you also try DockerSpawnernot SwarmSpawner?
wolfktl
November 5, 2024, 7:38am
12
tail -n 400 /var/log/syslog
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.339574] docker_gwbridge: port 2(veth049a6d2) entered forwarding state
Nov 5 10:37:10 msk-dwh-juphub-1-t networkd-dispatcher[834]: ERROR:Unknown interface index 581 seen even after reload
Nov 5 10:37:10 msk-dwh-juphub-1-t networkd-dispatcher[834]: WARNING:Unknown index 584 seen, reloading interface list
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.562896] veth1: renamed from vethf0012d8
Nov 5 10:37:10 msk-dwh-juphub-1-t networkd-dispatcher[834]: WARNING:Unknown index 585 seen, reloading interface list
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.579152] br0: port 3(veth1) entered blocking state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.579156] br0: port 3(veth1) entered disabled state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.579387] device veth1 entered promiscuous mode
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.579797] br0: port 3(veth1) entered blocking state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.579801] br0: port 3(veth1) entered forwarding state
Nov 5 10:37:10 msk-dwh-juphub-1-t networkd-dispatcher[834]: ERROR:Unknown interface index 585 seen even after reload
Nov 5 10:37:10 msk-dwh-juphub-1-t networkd-dispatcher[834]: WARNING:Unknown index 585 seen, reloading interface list
Nov 5 10:37:10 msk-dwh-juphub-1-t networkd-dispatcher[834]: ERROR:Unknown interface index 585 seen even after reload
Nov 5 10:37:10 msk-dwh-juphub-1-t containerd[846]: time="2024-11-05T10:37:10.672205120+03:00" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1
Nov 5 10:37:10 msk-dwh-juphub-1-t containerd[846]: time="2024-11-05T10:37:10.672328627+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 5 10:37:10 msk-dwh-juphub-1-t containerd[846]: time="2024-11-05T10:37:10.672887013+03:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 5 10:37:10 msk-dwh-juphub-1-t containerd[846]: time="2024-11-05T10:37:10.673297599+03:00" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1
Nov 5 10:37:10 msk-dwh-juphub-1-t systemd[1]: Started libcontainer container 3cb5fa35c06bb7d0bdab55c715444fb714defb8e54ea4c973b42ed85b7e9e072.
Nov 5 10:37:10 msk-dwh-juphub-1-t systemd[1]: run-docker-runtime\x2drunc-moby-3cb5fa35c06bb7d0bdab55c715444fb714defb8e54ea4c973b42ed85b7e9e072-runc.YJTAt3.mount: Deactivated successfully.
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.859830] eth0: renamed from veth81f36c4
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.871608] docker_gwbridge: port 2(veth049a6d2) entered disabled state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.874902] br0: port 3(veth1) entered disabled state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.875141] br0: port 3(veth61) entered blocking state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.875145] br0: port 3(veth61) entered forwarding state
Nov 5 10:37:10 msk-dwh-juphub-1-t kernel: [295791.931597] eth1: renamed from veth07270fe
Nov 5 10:37:11 msk-dwh-juphub-1-t kernel: [295791.943573] br0: port 3(veth1) entered blocking state
Nov 5 10:37:11 msk-dwh-juphub-1-t kernel: [295791.943578] br0: port 3(veth1) entered forwarding state
Nov 5 10:37:11 msk-dwh-juphub-1-t kernel: [295791.955621] eth2: renamed from vethec17ee9
Nov 5 10:37:11 msk-dwh-juphub-1-t kernel: [295791.971857] IPv6: ADDRCONF(NETDEV_CHANGE): veth049a6d2: link becomes ready
Nov 5 10:37:11 msk-dwh-juphub-1-t kernel: [295791.972015] docker_gwbridge: port 2(veth049a6d2) entered blocking state
Nov 5 10:37:11 msk-dwh-juphub-1-t kernel: [295791.972019] docker_gwbridge: port 2(veth049a6d2) entered forwarding state
Nov 5 10:37:11 msk-dwh-juphub-1-t systemd-networkd[797]: veth049a6d2: Gained carrier
Nov 5 10:37:11 msk-dwh-juphub-1-t systemd-udevd[185689]: Using default interface naming scheme 'v249'.
Nov 5 10:37:12 msk-dwh-juphub-1-t systemd-networkd[797]: veth049a6d2: Gained IPv6LL
Nov 5 10:37:54 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:37:54.900748762+03:00" level=warning msg="Entry was not in db: nid:zbwfnn53p9hqdaa4pmjvth7w1 eid:513f58e855d193d68d27b08882b8e11b4dee16a5d23dcb5f2a4ce9d1411d19a0 peerIP:10.0.3.75 peerMac:02:42:0a:00:03:4b isLocal:false vtep:10.132.22.139"
Nov 5 10:37:54 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:37:54.902017695+03:00" level=warning msg="Peer delete operation failed" error="could not delete fdb entry for nid:zbwfnn53p9hqdaa4pmjvth7w1 eid:513f58e855d193d68d27b08882b8e11b4dee16a5d23dcb5f2a4ce9d1411d19a0 into the sandbox:Search neighbor failed for IP 10.132.22.139, mac 02:42:0a:00:03:4b, present in db:false"
Nov 5 10:37:54 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:37:54.902215019+03:00" level=warning msg="Entry was not in db: nid:zbwfnn53p9hqdaa4pmjvth7w1 eid:d6044661139e7952118f2d6a3d79660290807d6083e535744a46679943a3fb61 peerIP:10.0.3.77 peerMac:02:42:0a:00:03:4d isLocal:false vtep:10.132.22.139"
Nov 5 10:37:54 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:37:54.902398663+03:00" level=warning msg="Peer delete operation failed" error="could not delete fdb entry for nid:zbwfnn53p9hqdaa4pmjvth7w1 eid:d6044661139e7952118f2d6a3d79660290807d6083e535744a46679943a3fb61 into the sandbox:Search neighbor failed for IP 10.132.22.139, mac 02:42:0a:00:03:4d, present in db:false"
Nov 5 10:37:59 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:37:59.164472562+03:00" level=warning msg="underweighting node t141ejz1isqiwdyg5q4glyzof for service 817vncotz1h2ge8afb2ykqckv because it experienced 5 failures or rejections within 5m0s" module=scheduler node.id=wi5ivhxikfjv73m19ywt1vzys
Nov 5 10:38:01 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:01.141619919+03:00" level=error msg="fatal task error" error="invalid mount config for type \"bind\": bind source path does not exist: /mnt/data/p-2eshipilov" module=node/agent/taskmanager node.id=wi5ivhxikfjv73m19ywt1vzys service.id=817vncotz1h2ge8afb2ykqckv task.id=ehcl67k37coelhymblh6pdg7k
Nov 5 10:38:06 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:06.147039082+03:00" level=error msg="fatal task error" error="invalid mount config for type \"bind\": bind source path does not exist: /mnt/data/p-2eshipilov" module=node/agent/taskmanager node.id=wi5ivhxikfjv73m19ywt1vzys service.id=817vncotz1h2ge8afb2ykqckv task.id=t2tpa697gznt2giasbddhy96o
Nov 5 10:38:11 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:11.007018565+03:00" level=error msg="fatal task error" error="invalid mount config for type \"bind\": bind source path does not exist: /mnt/data/p-2eshipilov" module=node/agent/taskmanager node.id=wi5ivhxikfjv73m19ywt1vzys service.id=817vncotz1h2ge8afb2ykqckv task.id=k4bh02qraov3b8yrd02tjhkvr
Nov 5 10:38:16 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:16.143605797+03:00" level=error msg="fatal task error" error="invalid mount config for type \"bind\": bind source path does not exist: /mnt/data/p-2eshipilov" module=node/agent/taskmanager node.id=wi5ivhxikfjv73m19ywt1vzys service.id=817vncotz1h2ge8afb2ykqckv task.id=x6ondlnc1sw3se2dio147sj4b
Nov 5 10:38:21 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:21.200232014+03:00" level=error msg="fatal task error" error="invalid mount config for type \"bind\": bind source path does not exist: /mnt/data/p-2eshipilov" module=node/agent/taskmanager node.id=wi5ivhxikfjv73m19ywt1vzys service.id=817vncotz1h2ge8afb2ykqckv task.id=w0xadmha0o9l3q9mjkr3biphf
Nov 5 10:38:21 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:21.226109548+03:00" level=warning msg="underweighting node wi5ivhxikfjv73m19ywt1vzys for service 817vncotz1h2ge8afb2ykqckv because it experienced 5 failures or rejections within 5m0s" module=scheduler node.id=wi5ivhxikfjv73m19ywt1vzys
Nov 5 10:38:24 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:24.709749241+03:00" level=warning msg="failed to deactivate service binding for container jupyter-p-2eshipilov.1.ehcl67k37coelhymblh6pdg7k" error="No such container: jupyter-p-2eshipilov.1.ehcl67k37coelhymblh6pdg7k" module=node/agent node.id=wi5ivhxikfjv73m19ywt1vzys
Nov 5 10:38:29 msk-dwh-juphub-1-t dockerd[1023]: time="2024-11-05T10:38:29.711396772+03:00" level=warning msg="failed to deactivate service binding for container jupyter-p-2eshipilov.1.t2tpa697gznt2giasbddhy96o" error="No such container: jupyter-p-2eshipilov.1.t2tpa697gznt2giasbddhy96o" module=node/agent node.id=wi5ivhxikfjv73m19ywt1vzys
1 Like
wolfktl
November 5, 2024, 7:48am
13
User p.shipilov
bind source path does not exist: /mnt/data/p-2eshipilov
Jupiter transfers username p.shipilov to p-2eshipilov
1 Like
Seems like . and - are unsafe characters for DockerSpawner . So, I guess you will have to normalize the usernames using your Authenticator of JupyterHub and use those normalized user names on bind mounts.
1 Like
wolfktl
November 5, 2024, 10:20am
15
FIX
def create_dir_hook(spawner):
username2 = spawner.user.name
username = username2.replace('.', '-2e')
manics
November 5, 2024, 6:08pm
16
I’m glad you found out a solution! I think you could also use
username = spawner.escape(spawner.user.name)
which has the advantage of also handling other special characters.
1 Like