TLJH server - Failed to spawn server

I just installed TLJH on a VPS running Ubuntu 24.04 using this guide: Installing on your own server — The Littlest JupyterHub documentation

I was able to complete the installation, login to an admin, create another user, and install ssl using let’s encrypt. After logging to my other user, I install the conda-forge package which seemed to go well. I then uploaded some old notebooks and csv files I had from another machine. Shortly after that, the server crash and failed to respawn.

I restarted the server but am getting the same error with both users.

Spawn failed: Server at http://127.0.0.1:43621/user/adam.mobley/api didn't respond in 30 seconds
Event log
Server requested
Spawning server...
Spawn failed: Server at http://127.0.0.1:43621/user/adam.mobley/api didn't respond in 30 seconds

I am seeing this in the User Server Logs

Apr 08 20:34:58 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:58.926 ServerApp] Logged-in user adam.mobley
Apr 08 20:34:58 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:58.927 ServerApp] Setting new xsrf cookie for b'55ffe3d4d3954893881b27ce7e023f0d:70a3e5ca31e8def322376ce9179ffe38cfc00737dd1bc3cc341296e5>
Apr 08 20:34:58 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:58.927 ServerApp] 302 GET /user/adam.mobley/oauth_callback?code=[secret]&state=[secret] -> /user/adam.mobley/lab? (adam.mobley@108.193.80>
Apr 08 20:34:58 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:58.970 ServerApp] 200 GET /user/adam.mobley/lab? (adam.mobley@108.193.80.156) 4.12ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.719 ServerApp] 200 GET /user/adam.mobley/api/kernelspecs?1775680499692 (adam.mobley@108.193.80.156) 1.50ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.720 ServerApp] 200 GET /user/adam.mobley/api/me?1775680499692 (adam.mobley@108.193.80.156) 0.81ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.801 ServerApp] 200 GET /user/adam.mobley/lab/api/settings?1775680499701 (adam.mobley@108.193.80.156) 74.88ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.807 ServerApp] 200 GET /user/adam.mobley/api/kernels?1775680499704 (adam.mobley@108.193.80.156) 1.94ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.808 ServerApp] 200 GET /user/adam.mobley/api/terminals?1775680499704 (adam.mobley@108.193.80.156) 2.06ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.808 ServerApp] 200 GET /user/adam.mobley/lab/api/workspaces?1775680499705 (adam.mobley@108.193.80.156) 2.44ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.809 ServerApp] 200 GET /user/adam.mobley/api/sessions?1775680499705 (adam.mobley@108.193.80.156) 2.65ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.809 ServerApp] 200 GET /user/adam.mobley/api/kernelspecs?1775680499732 (adam.mobley@108.193.80.156) 3.15ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.810 ServerApp] 200 GET /user/adam.mobley/api/me?1775680499734 (adam.mobley@108.193.80.156) 3.36ms
Apr 08 20:34:59 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:34:59.811 ServerApp] 101 GET /user/adam.mobley/api/events/subscribe (adam.mobley@108.193.80.156) 0.62ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.006 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680499944 (adam.mobley@108.193.80.156) 36.29ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.007 ServerApp] 200 GET /user/adam.mobley/lab/api/translations/default?1775680499941 (adam.mobley@108.193.80.156) 39.16ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.051 ServerApp] 200 GET /user/adam.mobley/api/config/jupyterlabapputilsextensionannouncements?1775680500023 (adam.mobley@108.193.80.156>
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [W 2026-04-08 20:35:00.072 LabApp] Could not determine jupyterlab build status without nodejs
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.072 ServerApp] 200 GET /user/adam.mobley/lab/api/build?1775680500044 (adam.mobley@108.193.80.156) 1.98ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.078 ServerApp] 200 GET /user/adam.mobley/lsp/status?1775680500047 (adam.mobley@108.193.80.156) 5.00ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.148 ServerApp] 200 GET /user/adam.mobley/lab/api/translations?1775680500104 (adam.mobley@108.193.80.156) 17.45ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.199 ServerApp] 200 GET /user/adam.mobley/api/contents?content=1&hash=0&1775680500169 (adam.mobley@108.193.80.156) 3.22ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.263 ServerApp] 200 GET /user/adam.mobley/lab/api/settings/@jupyterlab/codemirror-extension:plugin?1775680500234 (adam.mobley@108.193.8>
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.265 ServerApp] 200 GET /user/adam.mobley/lab/api/settings/@jupyterlab/docmanager-extension:plugin?1775680500233 (adam.mobley@108.193.8>
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.270 ServerApp] 200 GET /user/adam.mobley/lab/api/settings/@jupyterlab/notebook-extension:panel?1775680500234 (adam.mobley@108.193.80.1>
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.278 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680500241 (adam.mobley@108.193.80.156) 7.20ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.344 ServerApp] 200 GET /user/adam.mobley/lab/api/workspaces/default?1775680500317 (adam.mobley@108.193.80.156) 1.09ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.467 ServerApp] 200 GET /user/adam.mobley/api/terminals?1775680500441 (adam.mobley@108.193.80.156) 0.89ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.592 ServerApp] 200 GET /user/adam.mobley/lab/api/settings?ids_only=true&1775680500559 (adam.mobley@108.193.80.156) 7.19ms
Apr 08 20:35:00 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:00.640 ServerApp] 101 GET /user/adam.mobley/terminals/websocket/1 (adam.mobley@108.193.80.156) 0.95ms
Apr 08 20:35:01 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:01.469 ServerApp] 204 PUT /user/adam.mobley/lab/api/workspaces/default?1775680501442 (adam.mobley@108.193.80.156) 1.43ms
Apr 08 20:35:01 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:01.512 ServerApp] 200 GET /user/adam.mobley/api/contents?content=1&hash=0&1775680501484 (adam.mobley@108.193.80.156) 3.81ms
Apr 08 20:35:02 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:02.056 ServerApp] 204 PUT /user/adam.mobley/lab/api/workspaces/default?1775680502028 (adam.mobley@108.193.80.156) 1.49ms
Apr 08 20:35:05 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:05.053 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680505021 (adam.mobley@108.193.80.156) 6.98ms
Apr 08 20:35:05 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:05.381 ServerApp] 204 PUT /user/adam.mobley/lab/api/workspaces/default?1775680505350 (adam.mobley@108.193.80.156) 1.66ms
Apr 08 20:35:05 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:05.459 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680505426 (adam.mobley@108.193.80.156) 6.43ms
Apr 08 20:35:09 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:09.982 ServerApp] 200 GET /user/adam.mobley/api/kernels?1775680509950 (adam.mobley@108.193.80.156) 1.01ms
Apr 08 20:35:09 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:09.985 ServerApp] 200 GET /user/adam.mobley/api/terminals?1775680509952 (adam.mobley@108.193.80.156) 1.28ms
Apr 08 20:35:09 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:09.986 ServerApp] 200 GET /user/adam.mobley/lab/api/workspaces?1775680509954 (adam.mobley@108.193.80.156) 1.82ms
Apr 08 20:35:09 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:09.987 ServerApp] 200 GET /user/adam.mobley/api/sessions?1775680509956 (adam.mobley@108.193.80.156) 0.80ms
Apr 08 20:35:10 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:10.102 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680510067 (adam.mobley@108.193.80.156) 9.27ms
Apr 08 20:35:10 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:10.512 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680510476 (adam.mobley@108.193.80.156) 6.98ms
Apr 08 20:35:11 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:11.562 ServerApp] 200 GET /user/adam.mobley/api/contents?content=1&hash=0&1775680511529 (adam.mobley@108.193.80.156) 3.46ms
Apr 08 20:35:12 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:12.119 ServerApp] 204 PUT /user/adam.mobley/lab/api/workspaces/default?1775680512087 (adam.mobley@108.193.80.156) 1.34ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.510 ServerApp] Creating new notebook in
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.551 ServerApp] Writing notebook-signing key to /home/jupyter-adam.mobley/.local/share/jupyter/notebook_secret
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.556 ServerApp] 201 POST /user/adam.mobley/api/contents?1775680514483 (adam.mobley@108.193.80.156) 46.62ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.598 ServerApp] 200 GET /user/adam.mobley/api/contents/Untitled.ipynb?content=0&hash=0&1775680514570 (adam.mobley@108.193.80.156) 1.84ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.603 ServerApp] 200 GET /user/adam.mobley/api/contents?content=1&hash=0&1775680514570 (adam.mobley@108.193.80.156) 5.13ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.683 ServerApp] 200 GET /user/adam.mobley/api/contents/Untitled.ipynb?type=notebook&content=1&hash=1&contentProviderId=undefined&177568>
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.886 ServerApp] 200 GET /user/adam.mobley/api/contents/Untitled.ipynb/checkpoints?1775680514732 (adam.mobley@108.193.80.156) 3.80ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.887 ServerApp] 200 GET /user/adam.mobley/api/contents/Untitled.ipynb/checkpoints?1775680514732 (adam.mobley@108.193.80.156) 4.12ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.888 ServerApp] 200 GET /user/adam.mobley/api/contents/Untitled.ipynb/checkpoints?1775680514737 (adam.mobley@108.193.80.156) 4.75ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.928 ServerApp] 200 GET /user/adam.mobley/api/sessions?1775680514900 (adam.mobley@108.193.80.156) 1.64ms
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.988 ServerApp] Kernel started: 9f246caa-91f3-45e2-86de-d19142b8e722
Apr 08 20:35:14 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:14.990 ServerApp] 201 POST /user/adam.mobley/api/sessions?1775680514941 (adam.mobley@108.193.80.156) 23.45ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.030 ServerApp] 200 GET /user/adam.mobley/api/sessions?1775680515003 (adam.mobley@108.193.80.156) 1.38ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.076 ServerApp] 200 PATCH /user/adam.mobley/api/sessions/a22eb814-73ea-4959-93d1-793bd43b5014?1775680515046 (adam.mobley@108.193.80.156>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.076 ServerApp] 200 GET /user/adam.mobley/api/kernels?1775680515046 (adam.mobley@108.193.80.156) 3.75ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.118 ServerApp] 200 GET /user/adam.mobley/api/sessions?1775680515090 (adam.mobley@108.193.80.156) 1.82ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.119 ServerApp] 200 PATCH /user/adam.mobley/api/sessions/a22eb814-73ea-4959-93d1-793bd43b5014?1775680515089 (adam.mobley@108.193.80.156>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.156 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680515120 (adam.mobley@108.193.80.156) 10.23ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.162 ServerApp] 200 GET /user/adam.mobley/api/kernelspecs?1775680515134 (adam.mobley@108.193.80.156) 2.17ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]: Traceback (most recent call last):
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "<frozen runpy>", line 198, in _run_module_as_main
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "<frozen runpy>", line 88, in _run_code
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/ipykernel_launcher.py", line 16, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from ipykernel import kernelapp as app
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/ipykernel/kernelapp.py", line 21, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from IPython.core.application import (  # type:ignore[attr-defined]
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/__init__.py", line 57, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from .terminal.embed import embed
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/terminal/embed.py", line 15, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from IPython.core.interactiveshell import InteractiveShell, make_main_module_type
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/core/interactiveshell.py", line 72, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from IPython.core.displayhook import DisplayHook
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/core/displayhook.py", line 19, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from .history import HistoryOutput
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/core/history.py", line 53, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from sqlite3 import DatabaseError, OperationalError
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/sqlite3/__init__.py", line 57, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from sqlite3.dbapi2 import *
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:   File "/opt/tljh/user/lib/python3.12/sqlite3/dbapi2.py", line 27, in <module>
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]:     from _sqlite3 import *
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[4498]: ImportError: /opt/tljh/user/lib/python3.12/lib-dynload/_sqlite3.cpython-312-x86_64-linux-gnu.so: undefined symbol: sqlite3_deserialize
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.294 ServerApp] 200 GET /user/adam.mobley/api/nbconvert?1775680514662 (adam.mobley@108.193.80.156) 606.20ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.568 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680515532 (adam.mobley@108.193.80.156) 6.85ms
Apr 08 20:35:15 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:15.771 ServerApp] 204 PUT /user/adam.mobley/lab/api/workspaces/default?1775680515739 (adam.mobley@108.193.80.156) 1.16ms
Apr 08 20:35:17 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:17.976 ServerApp] AsyncIOLoopKernelRestarter: restarting kernel (1/5), new random ports
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]: Traceback (most recent call last):
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "<frozen runpy>", line 198, in _run_module_as_main
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "<frozen runpy>", line 88, in _run_code
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/ipykernel_launcher.py", line 16, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from ipykernel import kernelapp as app
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/ipykernel/kernelapp.py", line 21, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from IPython.core.application import (  # type:ignore[attr-defined]
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/__init__.py", line 57, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from .terminal.embed import embed
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/terminal/embed.py", line 15, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from IPython.core.interactiveshell import InteractiveShell, make_main_module_type
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/core/interactiveshell.py", line 72, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from IPython.core.displayhook import DisplayHook
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/core/displayhook.py", line 19, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from .history import HistoryOutput
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/site-packages/IPython/core/history.py", line 53, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from sqlite3 import DatabaseError, OperationalError
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/sqlite3/__init__.py", line 57, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from sqlite3.dbapi2 import *
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:   File "/opt/tljh/user/lib/python3.12/sqlite3/dbapi2.py", line 27, in <module>
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]:     from _sqlite3 import *
Apr 08 20:35:18 ubuntu jupyterhub-singleuser[4503]: ImportError: /opt/tljh/user/lib/python3.12/lib-dynload/_sqlite3.cpython-312-x86_64-linux-gnu.so: undefined symbol: sqlite3_deserialize
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.031 ServerApp] 200 GET /user/adam.mobley/api/terminals?1775680520000 (adam.mobley@108.193.80.156) 1.25ms
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.033 ServerApp] 200 GET /user/adam.mobley/lab/api/workspaces?1775680520001 (adam.mobley@108.193.80.156) 1.13ms
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.208 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680520170 (adam.mobley@108.193.80.156) 8.18ms
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.333 ServerApp] 200 GET /user/adam.mobley/api/sessions?1775680520306 (adam.mobley@108.193.80.156) 1.05ms
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.334 ServerApp] 200 GET /user/adam.mobley/api/kernels?1775680520307 (adam.mobley@108.193.80.156) 0.71ms
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.619 ServerApp] 200 GET /user/adam.mobley/api/metrics/v1?1775680520586 (adam.mobley@108.193.80.156) 7.06ms
Apr 08 20:35:20 ubuntu jupyterhub-singleuser[3991]: [I 2026-04-08 20:35:20.989 ServerApp] AsyncIOLoopKernelRestarter: restarting kernel (2/5), new random ports

Looks like it is failing to import sqlite3 and the fallback, pysqlite2. Not sure if that is the root cause or not. Any help would be greatly appreciated.

Do you have sqlite3 installed on your Ubuntu server?

I suppose I was assuming it was installed along with everything else. What is the best way of validating it’s installation? If it is in fact missing, what is the correct procedure to install it for all users?

Use the instructions as shown in docs to check if SQLite is installed in conda environment. I think you can check with conda list sqlite command to see if the package is installed. If it is not installed, you can install it using conda install sqlite

Here is the output of conda list sqlite:

Error while loading conda entry point: conda-libmamba-solver (/opt/tljh/user/lib/python3.12/lib-dynload/_sqlite3.cpython-312-x86_64-linux-gnu.so: undefined symbol: sqlite3_deserialize)
# packages in environment at /opt/tljh/user:
#
# Name                     Version          Build            Channel
libsqlite                  3.52.0           h0c1763c_0       conda-forge
sqlite                     3.32.3           hcee41ef_1       conda-forge

It sounds like your conda environment may have become corrupted. Have you installed any other packages, and did you use conda or pip?

1 Like

I followed these guides to install everything:

So, both conda and pip were used.

The only other thing I did was create another admin user, login to that user, and upload some old notebooks. That is when the server crashed and would not respawn.

Uninstall libsqlite and sqlite and reinstall them to be on same version!! Probably it is the root cause of your issue!

I am having difficulty removing the packages

root@ubuntu:~# sudo -E conda remove libsqlite
sudo: conda: command not found

I did run this first but still no joy

export PATH=/opt/tljh/user/bin:${PATH}

I did try it without sudo and this was the result

root@ubuntu:~# conda remove libsqlite
Error while loading conda entry point: conda-libmamba-solver (/opt/tljh/user/lib/python3.12/lib-dynload/_sqlite3.cpython-312-x86_64-linux-gnu.so: undefined symbol: sqlite3_deserialize)

CondaValueError: You have chosen a non-default solver backend (libmamba) but it was not recognized. Choose one of: classic