Just today we had the issue and I was able to capture and save the logs.
This is a small part of it:
| Date | Message |
|---|---|
| 2023-11-08T13:28:16.477Z | Checking user [user] with scopes [‘access:servers!server=[user]/’, ‘read:users:groups!user=[user]’, ‘read:users:name!user=[user]’] against {‘access:servers!server=[user]/’, ‘access:servers!user=[user]’} |
| 2023-11-08T13:28:16.477Z | Allowing user [user] with scopes {‘access:servers!server=[user]/’} |
| 2023-11-08T13:28:16.477Z | 204 PUT /user/[user]/lab/api/workspaces/default?1699450095656 ([user]@10.49.241.58) 1.73ms |
| 2023-11-08T13:28:23.481Z | HubAuth cache miss: token:[token] |
| 2023-11-08T13:28:23.481Z | HubAuth cache miss: token:[token] |
| 2023-11-08T13:28:23.481Z | No Hub user identified for request |
| 2023-11-08T13:28:23.481Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:23.481Z | No user identified |
| 2023-11-08T13:28:23.481Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:23.481Z | [W 2023-11-08 13:28:22.645 TerminalsExtensionApp] wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:23.481Z | Traceback (most recent call last): |
| 2023-11-08T13:28:23.481Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/tornado/web.py, line 1784, in _execute |
| 2023-11-08T13:28:23.481Z | result = method(*self.path_args, **self.path_kwargs) |
| 2023-11-08T13:28:23.481Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/tornado/web.py, line 3278, in wrapper |
| 2023-11-08T13:28:23.481Z | url = self.get_login_url() |
| 2023-11-08T13:28:23.481Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/jupyterhub/singleuser/extension.py, line 148, in get_login_url |
| 2023-11-08T13:28:23.481Z | return original_get_login_url() |
| 2023-11-08T13:28:23.481Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/jupyter_server/base/handlers.py, line 753, in get_login_url |
| 2023-11-08T13:28:23.481Z | raise web.HTTPError(403) |
| 2023-11-08T13:28:23.482Z | tornado.web.HTTPError: HTTP 403: Forbidden |
| 2023-11-08T13:28:23.482Z | 403 GET /user/[user]/api/terminals?1699450102503 (@10.49.241.58) 10.14ms |
| 2023-11-08T13:28:23.482Z | No Hub user identified for request |
| 2023-11-08T13:28:23.482Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:23.482Z | No user identified |
| 2023-11-08T13:28:23.482Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:23.482Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:23.482Z | 403 GET /user/[user]/api/kernels?1699450102503 (@10.49.241.58) 10.28ms |
| 2023-11-08T13:28:23.482Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:23.482Z | No user identified |
| 2023-11-08T13:28:23.482Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&[state] |
| 2023-11-08T13:28:23.482Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:23.482Z | 403 GET /user/[user]/api/sessions?1699450102554 (@10.49.241.58) 1.94ms |
| 2023-11-08T13:28:25.483Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (busy) |
| 2023-11-08T13:28:25.483Z | test_parity_check.replay_anomaly_start |
| 2023-11-08T13:28:25.483Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_input |
| 2023-11-08T13:28:25.483Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_result |
| 2023-11-08T13:28:25.483Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (idle) |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | 304 GET /user/[user]/static/favicons/favicon-busy-1.ico (@10.49.241.58) 1.66ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104575 (@10.49.241.58) 1.56ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104575 (@10.49.241.58) 2.07ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104576 (@10.49.241.58) 2.80ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104576 (@10.49.241.58) 1.10ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104577 (@10.49.241.58) 1.18ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104577 (@10.49.241.58) 1.37ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104578 (@10.49.241.58) 2.12ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104579 (@10.49.241.58) 1.61ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104579 (@10.49.241.58) 2.23ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.483Z | Referer. user: [user] |
| 2023-11-08T13:28:25.483Z | Successfully submited the metrics! |
| 2023-11-08T13:28:25.483Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450104578 (@10.49.241.58) 1.16ms |
| 2023-11-08T13:28:25.483Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:25.483Z | No user identified |
| 2023-11-08T13:28:25.484Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:25.484Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:25.484Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:25.484Z | 403 GET /user/[user]/api/contents?1699450105155 (@10.49.241.58) 2.69ms |
| 2023-11-08T13:28:37.490Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:37.490Z | No user identified |
| 2023-11-08T13:28:37.490Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:37.490Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:37.490Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:37.490Z | 403 GET /user/[user]/api/sessions?1699450116407 (@10.49.241.58) 2.41ms |
| 2023-11-08T13:28:37.581Z | fetching config |
| 2023-11-08T13:28:37.581Z | successfully fetched and wrote configuration |
| 2023-11-08T13:28:42.494Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:42.494Z | No user identified |
| 2023-11-08T13:28:42.494Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:42.494Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:42.494Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:42.494Z | 403 GET /user/[user]/api/me?1699450121572 (@10.49.241.58) 2.48ms |
| 2023-11-08T13:28:42.494Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:42.494Z | No user identified |
| 2023-11-08T13:28:42.494Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:42.494Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:42.494Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:42.494Z | 403 GET /user/[user]/api/kernelspecs?1699450121573 (@10.49.241.58) 1.96ms |
| 2023-11-08T13:28:42.494Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:42.494Z | No user identified |
| 2023-11-08T13:28:42.494Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:42.494Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:42.494Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:42.494Z | 403 GET /user/[user]/api/contents?1699450121759 (@10.49.241.58) 2.71ms |
| 2023-11-08T13:28:43.495Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (busy) |
| 2023-11-08T13:28:43.495Z | test_parity_check.replay_anomaly_start == np.nan |
| 2023-11-08T13:28:43.495Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_input |
| 2023-11-08T13:28:43.495Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_result |
| 2023-11-08T13:28:43.495Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (idle) |
| 2023-11-08T13:28:43.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:43.495Z | No user identified |
| 2023-11-08T13:28:43.495Z | 304 GET /user/[user]/static/favicons/favicon-busy-1.ico (@10.49.241.58) 2.05ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.495Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.495Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123385 (@10.49.241.58) 2.27ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.495Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.495Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123386 (@10.49.241.58) 1.69ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.495Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.495Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123387 (@10.49.241.58) 1.49ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.495Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.495Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123387 (@10.49.241.58) 1.78ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.495Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.495Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123388 (@10.49.241.58) 2.82ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.495Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.495Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123389 (@10.49.241.58) 2.52ms |
| 2023-11-08T13:28:44.495Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.495Z | No user identified |
| 2023-11-08T13:28:44.495Z | Referer. user: [user] |
| 2023-11-08T13:28:44.496Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.496Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123389 (@10.49.241.58) 3.41ms |
| 2023-11-08T13:28:44.496Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.496Z | No user identified |
| 2023-11-08T13:28:44.496Z | Referer. user: [user] |
| 2023-11-08T13:28:44.496Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.496Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123390 (@10.49.241.58) 4.09ms |
| 2023-11-08T13:28:44.496Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.496Z | No user identified |
| 2023-11-08T13:28:44.496Z | Referer. user: [user] |
| 2023-11-08T13:28:44.496Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.496Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123388 (@10.49.241.58) 1.72ms |
| 2023-11-08T13:28:44.496Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:44.496Z | No user identified |
| 2023-11-08T13:28:44.496Z | Referer. user: [user] |
| 2023-11-08T13:28:44.496Z | Successfully submited the metrics! |
| 2023-11-08T13:28:44.496Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450123388 (@10.49.241.58) 2.70ms |
| 2023-11-08T13:28:47.497Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:47.497Z | No user identified |
| 2023-11-08T13:28:47.497Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:47.497Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:47.497Z | [W 2023-11-08 13:28:47.068 TerminalsExtensionApp] wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:47.497Z | Traceback (most recent call last): |
| 2023-11-08T13:28:47.497Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/tornado/web.py, line 1784, in _execute |
| 2023-11-08T13:28:47.497Z | result = method(*self.path_args, **self.path_kwargs) |
| 2023-11-08T13:28:47.497Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/tornado/web.py, line 3278, in wrapper |
| 2023-11-08T13:28:47.497Z | url = self.get_login_url() |
| 2023-11-08T13:28:47.497Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/jupyterhub/singleuser/extension.py, line 148, in get_login_url |
| 2023-11-08T13:28:47.497Z | return original_get_login_url() |
| 2023-11-08T13:28:47.497Z | File /opt/nbt/venvs/jupyter-server/lib/python3.10/site-packages/jupyter_server/base/handlers.py, line 753, in get_login_url |
| 2023-11-08T13:28:47.497Z | raise web.HTTPError(403) |
| 2023-11-08T13:28:47.497Z | tornado.web.HTTPError: HTTP 403: Forbidden |
| 2023-11-08T13:28:47.497Z | 403 GET /user/[user]/api/terminals?1699450126941 (@10.49.241.58) 2.49ms |
| 2023-11-08T13:28:49.498Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.498Z | No user identified |
| 2023-11-08T13:28:49.498Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:49.499Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:49.499Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:49.499Z | 403 GET /user/[user]/api/kernels?1699450128817 (@10.49.241.58) 2.64ms |
| 2023-11-08T13:28:49.499Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (busy) |
| 2023-11-08T13:28:49.499Z | (test_parity_check.replay_anomaly_start == np.nan).sum() |
| 2023-11-08T13:28:49.499Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_input |
| 2023-11-08T13:28:49.499Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_result |
| 2023-11-08T13:28:49.499Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (idle) |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | 304 GET /user/[user]/static/favicons/favicon-busy-1.ico (@10.49.241.58) 1.92ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129135 (@10.49.241.58) 1.88ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129136 (@10.49.241.58) 1.62ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129136 (@10.49.241.58) 1.64ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129137 (@10.49.241.58) 2.14ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129137 (@10.49.241.58) 3.21ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129138 (@10.49.241.58) 4.31ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129138 (@10.49.241.58) 1.91ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129140 (@10.49.241.58) 3.04ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129139 (@10.49.241.58) 1.69ms |
| 2023-11-08T13:28:49.499Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:49.499Z | No user identified |
| 2023-11-08T13:28:49.499Z | Referer. user: [user] |
| 2023-11-08T13:28:49.499Z | Successfully submited the metrics! |
| 2023-11-08T13:28:49.499Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450129139 (@10.49.241.58) 2.79ms |
| 2023-11-08T13:28:50.500Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: stream |
| 2023-11-08T13:28:57.505Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:57.505Z | No user identified |
| 2023-11-08T13:28:57.505Z | Detected unused OAuth state cookies |
| 2023-11-08T13:28:57.505Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:28:57.505Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:28:57.505Z | 403 GET /user/[user]/api/contents?1699450136667 (@10.49.241.58) 2.72ms |
| 2023-11-08T13:28:58.506Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (busy) |
| 2023-11-08T13:28:58.506Z | (test_parity_check.replay_anomaly_start is np.nan).sum() |
| 2023-11-08T13:28:58.506Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_input |
| 2023-11-08T13:28:58.506Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: error |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | 304 GET /user/[user]/static/favicons/favicon-busy-1.ico (@10.49.241.58) 1.95ms |
| 2023-11-08T13:28:58.506Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (idle) |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137770 (@10.49.241.58) 2.05ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137771 (@10.49.241.58) 1.62ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137773 (@10.49.241.58) 2.01ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137772 (@10.49.241.58) 2.55ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137774 (@10.49.241.58) 2.31ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137774 (@10.49.241.58) 2.68ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137775 (@10.49.241.58) 4.84ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137775 (@10.49.241.58) 5.66ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137776 (@10.49.241.58) 6.29ms |
| 2023-11-08T13:28:58.506Z | Token stored in cookie may have expired |
| 2023-11-08T13:28:58.506Z | No user identified |
| 2023-11-08T13:28:58.506Z | Referer. user: [user] |
| 2023-11-08T13:28:58.506Z | Successfully submited the metrics! |
| 2023-11-08T13:28:58.506Z | 200 POST /user/[user]/ddmetrics_lab/increment?1699450137777 (@10.49.241.58) 6.97ms |
| 2023-11-08T13:29:02.508Z | Token stored in cookie may have expired |
| 2023-11-08T13:29:02.508Z | No user identified |
| 2023-11-08T13:29:02.508Z | Detected unused OAuth state cookies |
| 2023-11-08T13:29:02.508Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:29:02.508Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:29:02.508Z | 403 GET /user/[user]/api/contents/notebooks/jump_detection/replay_jump_detection.ipynb?content=0&1699450141551 (@10.49.241.58) 2.83ms |
| 2023-11-08T13:29:06.511Z | Token stored in cookie may have expired |
| 2023-11-08T13:29:06.511Z | No user identified |
| 2023-11-08T13:29:06.511Z | Detected unused OAuth state cookies |
| 2023-11-08T13:29:06.511Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:29:06.511Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:29:06.511Z | 403 GET /user/[user]/api/contents/notebooks/jump_detection/replay_jump_detection.ipynb?content=0&1699450145824 (@10.49.241.58) 2.80ms |
| 2023-11-08T13:29:07.600Z | fetching config |
| 2023-11-08T13:29:07.600Z | successfully fetched and wrote configuration |
| 2023-11-08T13:29:09.513Z | Token stored in cookie may have expired |
| 2023-11-08T13:29:09.513Z | No user identified |
| 2023-11-08T13:29:09.513Z | Detected unused OAuth state cookies |
| 2023-11-08T13:29:09.513Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:29:09.513Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:29:09.513Z | 403 GET /user/[user]/api/sessions?1699450149071 (@10.49.241.58) 2.97ms |
| 2023-11-08T13:29:09.513Z | Token stored in cookie may have expired |
| 2023-11-08T13:29:09.513Z | No user identified |
| 2023-11-08T13:29:09.513Z | Detected unused OAuth state cookies |
| 2023-11-08T13:29:09.513Z | Redirecting to login url: /hub/api/oauth2/authorize?client_id=jupyterhub-user-[user]&redirect_uri=%2Fuser%2F[user]%2Foauth_callback&response_type=code&state=[state] |
| 2023-11-08T13:29:09.513Z | wrote error: ‘Forbidden’ |
| 2023-11-08T13:29:09.513Z | 403 GET /user/[user]/api/kernels (@10.49.241.58) 2.90ms |
| 2023-11-08T13:29:37.618Z | fetching config |
| 2023-11-08T13:29:37.618Z | successfully fetched and wrote configuration |
| 2023-11-08T13:29:49.538Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: status (busy) |
| 2023-11-08T13:29:49.538Z | (test_parity_check[~(test_parity_check[replay_anomaly_start] > 0)) |
| 2023-11-08T13:29:49.539Z | activity on ff944a42-2f3d-4a4d-94b9-24d9cb6d9a47: execute_input |