Notebook spawned in Yarn but killed after timeout

[I 2023-07-11 14:21:58.981 YarnSingleUserNotebookApp mixins:609] Starting jupyterhub single-user server version 3.1.1
[I 2023-07-11 14:21:58.981 YarnSingleUserNotebookApp mixins:623] Extending __main__.YarnSingleUserNotebookApp from __main__ 
[I 2023-07-11 14:21:58.981 YarnSingleUserNotebookApp mixins:623] Extending jupyter_server.serverapp.ServerApp from jupyter_server 1.23.6
[D 2023-07-11 14:21:58.999 YarnSingleUserNotebookApp application:190] Searching ['/home/.jupyter', '/home/.local/etc/jupyter', '/cm/shared/datalake/jupyterhub/miniconda/etc/jupyter', '/usr/local/etc/jupyter', '/etc/jupyter'] for config files
[D 2023-07-11 14:21:58.999 YarnSingleUserNotebookApp application:902] Looking for jupyter_config in /etc/jupyter
[D 2023-07-11 14:21:58.999 YarnSingleUserNotebookApp application:902] Looking for jupyter_config in /usr/local/etc/jupyter
[D 2023-07-11 14:21:59.000 YarnSingleUserNotebookApp application:902] Looking for jupyter_config in /cm/shared/datalake/jupyterhub/miniconda/etc/jupyter
[D 2023-07-11 14:21:59.000 YarnSingleUserNotebookApp application:902] Looking for jupyter_config in /home/.local/etc/jupyter
[D 2023-07-11 14:21:59.000 YarnSingleUserNotebookApp application:902] Looking for jupyter_config in /home/.jupyter
[D 2023-07-11 14:21:59.000 YarnSingleUserNotebookApp application:902] Looking for jupyter_server_config in /etc/jupyter
[D 2023-07-11 14:21:59.001 YarnSingleUserNotebookApp application:902] Looking for jupyter_server_config in /usr/local/etc/jupyter
[D 2023-07-11 14:21:59.001 YarnSingleUserNotebookApp application:902] Looking for jupyter_server_config in /cm/shared/datalake/jupyterhub/miniconda/etc/jupyter
[D 2023-07-11 14:21:59.001 YarnSingleUserNotebookApp application:902] Looking for jupyter_server_config in /home/.local/etc/jupyter
[D 2023-07-11 14:21:59.001 YarnSingleUserNotebookApp application:902] Looking for jupyter_server_config in /home/.jupyter
[D 2023-07-11 14:21:59.003 YarnSingleUserNotebookApp config_manager:93] Paths used for configuration of jupyter_server_config: 
    	/etc/jupyter/jupyter_server_config.json
[D 2023-07-11 14:21:59.003 YarnSingleUserNotebookApp config_manager:93] Paths used for configuration of jupyter_server_config: 
    	/usr/local/etc/jupyter/jupyter_server_config.json
[D 2023-07-11 14:21:59.003 YarnSingleUserNotebookApp config_manager:93] Paths used for configuration of jupyter_server_config: 
    	/cm/shared/datalake/jupyterhub/miniconda/etc/jupyter/jupyter_server_config.json
[D 2023-07-11 14:21:59.003 YarnSingleUserNotebookApp config_manager:93] Paths used for configuration of jupyter_server_config: 
    	/home/.local/etc/jupyter/jupyter_server_config.json
[D 2023-07-11 14:21:59.004 YarnSingleUserNotebookApp config_manager:93] Paths used for configuration of jupyter_server_config: 
    	/home/.jupyter/jupyter_server_config.json
[I 2023-07-11 14:21:59.080 YarnSingleUserNotebookApp mixins:670] Starting jupyterhub-singleuser server version 3.1.1
[D 2023-07-11 14:21:59.085 YarnSingleUserNotebookApp _version:74] jupyterhub and jupyterhub-singleuser both on version 3.1.1
[I 2023-07-11 14:21:59.086 YarnSingleUserNotebookApp serverapp:2686] Serving notebooks from local directory: /hadoop/yarn/local/usercache/sorokaa/appcache/application_1687889389675_0015/container_1687889389675_0015_01_000001
[I 2023-07-11 14:21:59.086 YarnSingleUserNotebookApp serverapp:2686] Jupyter Server 1.23.6 is running at:
[I 2023-07-11 14:21:59.086 YarnSingleUserNotebookApp serverapp:2686] http://dl-test-01:39199/user/sorokaa/tree/
[I 2023-07-11 14:21:59.086 YarnSingleUserNotebookApp serverapp:2686]  or http://127.0.0.1:39199/user/sorokaa/tree/
[I 2023-07-11 14:21:59.086 YarnSingleUserNotebookApp serverapp:2687] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 2023-07-11 14:21:59.092 YarnSingleUserNotebookApp mixins:591] Updating Hub with activity every 300 seconds
[D 2023-07-11 14:21:59.093 YarnSingleUserNotebookApp mixins:553] Notifying Hub of activity 2023-07-11T18:21:59.014371Z
[I 2023-07-11 14:21:59.240 YarnSingleUserNotebookApp log:186] 302 GET /user/sorokaa/ -> /user/sorokaa/tree/? (@192.168.60.11) 0.64ms
[I 2023-07-11 14:21:59.351 YarnSingleUserNotebookApp log:186] 302 GET /user/sorokaa/ -> /user/sorokaa/tree/? (@::ffff:10.254.127.246) 0.59ms
[I 2023-07-11 14:21:59.399 YarnSingleUserNotebookApp log:186] 302 GET /user/sorokaa/tree/? -> /user/sorokaa/tree? (@::ffff:10.254.127.246) 0.55ms
[D 2023-07-11 14:21:59.440 YarnSingleUserNotebookApp auth:673] No user identified
[D 2023-07-11 14:21:59.441 YarnSingleUserNotebookApp handlers:273] Using contents: services/contents
[D 2023-07-11 14:21:59.476 YarnSingleUserNotebookApp handlers:881] Path favicon.ico served from /cm/shared/datalake/jupyterhub/miniconda/lib/python3.10/site-packages/jupyter_server/static/favicon.ico
[D 2023-07-11 14:21:59.478 YarnSingleUserNotebookApp handlers:881] Path style/bootstrap.min.css served from /cm/shared/datalake/jupyterhub/miniconda/lib/python3.10/site-packages/jupyter_server/static/style/bootstrap.min.css
[D 2023-07-11 14:21:59.479 YarnSingleUserNotebookApp handlers:881] Path style/bootstrap-theme.min.css served from /cm/shared/datalake/jupyterhub/miniconda/lib/python3.10/site-packages/jupyter_server/static/style/bootstrap-theme.min.css
[D 2023-07-11 14:21:59.480 YarnSingleUserNotebookApp handlers:881] Path style/index.css served from /cm/shared/datalake/jupyterhub/miniconda/lib/python3.10/site-packages/jupyter_server/static/style/index.css
[W 2023-07-11 14:21:59.481 YarnSingleUserNotebookApp log:186] 404 GET /user/sorokaa/tree? (@::ffff:10.254.127.246) 42.27ms
[D 2023-07-11 14:21:59.538 YarnSingleUserNotebookApp auth:673] No user identified
[D 2023-07-11 14:21:59.540 YarnSingleUserNotebookApp log:186] 200 GET /user/sorokaa/static/style/bootstrap.min.css?v=0e8a7fbd6de23ad6b27ab95802a0a0915af6693af612bc304d83af445529ce5d95842309ca3405d10f538d45c8a3a261b8cff78b4bd512dd9effb4109a71d0ab (@::ffff:10.254.127.246) 2.96ms
[D 2023-07-11 14:21:59.546 YarnSingleUserNotebookApp auth:673] No user identified
[D 2023-07-11 14:21:59.547 YarnSingleUserNotebookApp auth:673] No user identified
[D 2023-07-11 14:21:59.549 YarnSingleUserNotebookApp log:186] 200 GET /user/sorokaa/static/style/bootstrap-theme.min.css?v=8b2f045cb5b4d5ad346f6e816aa2566829a4f5f2783ec31d80d46a57de8ac0c3d21fe6e53bcd8e1f38ac17fcd06d12088bc9b43e23b5d1da52d10c6b717b22b3 (@::ffff:10.254.127.246) 2.86ms
[D 2023-07-11 14:21:59.550 YarnSingleUserNotebookApp log:186] 200 GET /user/sorokaa/static/style/index.css?v=30372e3246a801d662cf9e3f9dd656fa192eebde9054a2282449fe43919de9f0ee9b745d7eb49d3b0a5e56357912cc7d776390eddcab9dac85b77bdb17b4bdae (@::ffff:10.254.127.246) 2.82ms
[D 2023-07-11 14:21:59.769 YarnSingleUserNotebookApp auth:673] No user identified
[D 2023-07-11 14:21:59.771 YarnSingleUserNotebookApp log:186] 200 GET /user/sorokaa/static/favicon.ico?v=50afa725b5de8b00030139d09b38620224d4e7dba47c07ef0e86d4643f30c9bfe6bb7e1a4a1c561aa32834480909a4b6fe7cd1e17f7159330b6b5914bf45a880 (@::ffff:10.254.127.246) 1.85ms
End of LogType:application.driver.log.This log file belongs to a running container (container_1687889389675_0015_01_000001) and so may not be complete.

@manics Do you happen to know why when notebook is missing from single user environment we get this No user identified error? I mean it is sort of misleading, right? Can we check for the presence of notebook/jupyterlab before starting single user server? Cheers!!