I was having the same problem and in fact just joined up to ask for help.
I ended up solving it with the solution in this thread: Can not get admin UI in JupyterHub 2.2.0
(Set proxy_set_header X-scheme to https instead of $scheme)
2 Likes