Extension shows up as both installed and uninstalled and doesn't work

I got a user report this on three extensions: https://github.com/krassowski/jupyterlab-lsp/issues/203#issuecomment-599300121. Did anyone open an issue on GitHub already?