Right, that is for the frontend part of the extension (the prebuilt assets).
I think a restart of the server would still be needed since the extensions are loaded on server startup.
Linking to this topic for reference since it’s about reloading server extensions, although more focused on the development mode aspect of it: Reload jupyter serverextension