This now has an answer:
jupyterlab-myst
Here highlights the ability, while tagging a post that demonstrates additional features.