Modern JupyterLab should already have the debugger installed as it is now built in. The main kernel used ipykernel supports it and so you should be all set.
However, it seems old cruft that can be laying about on your system can disable it in sessions launched with Anconda. I would start here and read from there forward to try and see what you should be seeing and how you may need to troubleshoot/debug.