It is possible to install Jupyterlab via Docker in Windows, but I don’t know how to install the CUDA. Maybe WSL2 (the Windows subsystem for Linux) allows to install the required CUDA drivers and to access the GPU.
Les us know if it works for you!