Can not restart or start/restart debugging without exiting PIO and unplug/plug ESP-Prog

Windows 10, ESP32 + ESP-PROG (with both jtag and TX/RX connectors being used).

Anyone have any hints on what I might look into. Its a pain to restart the PIO IDE and HW every time I make a change.