Hi,
Yes, this is a known limitation of the toolbar. It does not watch for external triggers. For now, we do not plan to fix this behavior.
The workaround is to "stop debugging" from within the toolbar, even if its already stopped.