Stuck in Breakout Room as a Host

Has anyone experienced getting stuck in a breakout room as the host and not being able to return to the main room until the time is up? It's happened to me quite a few times lately - all of the controls seem disabled - and I haven't been able to move around to the different breakout rooms.