Do not move state of the call requesting the pause to PausedByRemote when the other party puts down inactive streams