Correctly route sound to speaker after early media and when cancelling call