Do not connect audio to conference during early media.