Fix a crash where a csrc change is reported in a video stream but the attached conference no longer exists. Rework a bit.
