Stereoscopic optimization: Avoid duplication

There are already optimizations to skip code-paths which are needed to be done per-frame but not twice-a-frame in stereo mode. This optimization work can be continued. This probably doesn't bring any major performance gains but small ones here and there.