If the panoramic view shudders or is not pointing in the correct direction, you can calibrate the compass. Press the icon below the compass for further instructions.
If the panoramic view is still not aligned correctly after the calibration of the compass, you may correct the alignment manually. Just drag the panorama display to the desired direction. The small point circling the compass symbol indicates the correction.