http://www.videohelp.com/tools?tool=Virtualdub-MPEG2
and examine the jerky sections of your mpeg2 video file frame-by-frame. I think that this will help to solve your problem and you will learn a lot.
BTW, panning and zooming too fast can make your audience seasick.
