The other consideration to reach is that wide open, fast lenses have a shallow DOF, and the longer the focal length, the more pronounced it is. I am not sure how good the Hi-ISO on your body is, but I would be fairly confident that on my D700/D3 I could crank the ISO enough to get good shutter speed at f/2.8-4 particularly if panning without too much noise.