HTML5 Video does not play smoothly, buffered again on playback

My html5 tag looks like this:

<video preload="auto" controls="">              
        <source src="http://whatever/sweetvideo.mp4" type="video/mp4"></video>
</video>

      

        
        
        
      

    

The video itself is a 30 second video.

In Chrome (v37) and IE11, Video buffers and plays every few seconds. It doesn't download all videos.

But in Chrome:
When I play the video, it starts buffering again - this is the main problem .
In IE11 it doesn't reload again on playback (desired behavior)