IE closes connection on file download before download finishes

IE closes the connection accidentally when we try to download a file from our server (mp3 file).

Sometimes it downloads the whole file, but sometimes it just won't download.

I added% X to the apache logs and whenever the download fails, instead of "+" I get "x" in the log.

Does anyone know why this is happening?