This could be due to large files being downloaded and the connection is timing out, change the Time out settings for your email accounts.
Taking a guess as you don't give us an email program - For Outlook Express - Tools > Accounts > select account and click Properties > Advanced and change the timeout setting, see image.
I'm not surprised that you ISP is passing the buck.