Is this when you're sending only to a single recipient, or to numerous?
What platform are you using to send mail? Webmail (ie; from a browser), email client, either desktop or mobile device, such as phone/tablet, and so on.
Could potentially be an issue with outgoing mail settings, or even a limitation on how many email can be sent per minute/hour/week.