How to solve a secure connection on the server side

I just got my site up and running and set up SSL with it.

The site works fine as long as the visitor does not travel at least 3 or 4 pages. and then errors start coming in like "secure connection refused, connection restart, etc."

Not sure why my user is facing such a problem, but not just for one, I just tried using multiple browsers, but got stuck with the same error.

Let me know if anyone has solved or solved / idea.

Thank!