Github url redirect url to old custom domain

The site is currently hosted on the Github pages. I redirected it to a custom domain, then decided to switch domains. I changed the CNAME file in the repository to reflect the new domain, but when I go to my Github pages url (user.github.io) it redirects me to my old domain. Is this a caching issue that will get resolved over time or is there something else I need to do?