It seems like I have my A CNAME and TXT records correct for my Azure App but My Domain name is still not resolving. Error: 404 Web Site not found.
You may be seeing this error due to one of the reasons listed below :
Custom domain has not been configured inside Azure. See how to map an existing domain to resolve this.
Client cache is still pointing the domain to old IP address. Clear the cache by running the command ipconfig/flushdns.
Here is my source tutorial: https://docs.microsoft.com/en-us/azure/dns/dns-web-sites-custom-domain