If you want to run a site audit and monitor your site health using SearchAtlas, sometimes our site crawlers get blocked by CDNs.
Content Delivery Networks (CDNs) are a group of servers that help deliver website content faster. If your website relies on a CDN to increase the performance of your website, then it’s possible the CDN’s firewall will block our crawler from accessing your site.
Resolving this issue is fairly straightforward and requires whitelisting the SearchAtlas site crawler. This post will explain how to do so on Cloudflare, as it is the most popular CDN provider for webmasters.
If you are using another CDN, the process is similar, and can still be done by following the steps outlined below.
SearchAtlas uses one primary IP address to monitor websites:
You will need to whitelist this IP address in order to run successful seo audits via SearchAtlas.
Follow these steps to proceed with whitelisting:
After performing the above steps, SearchAtlas will have access to your website for monitoring.
For help and a better understanding of Cloudflare’s IP Access Rules, see Cloudflare’s support documentation.
If you are still unable to successfully run a site audit, please contact our support team between 9am-6pm (PST), M-F, via the chat feature in your dashboard. Or, book a software demo with someone from our team.
Duplicate content is a problem for any website that wants to rank in search engines…
Every piece of content you publish influences how well your website performs. Whether you’ve just…
If you're looking for ways to improve the SEO of your website, content pruning is…
A comprehensive SEO strategy is the key to building a significant online presence for any…
Lead generation is vital when it comes to getting customers interested in the goods and…
Although a more technical part of SEO optimization, robots.txt files are a great way to…