Advertising Continue reading below The bug was fixed in mid-August and we saw an upward trend in clicks and impressions back to normal numbers. How often should you perform technical website crawls for SEO? From July 23 to August 13, FOX experienced a sharp drop in SEO clicks and /watch/page impressions - due to a bug with the allroutes.json file. Then I had a thought: If we had Banner Design waited several weeks to a month before running the crawl (which is widely considered best practice), the inappropriate response codes would have caused additional damage to the site's SEO traffic and ad Banner Design revenue. Not just the problem itself, but the extra time to create and execute a solution .
Advertising Continue reading below While it's Banner Design entirely possible to have diagnosed this bug without a full crawl of the website, it would have made the task unnecessarily difficult. The screenshot below shows that without the right Google Search Console (GSC) filters in place, this particular issue was hiding under a veil in the search results report. The GSC Coverage Banner Design report also took 10 days to identify errors on our monitoring pages and only offered examples of affected URLs. As mentioned earlier, this response code issue did not affect the UX of the page. How often should you perform technical website crawls for SEO? Although the issue has been largely veiled without the Banner Design proper set of filters - highlighting the value of a full crawl rather than relying on Google Search Console data. Summary Of course, you can continue by simply “watching” Google Search Console. Advertising
Continue reading below But routine scans can be very beneficial. We implemented weekly scans and haven't looked back since, especially after a three-week correction. While Banner Design SEO teams aren't required to perform weekly website crawls, you may only qualify for a monthly crawling engagement – rather than a more relaxed, “as needed” approach. In the words of Barry Adams: “You have to constantly improve. You have to put in effort, make small adjustments, speed up the process, improve it, optimize every part of it. Constantly. All the time." And regular website crawling is a great tactic. More Banner Design resources: Crawl-First SEO: A 12-Step Guide to Before Crawl A guide to effectively analyzing corporate sites 10 ways to think like Googlebot and boost your technical SEO