
If you’ve released a brand new website, it might take a day, or two days, or even three days for some of these errors to be reported. Finds URL errors in real time: With Google Search Console, there tends to be a bit of a lag.It’s very good at diagnosing technical issues: You can crawl up to 500 URLs and you can get limited features for free, or you can pay for the premium package and that will give you all your URLs and more advanced features. Anyone who’s a technical SEO or an experienced SEO will have used this tool, and it has a freemium model. Screaming Frog SEO Spider is a really nice tool. (Please note – This is not a data extraction or scraping feature yet.Digital Marketing - Study Notes: Crawling and diagnosing technical issues Custom Source Code Search – The spider allows you to find anything you want in the source code of a website! Whether that’s analytics code, specific text, or code etc.User-Agent Switcher – Crawl as Googlebot, Bingbot, or Yahoo! Slurp.

Images over 100kb, missing alt text, alt text over 100 characters


Page Title – Missing, duplicate, over 70 characters, same as h1, multiple.Duplicate Pages – Hash value / MD5checksums lookup for pages with duplicate content.URI Issues – Non ASCII characters, underscores, uppercase characters, dynamic uris, long over 115 characters.External Links – All followed links and their subsequent status codes.Redirects – (3XX, permanent or temporary).

Errors – Client & server errors (No responses, 4XX, 5XX).A quick summary of some of the data collected:.
