instal the new for mac Screaming Frog SEO Spider 19.0

You now have the option to ‘respect’ noindex and canonical directives. However, now on right click of a URL (under ‘export’), you can see how the spider discovered a URL and what crawl path it took from start to finish. Have you ever wanted to know how a URL was discovered? Obviously you can view ‘in links’ of a URL, but when there is a particularly deep page, or perhaps an infinite URLs issue caused by incorrect relative linking, it can be a pain to track down the originating source URL (Tip! – To find the source manually, sort URLs alphabetically and find the shortest URL in the sequence!). For example, you can view redirect chains in a nice little report in list mode now. Now, the SEO Spider will continue to crawl, until it has found the final target URL. To find this previously, you had to upload each set of target URLs each time to analyse responses and the destination. Potentially a URL could 301, then 301 again and then 404. However, as list mode is essentially working at a crawl depth of ‘0’, you wouldn’t see the status of the redirect target which, particularly on migrations is required when a large number of URLs are changed. Previously the SEO Spider would only crawl the first redirect and report the redirect URL target under the ‘Response Codes’ tab. Now when you tick this box, the SEO spider will continue to crawl redirects even in list mode and ignore crawl depth. This is really useful as the latency for users can be longer with a chain, a little extra PageRank can dissipate in each hop and a large chain of 301s can be seen as a 404 by Google (Matt discussed this in a Google Webmaster Help video here).Īnother very cool part of the redirect chain report is how it works for site migrations alongside the new ‘ Always follow redirects‘ option (in the ‘advanced tab’ of the spider configuration).

This report essentially maps out chains of redirects, the number of hops along the way and will identify the source, as well as if there is a loop.

There is a new ‘reports’ menu in the top level navigation of the UI, which contains the redirect chains report. Version 2.20 now includes the following – Redirect Chains Report We have been busy behind the scenes developing some very cool new features which we hope everyone will enjoy! As always, thank you to everyone for their fantastic feedback and suggestions, we still have plenty more to come. I am delighted to announce version 2.20 of the Screaming Frog SEO spider.

Instal the new for mac Screaming Frog SEO Spider 19.0