The Screaming Frog SEO Spider is a web site crawler, that lets you crawl web sites’ URLs and fetch key parts to analyse and audit technical and onsite SEO.
Discover Damaged Hyperlinks
Crawl a web site immediately and discover damaged hyperlinks (404s) and server errors. Bulk export the errors and supply URLs to repair, or ship to a developer.
Discover momentary and everlasting redirects, establish redirect chains and loops, or add an inventory of URLs to audit in a web site migration.
Analyse Web page Titles & Meta Information
Analyse web page titles and meta descriptions throughout a crawl and establish these which are too lengthy, quick, lacking, or duplicated throughout your web site.
Uncover Duplicate Content material
Uncover actual duplicate URLs with an md5 algorithmic test, partially duplicated parts resembling web page titles, descriptions or headings and discover low content material pages.
Extract Information with XPath
Acquire any information from the HTML of an internet web page utilizing CSS Path, XPath or regex. This may embody social meta tags, extra headings, costs, SKUs or extra!
Overview Robots & Directives
View URLs blocked by robots.txt, meta robots or X-Robots-Tag directives resembling ‘noindex’ or ‘nofollow’, in addition to canonicals and rel=“subsequent” and rel=“prev”.
Generate XML Sitemaps
Rapidly create XML Sitemaps and Picture XML Sitemaps, with superior configuration over URLs to incorporate, final modified, precedence and alter frequency.
Combine with Google Analytics
Connect with the Google Analytics API and fetch person information, resembling classes or bounce charge and conversions, targets, transactions and income for touchdown pages towards the crawl.
Visualise Website Structure
Consider inside linking and URL construction utilizing interactive crawl and listing force-directed diagrams and tree graph web site visualisations.