Problems by severity
Over forty types of problem (titles and meta descriptions, H1, canonical, hreflang, images, mixed content, security headers and others), each with a severity and a weight on the score.
The Spider visits your site page by page, as a search engine would, and hands you a score and the list of problems to fix, split by severity.
Broken links, duplicate titles, pages blocked by mistake, redirect chains: on a large site they stay invisible until traffic drops. A systematic crawl brings them to light, with the detail of where they are.
Choose the URL, how many pages to visit (200 by default) and the speed: safe, fast or turbo, with a pause between requests from 4 to 1 seconds.
It reads robots.txt and the sitemap, follows internal links and records every page. You can follow the progress or come back later.
Score, response codes, problems by severity and every page, with filters and search.
Plan a weekly or monthly crawl and compare two crawls to see what you fixed and what appeared.
Over forty types of problem (titles and meta descriptions, H1, canonical, hreflang, images, mixed content, security headers and others), each with a severity and a weight on the score.
Every page with response code, indexability, word count and timings; filters by status and problem, search, sorting and a page detail with incoming and outgoing links.
Internal links that lead to pages with errors and the most affected destinations.
Identical titles, meta descriptions and content, with the groups of pages involved.
The indexable pages found, with a ready-to-download sitemap.xml file.
Most linked pages, pages with the most outgoing links and the most linked external domains.
Pages, problems, broken links and internal links, protected against harmful spreadsheet formulas.
Score difference between two crawls of the same site, solved and new problems, new or no longer found pages and a trend chart.
Up to ten competitors to watch through a sample of public pages: duplicate titles, broken external links and changes over time.
After changing its address structure, a blog runs a crawl and finds a group of internal links leading to pages with errors. It fixes them, schedules a weekly crawl and compares the last two: the solved problems show up in the list, and a new one would be seen straight away.
It makes one request at a time with a pause between them (1 to 4 seconds, your choice) and respects robots.txt. On more delicate sites the safe speed is the better choice.
For normal crawls we recommend doing it only on your own sites or ones you are authorised to crawl. To watch a competitor there is the Competitor Spider, which requires accepting the terms of use and respects the rules of the observed site.
If most responses are 403 errors the crawl stops as «blocked». The bot has to be allowed in the site’s firewall or anti-bot service.
The owner can ask for exclusion: the request is verified with a message to the domain’s address, with a link valid for 48 hours, and once confirmed the site is no longer analysed.
Yes, as CSV: pages, problems, broken links and internal links. From the sitemap viewer you can download a sitemap.xml.
Whenever you want, within the plan’s limits, or with a weekly or monthly schedule.
Check whether AI engines can read and cite your site and what to fix, in order of impact.
Learn more →Scheduled summaries by email and PDF, plus alerts when a site gets worse.
Learn more →Keyword positions by country and language, with changes, history, keyword research and backlinks.
Learn more →Create the free account: analyses that have a cost always show the estimate and only start after your confirmation.