Crawling & technical audit — found from sitemap — CognitiveSEO

Cited by

Facts read from this source

• Crawl page limit Report an error

  “the number of crawled pages: 100 – unlimited;”

• Crawl speed options Report an error

  “the time needed for crawling: 10 URLs/min – 30 URLs/min;”

• Javascript crawling Report an error

  “Use JavaScript crawler to analyze sites that are using JavaScript. Check the box to Enable JavaScript Crawling and verify if your dynamic website is technically perfect and there are no errors.”

• Crawl sources Report an error

  “The default setting for cognitiveSEO is to crawl your website. There are two other options available, so it can be configured to also crawl XML Sitemap URLs, and/or a provided URL List.”

• Sitemap discovery Report an error

  “You can either let the tool discover it automatically, enter the URL or uploaded from your computer.”

• Crawlable elements Report an error

  “Non-HTML files are image files, PDFs, Microsoft Office or OpenDocument files, and audio or video files stored on the webserver.”

• User agents Report an error

  “You can change the user agent for crawling from the list available on cognitiveSEO: Applebot”

• Emulate human browsing Report an error

  “The Emulate Human Browsing option means that the crawler will access the site from various crawlers, with a low frequency and using a browser user agent following a natural user behavior.”

• Robots txt option Report an error

  “If you decide to Obey Robots.txt then all the URLs will be crawled according to the robots.txt file.”

• Password protected dirs Report an error

  “Use Password Protected Directories if you to run the crawler on a password protected directory you can do it by defining the username and password below. This can be used for staging environments.”

• Health score Report an error

  “For every site that runs the Site Audit analysis, you can see the Health Score, which shows from 1-100 % the degree to which a website is optimized for SEO.”

• Top 3 fixes Report an error

  “you can see the Top 3 fixes recommended by cognitiveSEO.”

• Audit history chart Report an error

  “There is the option to personalize this chart with metrics regarding indexability, content, mobile, performance, issues. The limit is set to 5 maximum metrics displayed on the graph.”

• Compare crawls Report an error

  “The Compare Crawls sheet contains two dates when your website was crawled so you can compare them side by side and see if there are any improvements for your website.”

• Recrawl schedule Report an error

  “When you create a campaign there is the option to select a recrawl once a month, once at two weeks or once per week.”

• Preferred domain check Report an error

  “The Site Audit analyzes your website and sees if you have set a preferred domain or not.”

• Http status codes Report an error

  “Depending on the website, in the chart, there is information available for 301 permanent redirects, 302 temporary redirects, 3xx other redirects, 4xx client errors, 5xx server errors, unidentified errors, 2xx success pages.”

• Content checks Report an error

  “Title Duplicate Titles Title Lenght Headings Thin Content Duplicate Pages Duplicate Descriptions Canonical Pages Unsecure Content Malware”

• Malware checks Report an error

  “Malware Threat Social Engineering Threat Unwanted Software Threat Harmful Application Threat URLs Not Checked”

• Image checks Report an error

  “Broken Internal Images”

• Social checks Report an error

  “Facebook Open Graph Twitter Cards”

• Hreflang checks Report an error

  “Missing Confirmation Links: All the pages from this category contain an hreflang issue.”

• Broken resources Report an error

  “Images CSS Files JavaScript Files Other”

• Amp check Report an error

  “Site Audit shows the next issues: pages that don’t have AMP setup. pages that don’t have correctly AMP setup.”

• Pagespeed check Report an error

  “Very Slow Pages: All the pages with this issue are loading very slowly.”

• Internal link checks Report an error

  “Orphan Pages are pages that are not linked to from another section of your site.”

• Click path Report an error

  “Click Path Analysis allows you to see how visitors may be moving through your website.”

• Sitemap audit Report an error

  “Crawled Sitemaps”

• Cpr metric Report an error

  “For each page, it is displayed the cognitiveSEO PageRank (CPR), the number of referring domains and referring URLs.”

• Other modules Report an error

  “Click on the tools that you want to setup or edit: Site Audit, Link Analysis, Rank Tracking, Social Media or Google Analytics.”

Scores citing this record

• The Agency Owner Crawling & technical audit
• The Agency Owner Rank tracking & index quality
• The Content Strategist Crawling & technical audit
• The Data Analyst Crawling & technical audit
• The In-House SEO Lead Crawling & technical audit
• The Skeptic Crawling & technical audit
• The Technical SEO Crawling & technical audit