Crawling & technical audit — found from sitemap — Netpeak Spider

Cited by

Facts read from this source

• Default threads Report an error

  “Crawling in 10 threads → the optimal number of threads that most sites can handle.”

• Default timeout ms Report an error

  “Maximum waiting time for server response – 30 000 milliseconds.”

• Js rendering default Report an error

  “Enable JavaScript rendering → by default this feature is disabled.”

• Js rendering capability Report an error

  “The feature allows you to crawl a URL with JavaScript code execution. This is necessary when part or all of the content is generated using JS frameworks and CSR (Client Side Rendering) technology.”

• Subdomain crawling Report an error

  “Crawl all subdomains → allows considering subdomains as a part of the current website. All subdomains will be crawled and links to them will be considered internal.”

• Image checking Report an error

  “Check images → this feature allows you to collect common SEO parameters of images and detect ‘Broken images‘ and ‘Max image size‘ issues.”

• Pdf checking Report an error

  “Check PDF → allows collecting common SEO parameters.”

• Mime type checking Report an error

  “Check other MIME types → allows collecting common SEO parameters for RSS feeds, archives, documents, video and audio files.”

• Hreflang crawling Report an error

  “Hreflang → allows you to follow the links from hreflang attribute in the tag of the section of HTTP response header ‘Link: rel=”alternate”‘.”

• Amp crawling Report an error

  “AMP HTML → allows you to follow and check links where AMP technology is introduced.”

• Cookie support Report an error

  “Cookie file is allowed. Check in case the analyzed website is closed for all requests without a cookie file.”

• Max redirects default Report an error

  “Max number of redirects – 5.”

• Threads changeable during crawl Report an error

  “Only the number of threads can be changed directly during the crawling process.”

• Pause resume Report an error

  “Crawling can be stopped at any stage by using the ‘Pause‘ button. To continue crawling (e.g. after changing settings), hit ‘Start‘, and it will start from where it had stopped.”

• Automatic analysis Report an error

  “When the crawling is finished (or paused), the data analysis will automatically begin: the program will detect duplicates, incoming links, Canonical chains and calculate internal PageRank”

• Analytics sources Report an error

  “Also the program gets data from Google Search Console, Google Analytics, Yandex.Metrika, and queries from Google Search Console”

• Project saving Report an error

  “In order to save the project, select ‘Save... ‘ (Ctrl+S), or ‘Quick Save‘ (Ctrl+Shift+S) on the control panel in the ‘Project‘ dropdown menu.”

• Export reports Report an error

  “Choose the necessary report template in the ‘Export‘ menu of the control panel or in the main menu. Download current results from ‘Dashboard’ via the ‘Export... ‘ button”

• Settings templates Report an error

  “You can always return to default template by choosing it from a template dropdown menu in the upper settings window”

Scores citing this record

• The Agency Owner Crawling & technical audit
• The Agency Owner Reporting, integrations & API
• The Agency Owner Data portability & exit
• The Agency Owner European sovereignty
• The Content Strategist Crawling & technical audit
• The Content Strategist Reporting, integrations & API
• The Content Strategist Data portability & exit
• The Content Strategist European sovereignty
• The Data Analyst Crawling & technical audit
• The Data Analyst Reporting, integrations & API
• The Data Analyst Data portability & exit
• The In-House SEO Lead Crawling & technical audit
• The In-House SEO Lead Data portability & exit
• The In-House SEO Lead European sovereignty
• The Skeptic Crawling & technical audit
• The Skeptic Reporting, integrations & API
• The Skeptic Data portability & exit
• The Technical SEO Crawling & technical audit
• The Technical SEO Data portability & exit
• The Technical SEO European sovereignty