Crawling & technical audit — found from sitemap — Surfer

Cited by

Facts read from this source

• Audit crawler ip whitelisting Report an error

  “You can ask our Support Team to name a bot for you to help address this issue. However, note that you can't whitelist us using IPs.”

• Audit query stall threshold Report an error

  “In general, if your query takes over 10 minutes to load, it will most likely not load at all and can be considered stalled.”

• Audit failed query reimbursement Report an error

  “If your new query loads with an error, your limit is automatically reimbursed, and you may need to follow the next steps in this article to resolve it.”

• Branded keyword serps requirement Report an error

  “Surfer needs three to five unique domains within the top ten to properly assess guidelines, so you may want to reconsider your target keyword instead.”

• Infinite scrolling audit support Report an error

  “Unfortunately, for now, we don’t have the option to audit pages with infinite scrolling, but you can always use our Content Editor as a workaround.”

• Crawler adblock Report an error

  “Our crawler uses an ad block when crawling pages and some elements on your page; for example, pop-ups can trigger our ad blocker, and as a result, your Audit might fail.”

• Geo blocked page audit Report an error

  “If your pages are geo-restricted, our crawlers won't be able to analyze your page content properly because they're blocked on a per-region basis.”

• Crawler user agent masking Report an error

  “Since our crawler masks as a regular visitor, when it visits your page, a redirect will be triggered as well.”

• Audit serp analyzer crawler check Report an error

  “You can verify this by taking a screenshot on SERP Analyzer to check how our crawlers see your page.”