If you just want to crawl the most important pages of a site, choosing to crawl from Sitemap instead of Website will let the audit crawl the most important pages, rather than just the ones most accessible from the homepage.
#SEMRUSH SITE AUDIT CODE#
Crawling from Website means we will crawl your site like the GoogleBot, using a breadth-first search algorithm and navigating through the links we see on your page’s code - starting from the homepage. There are 4 options to set as your Audit’s crawl source: Website, Sitemap on site, Sitemap by URL, and a file of URLs. In addition to setting the crawl source, you can set masks and parameters to include/exclude from the audit in steps 3 and 4 of the setup wizard. Setting the crawl source determines how the Semrush Site Audit bot crawls your website and finds pages to audit.
#SEMRUSH SITE AUDIT PRO#
Pro users can crawl up to 100,000 pages per month and 20,000 pages per audit.You can enter a custom amount using the “Custom” option. You will want to choose this number wisely, depending on the level of your subscription and how often you plan on re-auditing your website. Next, select how many pages you want to crawl per audit. You can specify the crawl scope as or /blog/ depending on whether it’s implemented as a subdomain or a subfolder. In Site Audit settings, you can specify your subdomain or subfolder like a crawl scope and untick ‘Crawl all subdomains’, if you don’t want other subdomains to be crawled.įor example, you want to audit only the blog of your website. If you enter a domain in this field, you’ll be given the option to crawl all subdomains of your domain with a checkbox.īy default the tool checks the root domain, which includes all available subdomains and subfolders of your site. To crawl a specific domain, subdomain, or subfolder, you can enter it into the “Crawl scope” field. But don't worry, you can always change your settings and re-run your audit to crawl a more specific area of your site after your initial set up.
You’ll be taken to the first part of the setup wizard, Domain and Limit Pages. From here, you can either choose to “Start Site Audit,” which will immediately run an audit of your site with our default settings, or proceed to customize the settings of your audit to your liking.
0 kommentar(er)
