These choices can even be mixed to improve effectiveness. To start with, in the event you’re in memory storage manner you need to help save the crawl through the ‘File > Conserve’ menu ahead of altering configurations.Chances are you'll detect some URLs which aren't in the /site/ subfolder are crawled at the same time by default. This can be