Ability to scrap & crawl all pages on entire sitemap and train in bulk

So that it will be possible to train the chatbot with all of the data in all categories, subcategories, and product pages or other custom pages.

Or, at least, one category page with pages in all subcategories every time.