Crawl

PnyxBot allows you to crawl websites and add them to your document library. You can create, add, manage and delete crawls from this interface

Each server is currently allowed to add up to 3 crawled URLs to their bot's document library. Each crawl is limited to 200 endpoints.

Creating a crawl

You can create a new crawl using the "Create Crawl" button at the top of the page. This will submit a new crawl, and add it to your list of "Submitted Crawls"

The crawl can take a few minutes, refresh the page to update the status.

Adding the crawl to the document library

Once the crawl is done, you can move it to the bots document library by clicking "Use crawl". This will move the crawl in "In Use", which includes it in your document library.