Burp Suite User Forum

Create new post

Crawling a website in community edition

Carl | Last updated: Jul 18, 2019 03:01PM UTC

Hello, Since the spider was removed and replaced by the crawler, is it no longer possible to crawl/spider websites with the community edition? Whenever I right click a node, such as the root node of a website, on the target tab and choose "Scan", a new task is created, but it says "Crawl finished", with 0 requests (0 errors) and 0 locations crawled.

Liam, PortSwigger Agent | Last updated: Jul 18, 2019 03:04PM UTC

Carl, it is no longer possible to crawl applications using the community edition. The scan feature will be removed from the UI. Please let us know if you need any further assistance.

QuinnElko | Last updated: Jan 07, 2024 03:07AM UTC

Carl, If you're still looking to crawl a site, you can use GoSpider. You can send all the responses to the burp proxy with the -p function. GoSpider is in the Kali linux repo. Best

You must be an existing, logged-in customer to reply to a thread. Please email us for additional support.