Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Burp suite Community 2.1 Crawl

Venom Jun 28, 2019 01:06PM UTC

I'm not sure am i doing something wrong or why Crawl scan is not working?
After i configured settings and started it, it says "Crawl finished." under dashboard.
Other thing i noticed that under "Proxy" and "Intercept" there is "Intercept is Ofl" not "Off".
Best regards

Liam Tai-Hogan Jun 28, 2019 01:09PM UTC Support Center agent

Do you see any errors in the Event log?

If you manually browse the site does the Target > Site map populate?

Venom Jun 28, 2019 01:13PM UTC
No errors in Event log.
Yes manually everything works perfectly.

Liam Tai-Hogan Jun 28, 2019 01:32PM UTC Support Center agent

Sorry, I didn’t notice that you’re using the Community Edition.

Burp Crawler is part of Burp Suite Professional.

Venom Jun 28, 2019 02:02PM UTC
Ohh, allright.
So in the ver. 2 in Community version there is spider function gone too or is there anything similar to that?

AA Jun 30, 2019 07:58AM UTC
I'd also be interesting in finding an answer to this. Is there any equivalent to Spider in the Community Edition post v2 or has that been stripped out and restricted to paying customers?

Liam Tai-Hogan Jul 01, 2019 01:03PM UTC Support Center agent

The Spider function has been removed from Burp 2 Pro and Community.

The Spider was becoming increasingly obsolete for use with modern applications.

We are considering adding another task to both Pro and Community that would fetch content in the same way Burp Spider would. Unfortunately, we can’t provide an ETA for this feature.

JP Jul 15, 2019 12:27PM UTC
If the crawling feature is restricted to the Pro version, can this be indicated in the UI on Community?

Currently when you right click on a site and chose "Scan", you get taken to the "New scan" screen. The "Crawl and audit" and "Audit selected items" options are both greyed out with some text indicating that they're only available in pro, but "Crawl" doesn't have this, and it lets you configure the scan and apparently run it.

The scan then completed immediately with no requests, and no indication that this functionality is only available in the paid version.

This means wasted time for both Venom and myself (and probably others) trying to work out why the Crawl doesn't seem to be doing anything, until I came across this thread which says that's by designed. It also makes it just makes it look like the feature is broken.

Please can the "Crawl" option be disabled like the auditing options are so this is clear in future? Or even just the whole "Scan" menu item, since it does nothing in Community.


- JP

Rose Krawczuk Jul 17, 2019 08:59AM UTC Support Center agent

JP, thanks for this report. It should have been fixed in the latest version. Let us know if there are still any issues.

Post Your public answer

Your name
Your email address