Custom crawl user-agent cannot contain colon (Burp 126.96.36.199)
I am setting up a custom crawler function, and tried to set-up a user-agent like this:
Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0
However, this does not succeed and gives the error-message:
"custom user-agent cannot contain colon"
Is there any reason for this? Many WAFs try to block scans with user-agents that are know to be used from scanners. I would like to have all options open to block this (simple) defense.
Hi Herman, can you clarify what you mean by a custom crawler function?
And is this error appearing in the error log or is this being returned in the response?