Jump to content

Locked Crawlergo 0.4.2 - A Powerful Browser Crawler For Web Vulnerability Scanners


Recommended Posts

This is the hidden content, please

crawlergo is a browser crawler that uses chrome headless mode for URL collection. It hooks key positions of the whole web page with DOM rendering stage, automatically fills and submits forms, with intelligent JS event triggering, and collects as many entries exposed by the website as possible. The built-in URL de-duplication module filters out a large number of pseudo-static URLs, still maintains a fast parsing and crawling speed for large websites, and finally gets a high-quality collection of request results.

crawlergo currently supports the following features:

    chrome browser environment rendering
    Intelligent form filling, automated submission
    Full DOM event collection with automated triggering
    Smart URL de-duplication to remove most duplicate requests
    Intelligent analysis of web pages and collection of URLs, including javascript file content, page comments, robots.txt files and automatic Fuzz of common paths
    Support Host binding, automatically fix and add Referer
    Support browser request proxy
    Support pushing the results to passive web vulnerability scanners

This is the hidden content, please

Link to comment
Share on other sites

This topic is now closed to further replies.
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.