Web app for Scrapyd cluster management
Web Scraping Framework
Web crawler that finds hidden web directories without brute force
Descubre archivos, rutas escondidas realizando busquedas avanzadas
Intelligent proxy pool for collecting and managing public proxies
Asynchronous tool for finding and checking public proxy servers
Distributed proxy IP pool for web crawlers using Scrapy and Redis
DSTK - DataScience ToolKit for All of Us
Finds all the security information for a given domain name
A web crawler oriented to information security.