Easyspider - Distributed Web Crawler Reviews

Easyspider is a perl client/Server architecture to crawl the web for interessting webpages. The Server can be any box that has internet access and allows perl programms to run. The client connects to the server, gets its working task, fullfills it and give the resuts as xml stream back to the server. the server then can install that xml file into a oracle/mysql/mariadb etc database or can be parsed by the sphinxsearch.com fulltext indexer to generate searchable content for your webpage. Happy Hacking ;-)