Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.

Project Activity

See All Activity >

Categories

Browsers, Search Engines, Link Checking, Web Scrapers

License

BSD License

Follow ASpider

ASpider Web Site

Other Useful Business Software
Our Free Plans just got better! | Auth0 Icon
Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of ASpider!

Additional Project Details

Languages

English

Intended Audience

End Users/Desktop

User Interface

Command-line

Programming Language

Java

Database Environment

Flat-file

Related Categories

Java Browsers, Java Search Engines, Java Link Checking Software, Java Web Scrapers

Registered

2004-12-15
Report inappropriate content