A general web scraper that uses the requests library to communicate with the website.

Scraper() contains a parser object, which you can add parsing handles to.

ParseHandle() is the code mining for you data from an html source.

Repo: https://github.com/crispycret/web_excavator

Project Activity

See All Activity >

Categories

Web Scrapers

Follow python-web_excavator

python-web_excavator Web Site

Other Useful Business Software
Auth for GenAI | Auth0 Icon
Auth for GenAI | Auth0

Enable AI agents to securely access tools, workflows, and data with fine-grained control and just a few lines of code.

Easily implement secure login experiences for AI Agents - from interactive chatbots to background workers with Auth0. Auth for GenAI is now available in Developer Preview
Try free now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of python-web_excavator!

Additional Project Details

Registered

2014-12-15