Skip to content

evandowning/selenium-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

selenium-crawler

A webcrawler implemented using selenium and Google Chrome

Requirements

  • Debian 8 (Jessie)
  • Python 2.7
  • Google Chrome
  • selenium==3.11.0
  • pyvirtualdisplay==0.2.1

Installation

Usage

$ python crawler.py target-folder/

NOTES

The page ranges in "urllist.txt" were retrieved manually. In the future it should be automated.

About

A webcrawler implemented using selenium

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages