File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed
Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change 11# dmcrawler (Douban Movie Crawler)
22Author: Muchenxuan Tong
< [email protected] > 33
4- A Clojure-based Crawler for fetching short comments from Douban movie page. (e.g. http://movie.douban.com/subject/11529526/comments?sort=time )
4+ A Clojure-based crawler for fetching short comments from Douban movie page. (e.g. http://movie.douban.com/subject/11529526/comments?sort=time )
55
66Features:
7- - Store and restore context when problems happened or the program shutted down.
7+ - Store context when problems happened or the program shutted down.
88- Parallelized crawling on a single machine.
9- - Data are stored in the database, with the time of storage information attached.
9+ - Data are stored in the database, with the storage time attached.
1010
1111## Usage
1212
You can’t perform that action at this time.
0 commit comments