This spider can start crawling from a group of profile urls, then expend to all the friends. It will collect all basic information on the profile page and all posts on the timeline.
- install virtual environment
virtualenv venv
source venv/bin/activate
- install packges
pip install -r requuirements.txt
- add environment variables
FACEBOOK_EMAIL=xxxx
FACEBOOK_PASS=xxxx
- start crawling
scrapy crawl facebook