This crawler is able to help me crawl the publicly viewable information of a user or a venue in Dazhong Dianping (http://www.dianping.com/aboutus).
We have tested our crawler on Ubuntu (version: 14.04). Please make sure that you have installed Python2.7 and Selenium Webdriver.
Usage:
-
Change directory to User_Crawler.
-
Run 'bash install.sh' (no sudo please) to set everything ready for user crawler to run.
-
Manually fill inputfile.txt with the users you are to crawl, one ID in each line without any formats.
-
Run crawler using bash command 'xvfb-run python dianping_u_script.py'.
-
When it is done, you can collect your data in 'User_Crawler/Data' folder.
Will be released soon.
See the LICENSE file for license rights and limitations (MIT).