Pyspider随笔

安装Pyspider

pip install pyspider

安装phantomjs

1. yum install fontconfig freetype freetype-devel fontconfig-devel libstdc++

2. wget https://bitbucket.org/ariya/phantomjs/downloads/phantomjs-2.1.1-linux-x86_64.tar.bz2

3. mkdir -p /opt/phantomjs

4. tar -xjvf phantomjs-2.1.1-linux-x86_64.tar.bz2 /opt/phantomjs/

5. ln -s /opt/phantomjs/bin/phantomjs /usr/bin/phantomjs

6. phantomjs /opt/phantomjs/examples/hello.js

分布式