Clever Geek Handbook

Scrapy: use a specific python version

I tried to run scrapy in my centers. Since centos comes with python2.6 installed and scrapy requires python2.7, I tried to create a virtual environment and run scrapy inside it, but I still get the error

Scrapy 0.24.4 requires Python 2.7.

This is my result when running a spider

(scrapyproject)[imadmin@IM03 tutorial]$ python --version
Python 2.7.6
(scrapyproject)[imadmin@IM03 tutorial]$ scrapy gen_spider
Scrapy 0.24.4 requires Python 2.7

I even tried setting up a shell alias:

alias python=/usr/local/bin/python2.7

It didn't work either.

thank

+3


source to share


2 answers


You have to install scrapy inside virtual environment (ie run pip install scrapy

after virtual env "scrapyproject" is activated).

Now when you do this, the command scrapy

cannot be found inside the virtual env, so it is called outside the virtual env.



PS Remove the alias.

+1


source


The problem here is that the scrapy gen_spider command is looking for a scrapy installation that is outside of your virtualenv.

Modify your $ PATH to include the scrapy installation (which is inside your virtualenv) before everything else.



Example:

export PATH = / root / virtualenv-1.11.6 / localenv / bin: /root/virtualenv-1.11.6/localenv/lib/python2.7/site-packages: / usr / local / sbin: / usr / local / bin : / Sbin: / bin: / usr / sbin: / usr / bin: / root / bin

0


source






More articles:


All Articles