Replicating scrapy shell capabilities in PyCharm python console
2 answers
I got it by running the following python snippet:
from scrapy.cmdline import execute
import sys
sys.argv = ['scrapy', 'shell', 'http://scrapy.org']
execute()
If you get the following error:
MultipleInstanceError: Multiple incompatible subclass instances of InteractiveShellEmbed are being created.
then you need to add the following line to scrapy.cfg:
shell=python
+2
source to share