Scrapy is a python module that allows you to crawl and extract data from web pages. It is an open-source framework that contains many inbulit functions that make crawling easier. But many new beginners are unable to install it on Pycharm. When you try to import this package then they will get an import no module not found error. It can be solved by installing it. In this entire tutorial, you will know how to install Scrapy in Pycharm step by step.
Scrapy Import Error
If you have not installed Scapy in Pycharm and try to import it using the import statement then you will see red color underline below the import error. It tells you that you have to install it.
Step by Step to Install Scrapy in Pycharm
Step 1: Go to File>>Setting and click on your Project: your_project_name. In my case the name of the project is scrapy-tutorial. There you will the two options like the below image.
Step 2: Click on the Project Interpreter. There you will see all the list of installed packages. You can see Scrapy is not installed.
Step 3: After step 2. You will see the “+” window on the top right side of the Pycharm window.
Step 4: After clicking the plus sign you will see the search window. Type there scrapy. You will see the list of all the scrapy modules from different authors.
Step 5: Select the Offical Scrapy Module and click on the Install Package.
It will start installing the Scrapy package in your Pycharm. After Installation, you will get the notification that Scrapy has been successfully installed.
If the above steps are unable to install the Scrapy package then you can also manually install the package using your Pycharm Terminal. Follow the steps below.
Step 1: Go to your Pycharm Terminal. You will find it at the bottom of the Pycharm window.
Step 2: Type the following command in your terminal.
For python 3.xx
pip3 install Scrapy
For python 2.xx
pip install Scrapy
It will successfully install the Scrapy python package.
How to check the version of the installed Module?
After the installation, you can also check the version of the installed Scrapy module. Use the below code to see the version.
import scrapy print(scrapy.__version__)
You can also check the version using the Pycharm terminal. Go to the terminal and type the following command
It will show the output.
Scrapy is a popular web scrapping python module. You can crawl anything from the website using it and also save the data to your database. There are the steps to install Scrapy in Pycharm. Hope this tutorial has solved your queries on installing Scrapy. Even if you have doubt you can contact us for more help.
Join our list
Subscribe to our mailing list and get interesting stuff and updates to your email inbox.