(Last Updated: 1/2020)

https://www.udemy.com/course/scrapy-tutorial-web-scraping-with-python/

Python Scrapy Tutorial - Learn how to scrape websites and build a powerful web crawler using Scrapy, Splash and Python

What you'll learn

Creating a web crawler in Scrapy

Crawling a single or multiple pages and scrape data

Deploying & Scheduling Spiders to ScrapingHub

Logging into Websites with Scrapy

Running Scrapy as a Standalone Script

Integrating Splash with Scrapy to scrape javascript rendered websites

Using Scrapy with Selenium in Special Cases, e.g. to Scrape javascript Driven Web Pages

Building Scrapy Advanced Spider

More functions that Scrapy offers after Spider is Done with Scraping

Editing and Using Scrapy Parameters

Exporting data extracted by Scrapy into CSV, Excel, XML, or JSON files

Storing data extracted by Scrapy into MySQL and MongoDB databases

Several real-life web scraping projects, including Craigslist, LinkedIn and many others

Python source code for all exercises in this Scrapy tutorial can be downloaded

Q&A board to send your questions and get them answered quickly