Skip to main content

DailyWiki: Building a Web Scraper with Python

Hands-On Lab


Photo of

Training Architect





Virtually limitless information is housed on the internet, but not all of it is accessible via APIs. Web scraping allows us to extract information from web pages so that we can use it in other applications or access it in different formats. In this hands-on lab, we'll use Scrapy to create a web scraper that will fetch us Wikipedia's featured articles and export them as a JSON file that we can access later.

What are Hands-On Labs?

Hands-On Labs are scenario-based learning environments where learners can practice without consequences. Don't compromise a system or waste money on expensive downloads. Practice real-world skills without the real-world risk, no assembly required.