Building Your First Web Scraping Application

In this chapter, we'll cover the following recipes:

• Downloading web pages
• Parsing HTML
• Crawling the web
• Subscribing to feeds
• Accessing web APIs
• Interacting with forms
• Using Selenium for advanced interaction
• Accessing password-protected pages
• Speeding up web scraping