Understand the Website

In this lesson, we’ll apply the knowledge we learned about web scraping to solve a real-world problem. We need to create a dataset on books, and we’ll collect that data from this website. Assume the following are the requirements we are given to perform this scraping task,

• Get a list of book categories.

• Get details of a specific book like title, price, description, etc.

• Get details of all books under different categories.

Locate information on the website

When we get the requirements, the first thing to do is surf through the website and identify where the required information is stored and how the website is structured.