Exploring Selenium
In this lesson, a scraping and automation tool named selenium is discussed.
We'll cover the following...
Selenium
Selenium is a browser automation tool. It is mostly used for automated testing purposes but in this course, this tool will be used to scrape information from websites.
While scraping information, all the information we need is never simply on a single page. Some buttons need to be clicked to traverse through the website to get to the required data, and then it is scraped and stored. Detailed info on selenium can be found here.
How it works
Selenium opens a browser and goes to the initial link given to it. Then, the user has the power to make it do anything as if they are controlling the browser behavior themselves. It locates specific elements in the HTML DOM structure and applies the action we want on that element. Selenium selects the elements on a web page through the following ...