Requirements

Let’s highlight the functional and non-functional requirements of a web crawler.

Functional requirements

These are the functionalities a user must be able to perform:

  • Crawling: The system should scour the WWW, spanning from a queue of seed URLs provided initially by the system administrator.

Level up your interview prep. Join Educative to access 80+ hands-on prep courses.