❗The content presented here is sourced directly from Youtube platform. For comprehensive course details, including enrollment information, simply click on the 'Go to class' link on our website.
Updated in [July 24th, 2023]
Design a Basic Search Engine (Google or Bing) System Design Interview Prep
This course provides an overview of the design of a basic search engine system, such as Google or Bing. It covers the requirements of the system, how search works, and the design of the system components. The course also covers scalability considerations, such as database sharding and global indexing. Finally, the course covers crawling and politeness considerations, as well as extensions to the system.
The course begins by discussing the requirements of the system, including retrieval, indexing, and scalability. It then covers how search works, including the API for accepting search queries, the database for storing site metadata, and the page BLOB store. The course then covers database sharding and global indexing, as well as text indexing.
The course then covers crawling, including robots.txt cache, crawler demands, and the URL frontier. It covers priority and politeness considerations, as well as multiple queues and solving for politeness. Finally, the course covers a full design review and extensions to the system.
By the end of this course, students will have a comprehensive understanding of the design of a basic search engine system. They will be able to design and implement a system that meets the requirements of retrieval, indexing, and scalability. They will also be able to design a system that is able to crawl and index web pages from the Internet, and handle a large number of queries and indexed web pages.
