Crawlers (or bots) are used to assemble info obtainable on the internet. By utilizing web site navigation menus, and reading internal and exterior hyperlinks, the bots start to understand the context of a web page. Of course, the words, images, and other knowledge on pages also assist search engines