NOT KNOWN FACTS ABOUT PDF CREATION FROM DOCUMENTS

In order to avoid unwanted content in the search indexes, webmasters can instruct spiders never to crawl sure files or directories through the standard robots.txt file in the foundation directory in the domain. Also, a website page can be explicitly excluded from a online search engine's database by making use of a meta tag particular to robots (ty