The reading level for this article is Expert What is the robots.txt file? The robots.txt file is an ASCII text file that has specific instructions for search engine robots about specific content that they are not allowed to...