What is a robots file?

A robots file is a list of any pages that you do not want the search engines to see and index.