#robots.txt #05/07/08 #this file dictates which folders and files bots may and may-not index #it must be named "robots.txt" and placed in the webRoot. ("/robots.txt") User-agent: * Disallow: /images/ Disallow: /pages/