# robots.txt# Robot-exclusion file for rgs.rice.edu # Please contact graduate@rice.edu when making additions. # See: http://info.webcrawler.com/mak/projects/robots/norobots.html # To disallow all Robots - User-agent: *Disallow: / User-agent: * # ROOT DIRECTORY EXCLUSIONS FOLLOW Disallow: /SubSystems/ Disallow: /CertAuthority/ Disallow: /Cfdocs/ Disallow: /Cfide/ Disallow: /classes/ Disallow: /handf/ Disallow: /images/ Disallow: /mainmenuimages/ Disallow: /newimages/ Disallow: /Utils/ Disallow: /cristobal/ Disallow: /Search/ Disallow: /OISS/ # GLOBAL DIRECTORY EXCLUSIONS FOLLOW Disallow: Admin/ Disallow: 1rgsadmin012063/ Disallow: HandF/ Disallow: images/ Disallow: ExeterReports/ Disallow: OnlineApp/ Disallow: cristobal/ Disallow: _text/ Disallow: Research/Services/ # added 2/21/08 by C Schanzmeyer Disallow: /styles/ Disallow: /Hooding/ Disallow: /GradNews/ Disallow: /includes/ Disallow: /FacInit/ Disallow: /CRF/ Disallow: /interimFiles/ Disallow: /Services/