User-agent: Googlebot Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: Mediapartners-Google Disallow: User-agent: Bingbot Disallow: User-agent: MSNBot Disallow: User-agent: BingPreview Disallow: User-agent: Slurp Disallow: User-agent: Baiduspider Disallow: User-agent: Baiduspider-mobile Disallow: User-agent: YandexBot Disallow: User-agent: grapeshot Disallow: User-agent: Twitterbot Disallow: User-agent: * Disallow: / Crawl-delay: 10 Host: www.ratemyprofessors.com