User-agent: *
Disallow: /tng/ # TNG files are the php to access my database
User-agent: Accelobot Disallow: / User-agent: AtlocalBot Disallow: / User-agent: archive.org_bot Disallow: / User-agent: BecomeBot Disallow: / User-agent: CazoodleBot Disallow: / User-agent: Clushbot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: crawl Disallow: / User-agent: Gigabot Disallow: / User-agent: grub-client Disallow: / User-agent: Homerbot Disallow: / User-agent: ia_archiver Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: linksmanager_bot Disallow: / User-agent: LocalcomBot Disallow: / User-agent: MSRBot Disallow: / User-agent: NaverBot Disalloe: / User-agent: NextGenSearchBot Disallow: / User-agent: NPBot Disallow: / User-agent: Nutch Disallow: / User-agent: Openbot Disallow: / User-agent: Psbot Disallow: / User-agent: SBIder Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: Slurp Disallow: / User-agent: Sproose Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Visbot Disallow: / User-agent: VoilaBot Disallow: / User-agent: * Disallow: /agility/ Disallow: /bookcovers/ Disallow: /candid/ Disallow: /candid2/ Disallow: /candid3/ Disallow: /cgi-bin/ Disallow: /daily/ Disallow: /dbdoc/ Disallow: /ears/ Disallow: /ebay/ Disallow: /forums/ Disallow: /gallery/ Disallow: /grooming/ Disallow: /guestbook/ Disallow: /historical/ Disallow: /holidays/ Disallow: /humans/ Disallow: /images/ Disallow: /irterrl/ Disallow: /links/ Disallow: /london/ Disallow: /maps/ Disallow: /misc/ Disallow: /music/ Disallow: /obedience/ Disallow: /poll/ Disallow: /portraits/ Disallow: /puppies/ Disallow: /rescue/ Disallow: /show/ Disallow: /sketches/ Disallow: /stats/ Disallow: /test/ Disallow: /treemenu/ Disallow: /ubb/ Disallow: /wfbimages/ Disallow: /wfbtrash/