User-agent: ia_archiver Disallow: / User-agent: itsapic.com_crawler Disallow: / User-agent: dotbot Disallow: / User-agent: twiceler Disallow: / User-agent: discobot Disallow: / User-agent: BPImageWalker Disallow: / User-agent: ImageWalker Disallow: / User-agent: DealGates Disallow: / User-agent: Gaisbot Disallow: / User-agent: webtraq Disallow: / User-agent: MJ12bot Disallow: / User-agent: YodaoBot Disallow: / User-agent: Linguee Disallow: / User-agent: Speedy Disallow: / User-agent: 008 Disallow: / User-agent: turnitinbot Disallow: / User-agent: Abonti Disallow: / User-agent: spbot Disallow: / User-agent: Eurobot Disallow: / User-agent: Baiduspider Disallow: /nl User-agent: CatchBot Disallow: / User-agent: linksmanager_bot Disallow: /nl Disallow: /en/Vacations Disallow: /en/Geocaching Disallow: /en/About_us Disallow: /en/Puzzles User-agent: linksmanager Disallow: /nl Disallow: /en/Vacations Disallow: /en/Geocaching Disallow: /en/About_us Disallow: /en/Puzzles User-agent: Slurp Disallow: /images Disallow: /gps Disallow: /gpx Disallow: /Out.aspx Disallow: /Out_en.aspx Disallow: /Outdoor.aspx Disallow: /Show.aspx User-agent: Yandex Disallow: / User-agent: * Disallow: /Out.aspx Disallow: /Out_en.aspx Disallow: /Outdoor.aspx Disallow: /Show.aspx Disallow: *country=tempCountry* Disallow: *region=tempRegion* Disallow: *city=tempCity* Disallow: *maincategory=tempMaincategory* Disallow: *subcategory=tempSubcategory* Disallow: *category=tempCategory* Disallow: User-agent: msnbot Disallow: /Out.aspx Disallow: /Out_en.aspx Disallow: /Outdoor.aspx Disallow: /Show.aspx User-agent: TwengaBot Disallow: /Out.aspx Disallow: /Out_en.aspx Disallow: /Outdoor.aspx Disallow: /Show.aspx User-agent: TwengaBot-Discover Disallow: /Out.aspx Disallow: /Out_en.aspx Disallow: /Outdoor.aspx Disallow: /Show.aspx User-agent: Slurp Crawl-delay: 5 User-agent: msnbot Crawl-delay: 5 User-agent: TwengaBot Crawl-delay: 5 User-agent: TwengaBot-Discover Crawl-delay: 5 Sitemap: http://www.sanmarko.nl/sitemap_rewrite.xml Sitemap: http://www.sanmarkotravel.com/sitemap_sanmarkotravel.xml Sitemap: http://www.sanmarko.nl/blog/sitemap.xml