#/robots.txt file for https://price.geekzone.co.nz User-agent: Teemer Disallow: / User-agent: NetSeer Disallow: / User-agent: dotbot Disallow: / User-agent: DomainCrawler Disallow: / User-agent: Baiduspider Disallow: / User-agent: Eurobot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: WebReaper Disallow: / User-agent: Wget Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: MJ12bot Disallow: / User-agent: ia_archiver Disallow: / User-agent: Onet.pl Disallow: / User-agent: Yandex Disallow: / User-agent: Gigabot Disallow: / User-agent: ShopWiki Disallow: / User-agent: psbot Disallow: / User-agent: ia_archiver Disallow: / User-agent: ichiro Disallow: / User-agent: CyberPatrol Disallow: / User-agent: HouxouCrawler Disallow: / User-agent: twiceler Disallow: / User-agent: Slurp Crawl-delay: 5 User-agent: msnbot Crawl-Delay: 10 User-agent: TurnitinBot Disallow: / user-agent:* Disallow: User-agent: Charlotte Disallow: / Crawl-Delay: 30 User-agent: Mediapartners-Google Crawl-delay: 5 User-agent: spbot Disallow: / Sitemap: https://price.geekzone.co.nz/sitemap/SiteMap.xml Disallow:/ResponseRedirect.aspx Disallow:/RetailerReview/ Disallow:/members/productreview.aspx Disallow:/ReviewRedirect.aspx? Disallow:/ReportLocation.aspx Disallow:/DealPostBack.aspx Disallow:/ReportProduct.aspx Disallow:/.axd$ User-agent: almaden Disallow: / User-agent: ASPSeek Disallow: / User-agent: dumbBot Disallow: / User-agent: Generic Disallow: / User-agent: grub-client Disallow: / User-agent: NexaBot Disallow: / User-agent: NPBot Disallow: / User-agent: OWR_Crawler Disallow: / User-agent: rabaz Disallow: / User-agent: RPT-HTTPClient Disallow: / User-agent: ScoutAbout Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: Cherry Picker Disallow: / User-agent: Crescent Internet ToolPak Disallow: / User-agent: DISCo Pump Disallow: / User-agent: szukacz Disallow: / User-agent: Teleport Disallow: / User-agent: Telesoft Disallow: / User-Agent: Ultraseek Disallow: / User-Agent: vspider Disallow: / User-Agent: WebCopier Disallow: / User-Agent: WebEMailExtractor Disallow: / User-Agent: Webster Pro Disallow: / User-Agent: WebStripper Disallow: / User-agent: IsraBot Disallow: User-agent: Orthogaffe Disallow: User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: Zealbot Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: Download Ninja Disallow: / User-Agent: grub Disallow: / User-agent: k2spider Disallow: / User-Agent: EmailSiphon Disallow: / User-Agent: htdig Disallow: / User-Agent: LNSpiderGuy Disallow: / User-Agent: Netprospector Disallow: / User-Agent: PerMan Surfer Disallow: / User-agent: Fetch Disallow: / User-agent: Offline Explorer Disallow: / User-agent: TeleportPro Disallow: / User-Agent: YahooSeeker Disallow: / User-Agent: BecomeBot Disallow: / User-agent: e-SocietyRobot Disallow: /