User-agent: * Allow: / Disallow: /cmsdesk/ Disallow: /cmshelp/ Disallow: /sass user-agent: AhrefsBot Disallow: / User-agent: Baiduspider Disallow: User-agent: Yandex Disallow: / User-agent: MJ12bot Disallow: / User-agent: MJ12bot/v1.4.5 Disallow: / User-agent: MJ12bot/v1.4.5 Disallow: / User-agent: 007ac9 Disallow: / User-agent: 007ac9 Crawler Disallow: / User-agent: 2ADAMbot Disallow: / User-agent: 2ADAMbot/1.0 Disallow: / User-agent: 200PleaseBot Disallow: / User-agent: 360Spider Disallow: / User-agent: &as_qdr=all Disallow: / user-agent: Abonti Disallow: / user-agent: Abonti/0.92 Disallow: / user-agent: abot v1.0 Disallow: / user-agent: aboutthedomain Disallow: / user-agent: Add Catalog Disallow: / user-agent: Add Catalog/2.1 Disallow: / user-agent: AdvBot Disallow: / user-agent: AdvBot/2.0 Disallow: / user-agent: Affectv Robot v1.0/Nutch-1.6 Disallow: / user-agent: AhrefsBot Disallow: / user-agent: Ahrefs-Bot Disallow: / user-agent: Ahrefs-Bot/1.0 Disallow: / user-agent: aiHitBot Disallow: / user-agent: aiHitBot/2.9 Disallow: / user-agent: Aitellu Disallow: / user-agent: Aitellu ForumSwarm Disallow: / user-agent: Aitellu ForumSwarm http://www.aitellu.com Disallow: / user-agent: Anonymous Disallow: / user-agent: Anonymous/0.0 Disallow: / user-agent: Apache-HttpClient/4.1.1 (java 1.5) Disallow: / user-agent: Apache-HttpClient/4.1.3 (java 1.5) Disallow: / user-agent: Apache-HttpClient/4.2.5 (java 1.5) Disallow: / user-agent: Apache-HttpClient/4.3.5 (java 1.5) Disallow: / user-agent: Associative Spider Disallow: / User-agent: Baidu Spider Disallow: / User-agent: Battleztar Bazinga Disallow: / User-agent: Battleztar Bazinga/0.01 Disallow: / User-agent: betaBot Disallow: / User-agent: bieshu Disallow: / User-agent: Bigli SEO Disallow: / User-agent: Blackboard Safeassign Disallow: / User-agent: Blazer 1.0 Disallow: / User-agent: BLEXBot Disallow: / User-agent: BLEXBot/1.0 Disallow: / User-agent: BLP_bbot Disallow: / User-agent: BLP_bbot/0.1 Disallow: / User-agent: BOIA-Accessibility-Agent Disallow: / User-agent: BOIA-Accessibility-Agent/PR 1.0 Disallow: / User-agent: BOT for JCE Disallow: / User-agent: BOT/0.1 (BOT for JCE) Disallow: / User-agent: BUbiNG Disallow: / User-agent: BuiBui-Bot Disallow: / User-agent: BuiBui-Bot/1.0 Disallow: / User-agent: ca-crawler Disallow: / User-agent: ca-crawler/1.0 Disallow: / User-agent: CakePHP Disallow: / User-agent: Calypso Disallow: / User-agent: Calypso v/0.01 Disallow: / User-agent: CamelHttpStream/1.0 Evolution/3.2.2 Disallow: / User-agent: CB/Nutch-1.7 Disallow: / User-agent: CCBot Disallow: / User-agent: CCBot/2.0 Disallow: / User-agent: chushou Disallow: / User-agent: Cliqzbot Disallow: / User-agent: Cliqzbot/0.1 Disallow: / User-agent: CloudServerMarketSpider Disallow: / User-agent: CloudServerMarketSpider/1.0 Disallow: / User-agent: CMS Crawler Disallow: / User-agent: CMS Crawler: http://www.cmscrawler.com Disallow: / User-agent: coccoc Disallow: / User-agent: CoinCornerBot Disallow: / User-agent: CoinCornerBot/1.1 Disallow: / User-agent: Copyscape Disallow: / User-agent: crawler4j Disallow: / User-agent: CrazyWebCrawler Disallow: / User-agent: CRAZYWEBCRAWLER 0.9.7 Disallow: / User-agent: CrazyWebCrawler-Spider Disallow: / User-agent: Crowsnest Disallow: / User-agent: Crowsnest/0.5 Disallow: / User-agent: CsQuery Disallow: / User-agent: CsQuery/1.3 Disallow: / User-agent: Curious George Disallow: / User-agent: Curious George - www.analyticsseo.com/crawler Disallow: / User-agent: curl/7.15.3 Disallow: / User-agent: curl/7.26.0 Disallow: / User-agent: curl/7.32.0 Disallow: / User-agent: curl/7.37.0 Disallow: / User-agent: curl/7.38.0 Disallow: / User-agent: curl/7.40.0 Disallow: / User-agent: Curl/PHP 5.3.23 Disallow: / User-agent: Curl/PHP 5.3.29 Disallow: / User-agent: Curl/PHP 5.4.37 Disallow: / User-agent: cuwhois Disallow: / User-agent: cuwhois/1.0 Disallow: / User-agent: dahoms Disallow: / User-agent: datagnionbot Disallow: / User-agent: Dispatch/0.11.0 Disallow: / User-agent: DomainAppender Disallow: / User-agent: DomainAppender /1.0 Disallow: / User-agent: Domain Re-Animator Bot Disallow: / User-agent: DomainSigmaCrawler Disallow: / User-agent: DomainSigmaCrawler/0.1 Disallow: / User-agent: Domnutch Disallow: / User-agent: Domnutch-Bot Disallow: / User-agent: Domnutch-Bot/Nutch Disallow: / User-agent: Domnutch-Bot/Nutch-1.0 Disallow: / User-agent: dotbot Disallow: / User-agent: ECCP/1.2.1 Disallow: / User-agent: eCommerceBot Disallow: / User-agent: EPiServer Link Checker Disallow: / User-agent: EuripBot Disallow: / User-agent: EuripBot/2.0 Disallow: / User-agent: evc/2.0 Disallow: / User-agent: evc-batch Disallow: / User-agent: evc-batch/2.0 Disallow: / User-agent: Exabot Disallow: / User-agent: Faraday Disallow: / User-agent: Faraday v0.8.8 Disallow: / User-agent: Findxbot Disallow: / User-agent: Findxbot/1.0 Disallow: / User-agent: Flamingo_SearchEngine Disallow: / User-agent: Flipboard Robot Disallow: / User-agent: getrequest Disallow: / User-agent: getrequest/1.0 Disallow: / User-agent: GigablastOpenSource Disallow: / User-agent: GigablastOpenSource/1.0 Disallow: / User-agent: Girafabot Disallow: / User-agent: Gluten Free Crawler Disallow: / User-agent: Gluten Free Crawler/1.0 Disallow: / User-agent: Go 1.1 package http Disallow: / User-agent: Haiula Disallow: / User-agent: Haiula/1.4 Disallow: / User-agent: HaosouSpider Disallow: / User-agent: heritrix Disallow: / User-agent: heritrix/1.14.4 Disallow: / User-agent: heritrix/3.1.1 Disallow: / User-agent: Hivemind Disallow: / User-agent: HostHarvest Disallow: / User-agent: HostHarvest/0.4.28 Disallow: / User-agent: HRCrawler Disallow: / User-agent: HRCrawler/2.0 Disallow: / User-agent: http://git.io/tl_S2w Disallow: / User-agent: http://www.checkprivacy.or.kr:6600/RS/PRIVACY_ENFAQ.jsp Disallow: / User-agent: httpunit/1.x Disallow: / User-agent: HubSpot Disallow: / User-agent: HubSpot Links Crawler 1.0 Disallow: / User-agent: HubSpot Webcrawler Disallow: / User-agent: hunchan Disallow: / User-agent: HyperCrawl Disallow: / User-agent: HyperCrawl/0.2 Disallow: / User-agent: ICAP-IOD Disallow: / User-agent: Ichiro Robot Disallow: / User-agent: image.coccoc/1.0 Disallow: / User-agent: Indy Library Disallow: / User-agent: integrity/5 Disallow: / User-agent: InterNaetBoten Disallow: / User-agent: InterNaetBoten/0.99 Disallow: / User-agent: jakarta Disallow: / User-agent: Jakarta Commons Disallow: / User-agent: Jakarta Commons-HttpClient Disallow: / User-agent: Jakarta Commons-HttpClient/3.0.1 Disallow: / User-agent: Jakarta Commons-HttpClient/3.0-rcx Disallow: / User-agent: Jakarta Commons-HttpClient/3.1 Disallow: / User-agent: JamesBOT Disallow: / User-agent: James BOT Disallow: / User-agent: Java/1.4.1_04 Disallow: / User-agent: Java/1.6.0_04 Disallow: / User-agent: Java/1.6.0_07 Disallow: / User-agent: Java/1.6.0_10-rc2 Disallow: / User-agent: Java/1.6.0_15 Disallow: / User-agent: Java/1.6.0_20 Disallow: / User-agent: Java/1.6.0_24 Disallow: / User-agent: Java/1.6.0_26 Disallow: / User-agent: Java/1.6.0_32 Disallow: / User-agent: Java/1.6.0_34 Disallow: / User-agent: Java/1.7.0_09 Disallow: / User-agent: Java/1.7.0_25 Disallow: / User-agent: Java/1.7.0_45 Disallow: / User-agent: Java/1.7.0_51 Disallow: / User-agent: Java/1.7.0_55 Disallow: / User-agent: Java/1.7.0_60 Disallow: / User-agent: Java/1.7.0_60-ea Disallow: / User-agent: Java/1.7.0_65 Disallow: / User-agent: Java/1.7.0_67 Disallow: / User-agent: Java/1.7.0_71 Disallow: / User-agent: Java/1.7.0_75 Disallow: / User-agent: Java/1.7.0_80 Disallow: / User-agent: Java/1.8.0_20 Disallow: / User-agent: Java/1.8.0_25 Disallow: / User-agent: Java/1.8.0_31 Disallow: / User-agent: Java/1.8.0_40 Disallow: / User-agent: Java/1.8.0_45 Disallow: / User-agent: JetBrains Disallow: / User-agent: JetBrains 5.0 Disallow: / User-agent: Kraken Disallow: / User-agent: Kraken/0.1 Disallow: / User-agent: Kraken/Nutch-2.2.1 Disallow: / User-agent: larbin Disallow: / User-agent: lechenie Disallow: / User-agent: libcurl Disallow: / User-agent: libcurl/7.15.3 Disallow: / User-agent: libcurl/7.19.7 Disallow: / User-agent: libcurl/7.21.0 Disallow: / User-agent: LibreOffice Disallow: / User-agent: Link/1.0 Disallow: / User-agent: linkCheck Disallow: / User-agent: linkchecker Disallow: / User-agent: link checker Disallow: / User-agent: linkCheckV3.0 Disallow: / User-agent: Linkdex Disallow: / User-agent: LinkdexBot Disallow: / User-agent: linkdexbot/2.0 Disallow: / User-agent: linkdexbot/2.1 Disallow: / User-agent: linkdex.com/v2.0 Disallow: / User-agent: linkdex.com/v2.1 Disallow: / User-agent: linkdexbot-mobile/2.1 Disallow: / User-agent: LinkpadBot Disallow: / User-agent: LinkpadBot/1.06 Disallow: / User-agent: LinqiaScrapeBot Disallow: / User-agent: LinqiaScrapeBot/1.0 Disallow: / User-agent: Lipperhey Disallow: / User-agent: Lipperhey SEO Service Disallow: / User-agent: Lipperhey-Kaus-Australis Disallow: / User-agent: Lipperhey-Kaus-Australis/5.0 Disallow: / User-agent: listicka Disallow: / User-agent: LSSRocketCrawler Disallow: / User-agent: LSSRocketCrawler/1.0 Disallow: / User-agent: LSSRocketCrawler/1.0 LightspeedSystems Disallow: / User-agent: ltx71 Disallow: / User-agent: LWNutch/Nutch-1.4 Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Mail.RU Disallow: / User-agent: Mail.RU_Bot Disallow: / User-agent: Mail.RU_Bot/2.0 Disallow: / User-agent: Mail.RU_Bot/Fast/2.0 Disallow: / User-agent: maluuba-crawler/Nutch-1.6 Disallow: / User-agent: MaxPointCrawler Disallow: / User-agent: MaxPointCrawler/Nutch-1.1 Disallow: / User-agent: md5sum Disallow: / User-agent: md5sum\x22 Disallow: / User-agent: meanpathbot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: mezhpozvonochnoi Disallow: / User-agent: MixBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: mycrowl/Nutch-1.9 Disallow: / User-agent: MyGreatUA/2.0 Disallow: / User-agent: MyIPTest Disallow: / User-agent: My Nutch Spider/Nutch-1.9 Disallow: / User-agent: NerdyBot Disallow: / User-agent: NetLyzer FastProbe Disallow: / User-agent: NetResearchServer Disallow: / User-agent: NetResearchServer/4.0 Disallow: / User-agent: netseer Disallow: / User-agent: Netvibes Disallow: / User-agent: NING/1.0 Disallow: / User-agent: node.io Disallow: / User-agent: node.js Disallow: / User-agent: nutch-1.4 Disallow: / User-agent: nutch-1.4/Nutch-1.4 Disallow: / User-agent: nutch-1.8/Nutch-1.8 Disallow: / User-agent: oBot/2.3.1 Disallow: / User-agent: okhttp/2.3.0 Disallow: / User-agent: omgilibot Disallow: / User-agent: omgilibot/0.4 Disallow: / User-agent: OpenHoseBot Disallow: / User-agent: OpenHoseBot/2.1 Disallow: / User-agent: Openstat Disallow: / User-agent: Openstat/0.1 Disallow: / User-agent: OptimizationCrawler Disallow: / User-agent: OptimizationCrawler/0.2 Disallow: / User-agent: PageAnalyzer Disallow: / User-agent: PageAnalyzer/1.1 Disallow: / User-agent: PageAnalyzer/1.5 Disallow: / User-agent: Page Analyzer Disallow: / User-agent: Page Analyzer v4.0 Disallow: / User-agent: PagesInventory Disallow: / User-agent: Pagespeedbot Disallow: / User-agent: Pagespeed/1.1 Disallow: / User-agent: Pagespeed/1.1 Fetcher Disallow: / User-agent: PathDefender Disallow: / User-agent: PathDefender/1.0 Disallow: / User-agent: Perl LWP Disallow: / User-agent: PHP/5.2 Disallow: / User-agent: PHP/5.3.28 Disallow: / User-agent: PHP/5.4 Disallow: / User-agent: PHP/5.4.24 Disallow: / User-agent: PHPCrawl Disallow: / User-agent: Plukkie Disallow: / User-agent: Plukkie/1.5 Disallow: / User-agent: POGS/2.0 Disallow: / User-agent: Powermarks Disallow: / User-agent: PowerPivot Disallow: / User-agent: PRIVACY_ENFAQ.jsp Disallow: / User-agent: Prlog Disallow: / User-agent: Prlog/1.0 Disallow: / User-agent: psbot Disallow: / User-agent: publiclibraryarchive.org Disallow: / User-agent: publiclibraryarchive.org/1.0 Disallow: / User-agent: Pulsepoint XT3 web scraper Disallow: / User-agent: pycurl Disallow: / User-agent: PycURL/7.24.0 Disallow: / User-agent: Python-urllib Disallow: / User-agent: Python-urllib/1.17 Disallow: / User-agent: Python-urllib/2.5 Disallow: / User-agent: Python-urllib/2.6 Disallow: / User-agent: Python-urllib/2.7 Disallow: / User-agent: Python-urllib/3.4 Disallow: / User-agent: qingdao Disallow: / User-agent: QlikView Disallow: / User-agent: qsdb Disallow: / User-agent: quipu Disallow: / User-agent: quipu/1.0 Disallow: / User-agent: quipu/2.0 Disallow: / User-agent: R6_FeedFetcher Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: Riddler Disallow: / User-agent: rogerbot Disallow: / User-agent: rogerbot/1.0 Disallow: / User-agent: Rome Client Disallow: / User-agent: rootlink Disallow: / User-agent: RU_Bot/2.0 Disallow: / User-agent: Ruby Disallow: / User-agent: scalaj-http Disallow: / User-agent: scalaj-http/1.0 Disallow: / User-agent: Scrapy Disallow: / User-agent: Scrapy/0.16.5 Disallow: / User-agent: Scrapy/0.24.4 Disallow: / User-agent: Scrapy/0.24.6 Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: Screaming Frog SEO Spider/2,55 Disallow: / User-agent: Screaming Frog SEO Spider/2.55 Disallow: / User-agent: Screaming Frog SEO Spider/3.1 Disallow: / User-agent: Screaming Frog SEO Spider/3.3 Disallow: / User-agent: Disallow: / User-agent: scrutiny/4 Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: SEOkicks Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SEOlyticsCrawler Disallow: / User-agent: SEOlyticsCrawler/3.0 Disallow: / User-agent: SeznamBot Disallow: / User-agent: ShowyouBot Disallow: / User-agent: SheerBoredom.Experimental.Robot Disallow: / User-agent: SheerBoredom.Experimental.Robot/0.2 Disallow: / User-agent: sistrix Disallow: / User-agent: SISTRIX Crawler Disallow: / User-agent: SiteExplorer Disallow: / User-agent: SiteExplorer/1.0b Disallow: / User-agent: SkimBot Disallow: / User-agent: SkimBot/1.0 Disallow: / User-agent: sky nutch crawler/Nutch-1.9 Disallow: / User-agent: Slackbot-LinkExpanding Disallow: / User-agent: Slackbot-LinkExpanding 1.0 Disallow: / User-agent: SMTBot Disallow: / User-agent: SMTBot/1.0 Disallow: / User-agent: Sogou Pic Spider Disallow: / User-agent: Sogou Pic Spider/3.0 Disallow: / User-agent: Sogou spider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: SpamBayes Disallow: / User-agent: SpamBayes/1.1a3+ Disallow: / User-agent: spbot Disallow: / User-agent: spbot/4.4.2 Disallow: / User-agent: spiderbot Disallow: / User-agent: Spiderbot/Nutch-1.7 Disallow: / User-agent: spray-can Disallow: / User-agent: spray-can/1.2.1 Disallow: / User-agent: SSG/3.0 Disallow: / User-agent: Statastico Disallow: / User-agent: Statastico/4.0 Disallow: / User-agent: Steeler Disallow: / User-agent: Steeler/3.5 Disallow: / User-agent: StudioFACA Disallow: / User-agent: StudioFACA Search Disallow: / User-agent: sukibot Disallow: / User-agent: sukibot_heritrix Disallow: / User-agent: sukibot_heritrix/3.1.1 Disallow: / User-agent: SurveyBot Disallow: / User-agent: Synapse Disallow: / User-agent: Synthesio Crawler release MonaLisa Disallow: / User-Agent: Traackr.com bot Disallow: / User-Agent: trendictionbot Disallow: / User-Agent: TrueBot Disallow: / User-Agent: TrueBot/1.0 Disallow: / User-Agent: Typhoeus Disallow: / User-Agent: uipbot/1.0 Disallow: / User-Agent: uMBot-LN Disallow: / User-Agent: uMBot-LN/1.0 Disallow: / User-Agent: updown_tester Disallow: / User-Agent: URLChecker Disallow: / User-agent: WASALive Disallow: / User-agent: WASALive-Bot Disallow: / User-agent: WbSrch Disallow: / User-agent: WbSrch/1.0 Disallow: / User-agent: WeAreNotEvil Disallow: / User-agent: WebCookies Disallow: / User-agent: WebCookies/1.0 Disallow: / User-agent: WebCopier vx.xa Disallow: / User-agent: Web corpus crawler Disallow: / User-agent: WebQL Disallow: / User-agent: Web-sniffer Disallow: / User-agent: Web-sniffer/1.1.0 Disallow: / User-agent: Webster Pro V3.4 Disallow: / User-agent: WeCrawlForThePeace Disallow: / User-agent: Wegtam Disallow: / User-agent: Wegtam Crawler Disallow: / User-agent: WeLikeLinks Disallow: / User-agent: WhatWeb Disallow: / User-agent: WhatWeb/0.4.8-dev Disallow: / User-agent: woobot Disallow: / User-agent: woobot/1.1 Disallow: / User-agent: woobot/2.0 Disallow: / User-agent: WorldBrewBot Disallow: / User-agent: WorldBrewBot/2.1 Disallow: / User-agent: worldwebheritage.org Disallow: / User-agent: worldwebheritage.org/1.0 Disallow: / User-agent: www.deadlinkchecker.com Disallow: / User-agent: www.petitsage.fr site detector 0.4 Disallow: / User-agent: WWW-Mechanize Disallow: / User-agent: WWW-Mechanize/1.74 Disallow: / User-agent: V1.0/1.2 Disallow: / User-agent: vBSEO Disallow: / User-agent: VeriCiteCrawler Disallow: / User-agent: VeriCiteCrawler/Nutch-1.9 Disallow: / User-agent: Visited by http://tools.geek-tools.org Disallow: / User-agent: Voila Robot Disallow: / User-agent: voltron Disallow: / User-agent: Vorboss Web Crawler Disallow: / User-agent: Vorboss Web Crawler/Nutch-2.3 Disallow: / User-agent: Xenu Link Sleuth Disallow: / User-agent: Xenu's Link Sleuth Disallow: / User-agent: XoviBot Disallow: / User-agent: XoviBot/2.0 Disallow: / User-agent: XSpider Disallow: / User-agent: Yandex Disallow: / User-agent: Yandex Robot Disallow: / User-agent: Yetibot Disallow: / User-agent: YisouSpider Disallow: / User-agent: yoozBot Disallow: / User-agent: yoozBot-2.2 Disallow: / User-agent: zzabmbot Disallow: / User-agent: zzabmbot/1.0 Disallow: /