1C Home   |   Register   |   Today Posts   |   Members   |   UserCP   |   Calendar   |   Search   |   FAQ

Go Back   Official 1C Company forum > Other > Other Topics

Other Topics Feel free to discuss other topics here.

Reply
 
Thread Tools Display Modes
  #1  
Old 09-11-2015, 11:38 PM
soisz soisz is offline
Approved Member
 
Join Date: Oct 2014
Posts: 2
Default Robots.txt Checker

If a site has the file "robots.txt", it displays all the directories and pages on the website that they wish to keep anonymous from the search engine spiders. This may lead to hidden pages.

With Robots.txt Checker you can access the site directly or check if it is indexed in google

Download:
http://rghost.net/8FDHPwLXY

Virustotal:
https://www.virustotal.com/en/file/4...is/1442013366/
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT. The time now is 06:29 PM.

Based on a design by: Miner Skinz.com

Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Copyright © 2007 1C Company. All rights reserved.