1C Home   |   Register   |   Today Posts   |   Members   |   UserCP   |   Calendar   |   Search   |   FAQ

Go Back   Official 1C Company forum > Other > Other Topics

Other Topics Feel free to discuss other topics here.

Thread Tools Display Modes
Old 09-12-2015, 12:38 AM
soisz soisz is offline
Approved Member
Join Date: Oct 2014
Posts: 2
Default Robots.txt Checker

If a site has the file "robots.txt", it displays all the directories and pages on the website that they wish to keep anonymous from the search engine spiders. This may lead to hidden pages.

With Robots.txt Checker you can access the site directly or check if it is indexed in google


Reply With Quote

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

All times are GMT. The time now is 11:10 AM.

Based on a design by: Miner Skinz.com

Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2018, Jelsoft Enterprises Ltd.
Copyright © 2007 1C Company. All rights reserved.