Home | Forums | Articles | F@H
Help | Search | Members | Calendar | Forum Map | Cybervillage | Archive
Welcome Guest ( Log In | Register | Resend Validation Email )


>  IceTeks Forums -> Technology made cool -> Programming


  Archived - No replies allowed - start new thread insteadStart new topicStart Poll

>  any one know how to
Track this topic | Email this topic | Print this topic
rovingcowboy
Posted: Oct 28 2004, 04:08 PM
Quote Post

Stubborn and bull headed.

Group Icon

Group: Ice Age Members
Posts: 1 550
Member No.: 28
Joined: 18-December 02
Ice Cubes: 834



stop the web spiders from crawling though my site and backing up pages i don't what anyone to see unless they click the link to them?

thanks.


--------------------
roving cowboy/ keith
PMEmail PosterUsers WebsiteMSN Top
Red Squirrel
Posted: Oct 28 2004, 04:43 PM
Quote Post

ZOMG!

Group Icon

Group: Admins
Posts: 13 964
Member No.: 1
Joined: 18-December 02
Ice Cubes: 163183



Look into setting up a robots.txt file.

http://www.robotstxt.org/wc/exclusion.html This should help you

You place the robots.txt file in your root folder.


--------------------
user posted image
http://www.redsquirrel.me my blog
http://www.uovalor.com AoS/ML Ultima Online Shard
PMEmail PosterUsers Website Top
rovingcowboy
Posted: Oct 28 2004, 10:16 PM
Quote Post

Stubborn and bull headed.

Group Icon

Group: Ice Age Members
Posts: 1 550
Member No.: 28
Joined: 18-December 02
Ice Cubes: 834



thanks red that is what i need. but i am not sure about the meta tag it says it might not work. looks like i will have to find room on the sites and make a folder to put the pages in. then block that folder.

banghead.gif

all that work just to keep some one from cheating on my treasure hunt style of game em320.gif


--------------------
roving cowboy/ keith
PMEmail PosterUsers WebsiteMSN Top
0 User(s) are reading this topic (0 Guests and 0 Anonymous Users)
0 Members:
« Next Oldest | Programming | Next Newest »

Topic Options Archived - No replies allowed - start new thread insteadStart new topicStart Poll

 



[ Script Execution time: 0.0328 ]   [ 13 queries used ]   [ GZIP Enabled ]

< Home | Forums | Contact >