| Streety - Jul-22-2005 server time |
| If you only want to track visitors so you can block the respected search engine bots I really wouldn't bother. They all respect a robots.txt file entry or meta tags so i would just use those. |
| MikeDB - Jul-22-2005 server time |
| Ok cool now how the heck do i make a password protected page? It sounds like a challenge. |
| Red Squirrel - Jul-22-2005 server time |
| Yeah just make it password protected. Or if the data is not too sensible just put it in a folder but don't link to it from anywhere. googlebot will only get to pages that are linked from other pages that google is aware of. (other sites, home page, etc) |
| MikeDB - Jul-22-2005 server time |
| gay... |
| Red Squirrel - Jul-22-2005 server time |
| Yeah true, I would not block the google bots, or any other search engine. If you don't have 200GB of monthly bandwidth, you may want to block Yahoo (slurp) though, but that's the only one I'd block. Even when blocked, I get a few thousand attempts from it per month. Here it's a fully custom system, but simply put there's an admin part to it and a tracker part to it. The tracker is included via php include() function on top of every page. The tracker will check if there's any rules (same concept as a firewall rule) that matches with the IP, user agent, or referrer. If yes it applies it and does the action (such as block, but not continuing to load the page) if not it goes on. Each time it also adds a log entry - aka page view to a text file which is then imported into my LAN server's stat database/log viewer. But before you ask, this code is not available to public. |
| Pyr-O-Rgasm - Jul-21-2005 server time |
| No offence, but that is one of the dumbest things I've heard a webmaster say. Google brings in so many hits to websites, it's like a theme park asking the city to close the road right infront of their entrance. |
| MikeDB - Jul-21-2005 server time |
| Hi all, would it be at all possible to make something that records all of the people who came to my site and it also shows there Ip address? Because I want to be able to block the google bots. |