Robots.txt resources added

I have recently added some information to the Webmaster Resources section on how to create robots.txt files. This file controls access to your site by spiders, bots, and other web crawling thingies, both friend and foe. These robots are generally used by search engines, but they are also used by spammers to harvest email addresses. Unfortunately, the bad critters usually ignore these files. There are alternatives to control the ill mannered bots and we will address that in the future.

The easiest way to create valid robots.txt files is to use a generator program. I have found Robot-Manager and Robot-Manager Pro to be excellent tools. I use Robot-Manager Pro, which includes the capability to analyze my log files for spider activity. I highly recommend these programs.

Free Directory Listings - Update:

I have made several updates and additions to the Free Directory Listing reviews section. PageRank™ was updated to reflect Google's April 22, 2005 Toolbar PageRank™. I have added a few more directory reviews and updated the listing status.

I just received an email advising me that several of the Search Engine Friendly Directories on the http://info.vilesilencer.com/ list are temporarily suspending free submissions until June 15, 2005, to clear their submission back log. The effected directories are listed here http://www.overthemark.com/seoblog/item/11. Currently, I only have one reviewed directory on that list, Easy Eraser Pro Directory . They are offering a express review submission option - $5 reviewed in 24-72 hours for all the effected directories. I will monitor this to see what happens.

That's it for now. Sorry to have been so long between posts. I have been very busy with client work.

As always, please feel free to comment below or contact me by email by clicking on my name below.

martin