Robot-Manager 3.1 
Robot-Manager 3.1 Description
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.
Read more...
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Maximizes effectiveness with search engines by avoiding over/under submitting. Excellent to improve search engine placements for users of automatic submission software such as WebPosition, TopDog, AddWeb, etc.
DOWNLOADS FROM Website Management Tools
robots.txt,
robot ,
spider,
crawler,
log file,
log file analysis,
log file analyzer,
search engine optimization,
seo,
spider tracking,
referrer logs
URL HelperURL Helper provide a one-step solution to finding the URLs for all streams.
AllWebMenus ProDHTML menu / Javascript menu builder that requires no programming at all!