I made a gadget from Aaron Wall’s search engine spider tool source code, available from his SEO tools page.
I have had my version of this spider tool on my other site for a long time, but I wanted to make a gadget that showed the results within the gadget, instead of throwing you off to another page. After some tinkering, I have figured it out…
Here is the live gadget (give it a try)…
This tool will show you very quickly some of the main things a spider sees on your webpage (or someone elses). It displays the title, description, keywords, how many words, keyword densities, and outgoing links.
To add this gadget go here or just click the “+Google” button beneath the gadget.
{ 7 comments… read them below or add one }
Pretty cool… do most spiders ignore robots.txt ?
Nice question Tim, I too would love to know, Pat. Do spiders ignore robots.txt?
Thank you for this tool. I use it almost daily and would suffer a loss should it go away. For me, it’s the only tool that will show me what the Google spiders see, versus just any old spider. I hope this helps others find your tool and use it.
Hi I’m a newbee to website design… Brilliant tool.
I’ve created a multi-page website with serif but no matter what I do I can’t get google or any other search engine to return a listing for my site. Any ideas on what I’m doing wrong?
http://www.boloit.com/forum/
i want SEO\,
I just want to say thank you. I come to this web site regularly because I find it does the best job of returning what the googlebot sees. Other spider simulators are not specific to Google.
Good is work thanx.