Worry lines are showing again. Ambiguity succumbs. After exerting too much effort, perhaps you might be wondering why your website is still nowhere to be found in search engine results. The reason may be as simple as distinguishing spidering from indexing. Most of the site owners are thinking that the two words are synonymous, unfortunately - they are not.

To illuminate the distinction, here is a portion of Shari Thurow's writings over at ClickZ:

The biggest misconception at this year's conference was the difference between the spidering and indexing processes. The index is a subset of the spider. Search engines access Web content through the spidering process. Then, they filter out duplicates and other bad content and create the index.

A Web site can be spidered and not included in a search engine index.

Spiders may have visited your site many times but the problem is that your site fails to show up in the index. The failure to do so may be the result of simple technical errors that should be corrected. These errors include improperly routed 301 redirect, code errors, duplicate contents to another site and robots.txt file. These are simple errors. Nonetheless, they can hex failure.