Site Design for Better Search Engine
Positioning - Part II
The relationship Between the Search Engines, and Ways to Get Listed
When all Your Past Attempts Have Failed.
So you've built your site, optimized it for search engine submission,
and uploaded it to your server. You've also set up some strategic
link swaps with some prominent sites, and submitted it to the search
engines, but it isn't showing up, or there is no record your site
has even been indexed by Google or Yahoo. Now what do you do? That's
what we are going to discuss in this article.
Indexing, Spidering, Inclusion, and Paid Inclusion - Terminology
and Differences in the Search Engine Optimization Game
Before I get into the relationships between the search engines,
I want to talk about spidering and inclusion. You need to understand
these. Understanding them will help you to understand the possible
reasons why your site may not be showing up in search engine results.
An important thing to keep in mind. Although your site might not
be showing up in results, that doesn't mean that it ins't already
spidered by a particular search engine. There is a difference between
spidering and inclusion. There is also a difference between inclusion,
not guaranteed, and paid inclusion, which is a guaranteed way to
make sure your site shows up on search engine results. Not all search
engines follow the steps I am about to go over. Some may jumble
tasks together with the same spider or bot when they visit your
pages. What follows is the long hand journey a page takes to find
it's way into search engine results.
Each search engine has their own little spider or bot that spends
all its time crawling around the web. Their soul intentions are
to find pages, and then read the URL links on those pages. The spider
or bot uses those URLs to find other pages on the net. In turn it
visits the pages in these paths and collects certain information
from them. In theory, manual submission is not required for your
site in order for it to be spidered. Eventually, most pages are
found and submitted to the next spider or bot. The first spider
or bot's job is to find pages. It then drops those pages off to
another bot or spider to index them. At this time your page is said
to have been spidered. Once the first bot spiders your page, the
next bot comes and gathers information off your page.
The bot will look at the words on the page. Most bots only read
html code, and tend to ignore images, flash, and the other more
flashy technology available on the web. This is where keyword placement
comes into play. The bot looks at the text on your page and gathers
what it feels is relevant to the page it is visiting. It reviews
the text and assigns the page keywords. It will then drop off this
information into a type of database, or a filter, where other programs
can be run on the information to extract information about the pages
it collect. At this time your page is said to have been indexed.
Note that I have not said anything about search engine results yet.
Once your page reaches this point, it may still not be included
on search results. Also note, that until your page reaches this
point, there is no chance for it to end up on search engine results
either.
Once they collect this data, the search engines run programs on
the data and apply filters and algorithms to select pages they want
to include in their search results. Remember that the lifeblood
of a search engine is providing pages to their visitors that apply
to the information their visitors are looking for. If your pages
are deemed link farms, then the chances of them being included in
their results will be slim. I will talk more of potential problems
that keep pages from being included later. Once they run these programs,
the search engine will then include the page in their database.
At this time, your page is now considered included in their database
and will show up in search results relevant to the keywords on your
page. Again, it is important to remember that most search engines
do not guarantee inclusion. They are becoming very selective on
what they include and don't include in their database. When dealing
with a search engine that uses a human in any of the process, you
are looking at it being more difficult to be included.
Back
to Table of Contents
Identifying Spiders & Bots (Article Continues)
Other Search Engine Positioning Articles:
Related E-Book Downloads
By James R. Sanders
January 15, 2004
If you have any suggestions to add to this article,
or have ideas for articles you would like to read, please feel free to contact
us and let us know. You can also feel free to contact us about questions you
might have when it comes to practical webmaster or website design issues in
today's online market. We welcome constructive criticism and want to know what
our visitors think of our site and services. You can either contact
us here, or click the contact link at the bottom of the page. Thanks in
advance, and we look forward to hearing from you.
About the Author
James R. Sanders is the owner of Sanders
Consultation Group Plus. He has been a webmaster and website designer since
1997. He has also been involved in self employment ventures since 1992. He is
presently a contributing author of NewbieHangout,
and has been published through WebProNews
and 4Rankings.com.
His writing is targeted to webmasters, would be webmasters, website designers,
would be website designers, self employed, or those researching information
looking for solutions to questions associated with design, business operations,
and promotion today. His goal is to provide practical information based upon
his years of experience to help webmasters, website designers, and self employed
people achieve their goals in today's competitive global market. You can subscribe
to his free newsletters at SCGP
- Newsletter and become a member of the SCGP Portal. If you like SCGP content
and would like to use it on your site, then check out our content
agreement and terms of use. Use our articles on your site without the hassles
of writing your own content. Get back to the things you could use your time
better for, like site promotion.
Back To Webmaster Resource Area Main
Comment About This Article
Comments limited to 1000 characters
This page last updated:
Wednesday, October 19, 2005 11:22 AM
EST
|
