MediaBUZZ - ePublisher of Asian eMarketing

Apr 16th
Text size
  • Increase font size
  • Default font size
  • Decrease font size
Home Asian e-Marketing May - June 2009 Search Engine Spiders (Robots) and what you should know about them

Search Engine Spiders (Robots) and what you should know about them

E-mail Print

Understanding the basic structure of how search engines register Web sites is crucial to succeed in search engine optimization (SEO). It is one of the most effective web site promotion techniques, referring to improvements and changes made to web pages so that they conform to the search criteria utilized by search engines to rank and position listings.

'Spiders' are used by search engines to locate, index, rank, and list their findings. Most indexing spiders can only read text and have in general problems to see dynamic, asp, Cold Fusion, Flash, multiple redirects, tables and codes such as Java Script.

In addition spiders take into consideration criteria such as keyword frequency, prominence, weight and proximity, plus keyword placement within the HTML They like "content rich" or thematic text (sufficient enough to support the primary keyword phrase) about your products/services and use this to determine how relevant the page is to a searcher's request.

There are many factors to consider when optimizing a web site, some of them are:

  • Head, title, and meta tags (include descriptions, keywords, and copyright info)
  • Incorporating body text that supports targeted keywords
  • Converting dynamic web pages (asp, jsp) to allow reading by search engine robots/spiders
  • Reducing source code without compromising Web site functionality
  • Improving/fixing html code, broken links, and tags
  • Ensuring sufficient keyword concentration and placement on a page
  • Rewriting or copy writing to ensure the content supports the keyword phrases


Follow us on:
 Follow MediaBUZZ_Asia on Twitter linkedin-logo
google-plus-logo rss_49x23


Contents (May - June 2009)

Partner Events
6th_Customer_Loyalty_Programme_and_CRM_China_Summit_small Media__Entertainment_2014_small
AsianeMarketing-152x50px Interactive_Digital_News_Design2014small
csr-BANNERBUTTON broadband2014small
MY10-BannerButton gmhss-new-152.50
CM3_Small_2014 ESM3-BannerButton
ATM_152_x_50_MediaBUZZ B2BDemandGen2014small
CMO-Asia-152x50 ITchina2014small
MediaBUZZ152x90 4thannualpayment2014small
CL14_152x50 adtechchina_152x50
adtechasean_152x50 Banner_Digital_Data_152_50