Spiritual Health Learning Community Center
Exploring Life's Horizons
 
                                            
Internet-Related Issues
Quality Leads and Search Engines - Part Two


If the arrangement developed by search engines and directories actually worked, then one might be persuaded to try to comply with the rules of the game. Unfortunately, in all too many cases, even when a Websteader or surfer tries to operate within the technical requirements and limitations of search engines, a submitted URL may end up all but invisible to the surfing public.

Consider the following possibility. Let us suppose that among the millions of Web Pages existing on the Internet, there were, say, a hundred Websteaders who had constructed Sites concerning modern, American politics. Let us further assume that not only had all of these individuals done their homework concerning the way search engines operate and, as a result, had incorporated every feature which a given search engine used to differentiate and rank Web Sites, but they did so with roughly equal proficiency.

Who gets ranked first, and who gets ranked last? However a given search engine or directory chooses to resolve this question, there are going to be quite a lot of these Websteaders who, for all practical purposes, will be invisible to the public because they are going to appear far below the point in the list where most Web surfers will stop looking, and, yet, these Websteaders have been playing the game in accordance with the rules.

Perhaps, someone may argue that the foregoing example is too contrived. In reality, there always will be some people who play the game better than others, and this will be reflected in where they show up in search engine match-listings.

This criticism may have some merit, but it doesnt't actually address the main issues. For instance, on the one hand, in whatever way various people may play this game better than others, these differences tend to be based on formal properties (such as meta tags, headers, keywords, titles, etc.) which are largely irrelevant to the question of whether, or not, those Web Sites enjoying high visibility or search engine ranking also possess quality content. On the other hand, being able to learn how to play the search engine positioning game well, can't hide the fact that search engines and directories are inherently linear and hierarchical, and, therefore, only a very limited number of those who play the game well still will be able to gain search engine visibility.

For those who only care about being at the top of the heap of the search engine wars, visibility may help them to earn money, sales, and so on. However, this "solution" which serves the few does precious little to solve the problems of the vast majority of the people who surf the Internet looking for value and quality, or try to promote their Web Pages, or seek to advertise goods and services at often prohibitive prices, on the few Web Sites enjoying visibility.

Moreover, even if one were to go along with the foregoing objection that the given example is somewhat contrived and artificial, one needs to take a closer look at how the game is played. One needs to try to determine whether, or not, the fact that some people learn how to play this game better than others really serves the interests of Websteaders or surfers in general.

In addition to the aforementioned data base which, among other things, consists of a collection of URLs that have been submitted by hopeful Websteaders, a search engine requires some kind of software program. This program sets the limits, conditions, values, and principles governing the way a search engine sets up, engages, and draws information from, its data base.

Essentially, therefore, a search engine consists of two parts. One portion is a data base, and the other aspect is a program which serves as the interface between the data base and an individual who is trying to discover whether or not the data base contains any URLs of value or interest to that person.

Let us take a quick look at each of these two facets of a search engine. Such an overview may improve instructive with respect to the actual nature of search engines and where the future of, at least, one dimension of the Internet may lay.

Most of us are familiar, at least in general terms, with the manner in which a search engine develops its data base. More specifically, a person - usually a Web Page homesteader, makes a submission to one or more of the existing search services and/or directories operating within some portion of Internet cyberspace such as, for example, the World Wide Web.

During this process, the one who is doing the submission answers a variety of questions about the URL being submitted. This material often includes information such as: the title of the Page, a short description of the Web Site being submitted, some relevant keywords, one or more topical categories under which the Web Page might be subsumed, and whatever other information the owners of the search engine service may feel to be appropriate to generate a data-profile for the URL being submitted.

Let us assume, for the moment, that the search engine program processing the foregoing sort of information were to perform its task perfectly (this not only is never the case, but it is hard to know what such "perfection" might entail). Can we conclude that the search engine is, now, in a position to provide seekers with whatever information they need?

The answer, of course, is "no". There are a number of reasons for this.

For instance, much depends on the quality of the information offered by the one who has submitted the URL to the search engine. Has this person accurately described the Web Page? Has this individual placed the Web Site in the most appropriate topic category? Has the person selected keywords which are likely to be the most productive possibilities for leading Web surfers to his or her Web Page? Has this individual been truthful in making her or his submission?

There is an old adage in computer circles which says: garbage in, garbage out. In the present context, the relevant issue is whether, or not, the person who has made an URL submission has introduced, either inadvertently or intentionally, a certain amount of "garbage" into a search engine and, in the process, helped corrupt the data base of the latter, rendering the search engine less useful to Web surfers than it might have been under more optimum, and less distortive or corrupted, circumstances.

One can understand how an individual might have done a poor job of describing her or his Web Page or may have been somewhat careless with the sort of keywords that have been submitted to a search engine as part of one's URL application, but why would someone intentionally introduce incorrect information into such a submission? One does not have to reflect very long to discover some of the reasons for this.

Historically, search engines and Web directories have served as the primary medium for trying to locate information on the Internet. One, of course, might learn about various Web Sites through some form of off-line advertising campaign or via a process of word-of-mouth testimonials, but, to a great extent, many people, at least in the beginning, have taken their cues from search engine queries.

Seemingly, therefore, until relatively recently, the one and only chance a Websteader had of becoming known in cyberspace was to rank high in one, or more, of the search engines and directories. The operative word, here, is "high" because, for the most part, unless one were listed in the top 15 or 20 entries for a given keyword search, then the likelihood was very slim that a Web surfer would have been willing to closely examine, say, 100-400, or more, of the "matches" that might have been returned from a keyword probe of such a data base - and this remains true even if one were to assume that the Websteader who submitted the URL had provided all the correct descriptions, keywords and so on ( which, unfortunately, frequently is not the case).

As a result, the era of "search engine strategies" arose. Websteaders, Internet analysts, Web consultants, and search engine placement companies all began to try to come up with strategies capable of paving a path to a promised land of high search engine positioning.

At this point, a third component of search engines and directories needs to be introduced. This is the spider or bot program which probes the actual Web Site of an URL that has been submitted to a given search engine or directory for consideration and disposition.

This spider or bot is a close cousin to the program that is organizing the data base from which a search engine derives its matches and responses to various kinds of search query. In effect, the logical character of the latter set of operations determines the sort of information for which the related spider or bot will be probing whenever it is sent out to engage and "evaluate" an URL that has been submitted to the search engine or directory.

In an attempt to try to control the results produced by a spider's or bot's probing of a Web Site, creative thinkers began to introduce "tricks" such as: invisible text (the background and text colors are the same which is invisible to a Web surfer but not to search spiders and bots), small text (too small to be detected by a human visitor, but capable of being picked up by a search engine spider/bot), and all manner of adjustments to the form of, among other things, the material contained in the text of, and HTML coding for, titles, meta tags, alt tags, and headers.

Therefore, repeating, and/or misspelling, and/or capitalizing, and/or special placing of various keywords, along with a number of other scenarios, were all suggested as being direct pipelines into the inner sanctum of high search engine placement. However, the strategies that sometimes led to success with respect to high placement in relation to one search engine, didn't necessarily work with other search engines because not all spiders/bots worked in accordance with the same set of logical principles, priorities and weighting factors.

Furthermore, the algorithms used by search engine bots and spiders began to grow in sophistication. In somewhat simplified terms, algorithms consist of one, or more, logical routines involving a set of reiterated or repeated steps within a software program that perform specific operations on a given object such as, for example, the HTML coding that underwrites a given Web Page.

Among other things, the growing sophistication of these algorithms meant that the spiders and bots (i.e., programs) sent out by search engines to probe a Web Site, were given the ability to detect, as well as take steps to counter, some of the strategies being used by people to get high search engine placement. As a result, search engines and directories started to penalize those Web Sites that were employing such strategies ( usually this was done either through rejecting the URL submission altogether or by lowering the placement or visibility of the Web Site in the search engine's data base).

This led to an escalation in the war of placement strategies. In other words, search engine spiders/bots (algorithms or computer programs) changed the way they analyzed Web Sites, as well as the manner in which they countered various URL submission strategies that were intended to subvert the intentions underlying any given search engine (which, presumably, is to provide a valid, reliable way for Web surfers to accurately access desired Web Sites). At the same time, the thrust-and-parry strategies of Web-positioning consultants underwent transformations in an attempt to try to discover new methods for undermining, or doing an end-around, the way in which these more sophisticated versions of various search engine algorithms were probing, analyzing and grading Web Sites.

For instance, there are now products and services specializing in what has become known as bridging software. These programs are capable of engaging and analyzing the search engine spider/bot probes of a Web Site and, then, such software presents a so-called "optimum Page" to the search engine spider ('optimum' from the perspective of the spider/bot's algorithm/program and the specific features for which that algorithm is searching).

However, this "optimum Page" which is being shown to the search engine spider/bot is different from the one that a visitor to, or browser of, the Site would see. Moreover, some of these bridging programs are capable of displaying a variety of "optimum Pages" as they engage spiders/bots that have been sent out from different search engines and directories.

The adversarial relationship which has arisen between search engines and Websteaders has a lot of implications for the quality and character of the information ending up in a search engine data base. And, this, in turn, has ramifications for the potential significance and value of what might be pulled out of that data base by someone who is doing a keyword search of the data base.

Not the least of these ramifications is that many search engines and Websteaders are so preoccupied with outsmarting and neutralizing one another that data bases have become corrupted with a growing body of material which renders many searches virtually meaningless. As a result, when someone tries to do a keyword search, often times a great deal of chaff comes back in the so-called "matches", along with whatever wheat may be made available.

A great deal of time and energy can be wasted in trying to identify which "URLs" belong in the wheat pile and which Web addresses need to be cast aside as so much chaff, either due to a lack of quality or because of irrelevancy to one's needs. Depending on the ratio of chaff to wheat being generated through a search engine or directory in response to keyword queries, one's level of frustration can range from quite high to only moderately so in many cases.



| Part 1 | Next | Part 4 | Part 5 |


Return to Internet Menu



















Copyright © 2004 Interrogative Imperative Institute. All Rights Reserved.