Updated May 1st, 2018 — version 264

The UnFair Advantage Book
Winning the Search Engine Wars

Chapter Three, The Search Engine Order of Importance and the Web page Discovery Process

Chapter Three
The Search Engine Order of Importance and the Web Page Discovery Process

Search Engines Market Share

The pie chart shows that Google attracts more than two-thirds of the English reading eyeballs that search the Internet. This makes Google twice as relevant as all the other major search engines combined in North America.

For the English speaking market, only two search engines count: Google and (what we like to call) BingHoo — a combination of Bing (owned by Microsoft) and Yahoo.

Yahoo gets its results from Bing in 17 countries including the USA, UK, France, Germany, Spain, Mexico, Australia, and Brazil. Bing also provides results for Baidu, which owns 63% of the Chinese search market.

Globally, Google has over 68% of the worldwide market. The Chinese search engine, Baidu, is 2nd with a worldwide market share of 18%. Yahoo has 6.4% (boosted by Yahoo Japan) and Bing is 4th with 5.59% of the worldwide market.

It's very important to note the above figures reflect the desktop market share. BUT, in terms of the Mobile Global Search Share, Google is the 800 pound gorilla because...

Google has slightly over 90% of the worldwide MOBILE search market share

...which effectively gives them a monopoly on Mobile Search!

The Web Page Discovery & Update Process

Earlier we mentioned spiders, crawlers, and bots. These are actually sophisticated computer programs that are designed to "crawl" the web and discover new and updated web pages to save to their index. Search engine results would get stale very quickly if they didn't continually look for new pages and update old ones. And, of course, this discovery and update process must start somewhere. These starting points are known as Seed Sets — sometimes also referred to as the Crawl Frontier.

Seed Sets

As the graphic indicates, sites that are part of a core seed set are likely to have a clearly identifiable authority like .gov, .edu, or .org. In addition they could otherwise be a well known commercial entity like NYTimes.com, CNN.com, , etc.

A site that is part of a seed set is likely to have the highest Trust and Authority values as the spiders begin their crawl.

Trust is determined by a combination of factors such as web site quality, popularity, and incoming links from authoritative sites. For example, a site with a link from NASA.gov would gain trust. But trust can also be lost by linking out to disreputable sites. Trust & Authority

Authority sites would include the likes of National Cancer Institute, NASA.org, Wikipedia.org, Electronic Frontier Foundation, National Geographic, PC Magazine, Wall Street Journal, and so forth.

Hubs are sites of any size that link to authoritative web pages. It is good to be a Hub and it is good to be linked-to by a Hub. Any page that links to other web sites with known authority can be a good page from which to get a link.