If you look at the source for this web page you will see the following:

<a href="http://youlookfab.com">this link to Angie's site</a>

Very simple, but this little fragment is the basis of the revolution that is the world wide web. Without it there would be no web sites, no web surfing, and no Google search.

There are essentially two benefits that Angie gets when I create a link like this to (youlookfab.com) YLF. First, the obvious one. People will click on the link and end up on her page. So I am sending her additional direct traffic.

The second benefit is more subtle, but also more powerful. By creating this link to Angie’s page I am telling Google that YLF is important. As a result Google may place YLF closer to the top of their search results, and then send Angie additional search traffic. This second bump in traffic has the potential to have a far greater impact. There are only a few people today on TheBlogEasy, but there are millions of people doing Google searches.

In order to explain the implications of this I will now make some gross oversimplifications about the way Google search works.

Google Search and Pagerank

Google has a little piece of software called the crawler. This crawler goes from page to page, following all the links and building a giant database that captures all the links on the web. Another piece of Google software then uses this giant database to answer your search queries when you type them in on the Google homepage. But how does Google decide which search result goes on top? That’s where the links come in!

Google looks at the number of links coming in to a page and uses this as a reflection of the page’s importance. This makes sense – popular pages will have many incoming links. Unpopular pages that no-one cares about? They won’t have any incoming links at all. So by linking to YLF on this page, I have sent a little signal to Google that YLF has some importance. Google uses the term “pagerank” to describe this importance measurement that is based on incoming links.

Paid Links: An Industry is Born

People are smart, and when they realized that Google was sending sites a lot of traffic they starting to think about ways that they could influence the Google search engine. They needed to convince it to put their site closer to the top of the search results so they could get more traffic. One obvious way to do this is to convince other sites to link to you so that the crawler would find these links, their pagerank would increase and Google would send them more search traffic.

This worked so well that people started to pay each other for these links.

And therein lies a problem. Google’s algorithm is relying on the fact that the links are natural in order to use them as an indicator of a site’s importance. When people start buying links, they are buying importance. Even if their site is horrible to look at and contains unreliable information, with enough money they can trick Google’s search engine into thinking that the page is important.

Then Google starts sending people to crappy sites and they lose confidence in the search engine. Not good.

Policing Natural Links and Punishing those who Distort Them

Needless to say, Google is very concerned about anything that distorts the natural order of things. This includes paid links and also link networks, where everyone in a community links to each other in order to get more pagerank. So a few years ago they started to lay out guidelines about what webmasters should and shouldn’t do with links. And they started penalizing sites that they judged to be breaking these rules.

Google isn’t transparent about their penalties, but there are widely believed to be three main ones. The -30 penalty forces your site to the 30th place in the search results even if it would normally rank much higher than that. The page 99 penalty (or -950 penalty) relegates certain pages on your site to the very end of the results (page 99) for certain keywords. The third and most serious penalty is exclusion from the index.

One good example here is the company Text Link Ads. They provide a marketplace for people to buy and sell paid links. That is, they make money by distorting the natural order of things that Google cares about so much. If you search for “text link ads” in Google you will not find their website. It has been banished.

Interestingly, the topmost result when I searched for “text link ads” a few minutes ago was an article reviewing the Test Link Ads service. So they are managing to get good placement despite having been banished.

The Nofollow Exception

It is possible to create paid links that don’t anger Google. All you need to do is add the “nofollow” attribute to any unnatural link. Modifying the link I gave above, this would look as follows:

<a rel="nofollow" href="http://youlookfab.com">this link to Angie's site</a>

The rel=”nofollow” bit tells the Google crawler to ignore this link, so it won’t be counted when calculating the pagerank of YLF. Of course, this doesn’t solve the problem for people who buy and sell links because they want links that do impact the pagerank.

What this Means for You

I believe that if you care about getting traffic from Google, you need to care about their guidelines. For this reason we do not pay for natural links to YLF, nor do we accept money to put natural links on YLF . When we do link to an advertiser in a post thanking our sponsors or in a review article where the advertiser provided free merchandise, we use the “nofollow” attribute. We are also upfront with advertisers about this practice.

Note that while buying paid links is one example of Search Engine Optimization (SEO) — the set of techniques one can user to make ones site rank well in the search engines — I am not implying that all SEO is bad. There are many good SEO practices that make Google a better search engine by making it more knowledgeable about your site’s content (e.g. using a sitemap). What is bad is anything that distorts the natural link order.

Could you get away with buying and selling links? Probably. Is it worth it? If you are highly dependent on Google traffic, probably not. You might also agree with Google that the web is better off with people linking based on quality and relevance of content, rather than pure dollars. In fact, if paid links started to dominate the web, then Google would have a much harder time providing good search results. And then there would be no SEO-related  reason to pay for links in the first place.

Tragedy of the Commons

This brings us to the tragedy of the commons. From Wikipedia:

The tragedy of the commons refers to a dilemma described in an influential article by that name written by Garrett Hardin and first published in the journal Science in 1968. The article describes a situation in which multiple individuals, acting independently, and solely and rationally consulting their own self-interest, will ultimately deplete a shared limited resource even when it is clear that it is not in anyone’s long-term interest for this to happen.

Will this be true of links on the web? Will commercial interests ultimately ruin the relevance that one can infer from a hyperlink?

Other default characteristics you can specify:

• Width and height
• Background color
• Headlines only versus Headlines and articles
• Whether images are displayed

Note these are only defaults. Your user can change these characteristics to suit their blog. Bear this in mind when creating your widget and try the different options to see whether they look OK.

Once you have created your widget it is immediately available on Widgetbox. See the YLF widgets here.

Likes:

• Quick and easy. It takes a few minutes to create a widget, and the result is easy for your readers to deploy.
• Monitoring tools. There is a nice little tool to monitor the performance of your widgets.

Dislikes:

• Limited creative. Widget customization options are a bit limited. I would like to make my widgets more graphic and “flat” (less gradient and less glass effect), but this isn’t possible. There is no way to change the text headlines to a different color, so you are stuck with their choice of blue. It might also be nice to have a background image.
• Ugly thumbnails. The thumbnail representation of my widgets on the Widgetbox site look pretty ugly, and they also reflect an older version of the widget in some cases. I think this might hurt my ability to get widget users, but I don’t want to design to their thumbnail.
• Neutered backlink. You don’t get a real backlink from the widget. People clicking on the widget will come to your site, but the Google crawler won’t recognize that link when calculating the ranking for your site. So if a blogger deploys your widget on their site instead of putting you in their blogroll, you lose the positive impact that the link would have had on your search engine rankings.

One thing to watch like a hawk with any widget is the overhead it adds to your user’s page load time after they have installed your widget. The widgetbox impact looks reasonable to the naked eye, but the widget does make quite a lengthy exchange with their server. Reload this page and watch the messages that appear at the bottom of your browser (e.g. “Read widgetserver.com” and “Transferring data from flash.quantserve.com…”). If I had a lot of other scripts on this site I might not be happy with this additional overhead.

Still, it is a very quick and easy way to create some nice looking, functional widgets. I think we will use these on YLF until we do something more sophisticated of our own.

The giant among search engines is Google. Nobody outside of Google knows exactly how their algorithm works, but if you search around the web you will find some guidelines on what to do and what not to do. The whole topic of making your site search engine-friendly is called SEO, or Search Engine Optimization.

There are two broad categories of SEO techniques:

1. Black Hat SEO: these are techniques that try to trick the search engines into sending people to your site. Don’t use these techniques. Getting caught might result in Google excluding you from their index, which will be disastrous for your traffic.
2. Legitimate SEO: these techniques just try to make it easier for the search engines to understand your site and its importance. Adding more relevant content to your website, making it easy for Google to figure out what your site is about and marketing your website to create awareness and incoming links are all legitimate ways to increase your ranking.

Keywords are one way to tell Google what your site is all about. You provide these keywords by putting some HTML before the <body> tag on your webpage. In most Wordpress themes you would do this in the “header.php” file. For example, in the YLF theme I have the following code before the <body> tag:
<META name="keywords" content="fashion, body type, what to wear, style, casual wear, dress codes, wedding wear, career wear, footwear, fuller figure, instant style tips, party wear, swimwear, underwear" />
Now, there is a temptation to provide a large number of keywords so that Google associates your website with many different topics, but the wisdom from around the web is that too many keywords will reduce your ranking. Based on this I cut down the YLF keywords a short while ago. It used to be:
<META name="keywords" content="advice, fashion, body type, what to wear, pear shaped, dressing well, trends, style, fashion you can wear, shopping, dress sense, fashion persona, casual wear, event wear, dress codes, dresses, wedding outfits, look slimmer, accessories, power dressing, feel good fashion, look good in your clothes, career wear, celebrities, clothing care, color, european style, fabrications, footwear, fuller figure, global shopping, individual style, fashion industry insider, instant style tips, maternity wear, men's style, party wear, swimwear, underwear" />
Our organic search traffic from Google is still down, so I think I’m going to switch back to the longer list of keywords for a while to see if that helps. You should experiment with different sets of keywords to see what works for you. Note that it can take Google quite a long time to review your site, so any one experiment with keywords should probably be run for at least a month.

I’ve never seen much direct traffic from these directories, but getting listed might help to raise your position in search results pages, particularly if the directory itself has a high page rank. Search engines like Google use the number of incoming links to your site as one factor they take into account when deciding how important your page is on the web. More links from popular sites (like a highly ranked directory) will make your site more popular in their eyes.

Today I added YLF to…

• www.lii.org
• www.turnpike.net
• www.searchwiz.com

…then I ran out of steam. Traffic2MyPage.com has a list of the top 500 directories sorted in page rank order.