Google Tweaks Algorithm To Spot 'Content Farms'

How-to content on the Internet has become popular and profitable. Google recently changed its search algorithm because it didn't like the glut of sites that show up every time you search how to do something.

Copyright © 2011 NPR. For personal, noncommercial use only. See Terms of Use. For other uses, prior permission required.

MARY LOUISE KELLY, host:

It's MORNING EDITION from NPR News. Good morning. I'm Mary Louise Kelly.

RENEE MONTAGNE, host:

And I'm Renee Montagne.

Let's look again at those Internet sites that serve up answers to your pressing questions. Yesterday, we heard how popular and profitable how-to content has become on the Web. Today, we'll examine the explosion of such sites. When you type how do I brush my teeth or how do I fix the light in my 2000 Silverado, there are hundreds, if not thousands, of results. And Google is not too happy about it, as NPR's Zoe Chace reports.

ZOE CHACE: The reason there are so many answers to your questions online is simple. It's easy money. Popular answers to how do I brush my teeth can stay at the top of your search results for a long time. That means a lot eyeballs on the answer and the ads right next to them for, say, toothpaste, dental floss or mint gum. Advertisers love to appear next to answers to your questions.

The money is so easy, some content-providing sites contain more ads than they do answers. Fortune editor Daniel Roth calls them content farms.

Mr. DANIEL ROTH (Editor, Fortune Magazine): Content farms pay people almost no money to turn out very mediocre content that can serve up very cheap ads. It's pure Google arbitrage.

CHACE: Here's how you know a content farm when you see one. Google how to change a tire.

Mr. ROTH: And there is a six point explanation of how to change a tire and point three is something like, get out of the car. Try to find your jack. You can tell that whoever was writing this was trying to finish it as quickly as possible in order to get the tiny amounts of money they're making for doing these stories.

Ms. SASHA MAGGIO: I look at it like $8 is $8. I'll give them $8 worth of work. The more I can cram in the better on a payday.

(Soundbite of laughter)

CHACE: Sasha Maggio writes for a few of the sites that some have called content farms. Here's how she structures her day.

Ms. MAGGIO: So when you log in, it brings you to what they call my work desk.

CHACE: At the work desk, there's a list of automatically generated topics, based on how popular they are in search engines. [

Ms. MAGGIO: How to inflate tennis balls, history of the NBA championship ring, guide to dating mature women.

CHACE: How to date a Japanese girl?

Ms. MAGGIO: Yes. I mean, these are not ones that I pick up, though. I just - I mean, I don't create these topics. I just go into the content pool and I find them. How to buy martial arts training mats, five tae kwon do tips.

CHACE: Maggio is a military wife who works from home with a Pomeranian on her lap. After looking for work for months in Fairfax, Virginia, where her husband is stationed, she decided to go back to school to get a masters degree in Psychology. She supports herself by freelance writing.

Ms. MAGGIO: My best day I wrote 10 in about 75 minutes. So you got to figure, I made 80 bucks in 75 minutes, which is decent. I mean, that's more than I made when I was working full time.

CHACE: It's 15 bucks an article for eHow, $8 an article for MadeMan.com, and a buck an article, plus revenue traffic, for Examiner.com.

To keep it straight, Maggio has a notebook open on her desk, with a different colored pen assigned to each of her employers. Today, she starts with eHow.

Ms. MAGGIO: So I have sales closing tips, tips for a passive aggressive boss, the effects of a tsunami on oil storage tanks. Some of these you have to look up, some of them they're not too bad, but all of them require a reference. So you've got to do some kind of research.

CHACE: Because eHow requires a reference - not all of Maggio's employers do -Google might consider it a higher-quality site and rank it high in your search results.

There's so much money to be made at ranking high in Google's search results that we ought to just ask Google how it's done. Google?

Mr. MATT CUTTS (Google): We use a lot of different factors. In fact we have more than 200 different signals that we use in our ranking.

CHACE: Matt Cutts is an engineer in charge of the algorithm that Google uses to generate search results. And what Cutts and his team of engineers decided recently is they don't like the glut of sites that show up every time you search how to do something.

Mr. CUTTS: Does an article have spelling or stylistic or factual errors, you know. How well is it edited? Does the article have an excessive number of ads maybe that might interfere with the primary content.

CHACE: So on February 24th Google made possibly the most visible change they've ever made to your search results.

Mr. CUTTS: This is a relatively large change to the algorithm - about 12 percent of queries are affected.

CHACE: And we found out what sites Google thinks you want to read and what sites Google thinks are content farms. Though Cutts is cagey when it comes to naming names, other people have. EHow was spared initially, but Examiner was not, according to one study.

The site that pays Maggio a dollar an article is almost 80 percent less visible than it was before Google made the change. And Google continues to tweak its algorithm, implicitly if not explicitly targeting content farms. After another update last week, eHow's visibility did drop, though by how much is in dispute.

But the story's not over yet. I'm going to bring back Daniel Roth from Fortune Magazine to make one last point. He says what if people just start searching the web without Google. That kind of messes up the game for all the players.

Mr. ROTH: I know, speaking personally, I read a lot from what I see from my friends on twitter.

CHACE: Roth says your social network might be the next search engine. And it's still pretty hard to game the system of hearing directly from your friends.

Mr. ROTH: When they suggest a story, I'm way more likely to click on it, because it's already been vetted. So I spend less time on aggregation sites, and I spend more time looking to see what my friends are aggregating for me. And how do you win in that game? I think you win in that game by writing stories that people really want to read.

CHACE: If people stop using Google for search and travel the internet by a new path, like Facebook or Twitter, then the game starts all over again.

Zoe Chace, NPR News.

Copyright © 2011 NPR. All rights reserved. No quotes from the materials contained herein may be used in any media without attribution to NPR. This transcript is provided for personal, noncommercial use only, pursuant to our Terms of Use. Any other use requires NPR's prior permission. Visit our permissions page for further information.

NPR transcripts are created on a rush deadline by a contractor for NPR, and accuracy and availability may vary. This text may not be in its final form and may be updated or revised in the future. Please be aware that the authoritative record of NPR's programming is the audio.

Web's 'Content Farms' Grow Audiences For Ads

Millions of times a day, people turn to Google for information on how to do things. Until Google changed its formula recently, the top sites returned in searches were often dominated by so-called "content farms" geared mostly at serving up ads.

hide captionMillions of times a day, people turn to Google for information on how to do things. Until Google changed its formula recently, the top sites returned in searches were often dominated by so-called "content farms" geared mostly at serving up ads.

Mito Habe-Evans/NPR

Think of Google like a well traveled interstate. It's how people get where they want to go on the Internet. You Google "tomatoes, mozzarella and basil" to get instructions on making a caprese salad. It's your way into the Web. And like a real highway, a whole industry has built up around the popular search engine — like fast food joints and hotels along Interstate 95.

"There is an entire industry that's sprung up around the idea of search engine optimization, of understanding how Google thinks, how Bing thinks, and reverse engineer[ing] how the search engines do their searches," says Daniel Roth, an editor with Fortune magazine.

What this means is that there are so many people asking Google questions, a slew of companies have shot up over the past couple of years to provide answers.

No Expiration Dates

How-to sites are very desirable to advertisers, for one simple reason: The content doesn't have an expiration date. It stays fresh.

"Advertisers don't necessarily want to be up against coverage of Japan, or coverage of the recession. If you sell carpet cleaner, and the how-to site is how to stop your dog from peeing on the rug, then that is a perfect article you want to be next to," Roth says.

An article on how to put on eye makeup is just as pertinent in six months as it is right now — so if the company creating the content really gets its formula right, its article on eye makeup should stay at the top of search results for a long time. That's great for advertisers. And that's why companies like Howcast are doing so well in this economy.

Howcast, which commissions how-to videos, is headquartered in an airy loft in downtown Manhattan. The company is prospering but has a real startup feel: crisp, white-washed office, but a little hip — like an Apple store. Supervising producer Tom Bender and I sit down together at one of the many screens. He pulls up a Google document.

"These are spreadsheets that show the process of going from search queries to titles," he says. The most popular searches in YouTube about dance are, according to Bender: "How to dance. Dougie Dance. Hip-hop dance. Wedding dance. Cupid shuffle."

How To Dance Or Put On Makeup

How much can Howcast make off the query, "How to dance the cupid shuffle"? To decide whether to commission a video, Bender gives it a score. He won't reveal all of the ingredients: Remember, this formula is Howcast's exclusive ticket to the top of your search results. But here are the main factors. Let's use "eye makeup."

"That query receives about 200,000 searches per month on YouTube," Bender says.

He looks at how many results come up for this search — it's not that much, by comparison — 5,000 to 6,000. So he feels his video can compete here.

Then there's a third factor, which is key: the cost per click associated with that query. The cost per click is how much advertisers are willing to spend to put an ad next to this particular topic — if your video shows up near the top of the YouTube results.

Marcus Milius makes harmonica instructional videos for Howcast.

hide captionMarcus Milius makes harmonica instructional videos for Howcast.

Watch One Of His Videos
Howcast

Howcast's winning formula has led the company to create entire video series on topics like "understanding the types of harmonicas, how to play a chromatic harmonica, how to play a diatonic harmonica, how to play blues harmonica, how to play harmonica solo," Bender says.

Churning Out Harmonica Videos

And right over our heads is the Howcast studio — where harmonica player Marcus Milius is sitting on a stool, in a sweaty suit and bowler cap, creating answers to these profitable questions.

"How many do you have left to do?" I ask the videographer.

"Nine," he replies.

"Do we really?!" Milius asks.

You could think of Milius as a well-dressed factory worker. The videographer has a list of more than 20 individual titles for videos that he checks off as Milius gets up to stretch his legs. There's no ambiguity.

"Pretty much they just gave me the list," Milius tells me, "and I'm creating content based upon these questions."

Howcast was co-founded by a former Google engineer, Jason Liebman, who felt that the how-to market was unfulfilled. Many people were searching for how to do something on YouTube and not getting quality results, he says.

That's what Howcast set out to do, and that's what landed Milius in the stool upstairs. More science than art, the videos are nonetheless well presented — like Howcast's office, clean and well-ordered, with that Apple store feng shui.

Gaming Google's Algorithm

But not all how-to content is like the Apple store. In fact, there is so much money to be made attracting advertisers to evergreen content, Fortune magazine's Daniel Roth says, that some companies have followed the formula to its logical conclusion — putting out sites that have more ads than content. Some people call them "content farms."

"Content farms pay people almost no money to turn out very mediocre content that can serve up very cheap ads. It's pure Google arbitrage," he says. "Google arbitrage" is an amazing way to think about this industry. Like speculators who make a killing exploiting simple supply-and-demand markets, some companies try to game Google's algorithm.

Here's how you know a content farm when you see one. Search Google for "how to change a tire," Roth says, and there is "a six-point explanation of how to change a tire, and point three is something like, 'Get out of the car. Try to find your jack.' "

Sasha Maggio writes for multiple websites that pay her from $1 to $15 per article.

hide captionSasha Maggio writes for multiple websites that pay her from $1 to $15 per article.

Zoe Chace/NPR

"You can tell that whoever was writing it was trying to finish it as quickly as possible in order to get the tiny amounts of money they're making for doing these stories."

Sasha Maggio, who lives in Fairfax, Va., writes articles for some of these so-called content farms. After searching for work for months, she decided to go back to school to get her master's degree in psychology. She supports herself by freelance writing.

Cranking Out Articles For $8 A Piece

"I look at it like, $8 is $8," Maggio says, logging in to what she calls her "work desk."

"I'll give them $8 worth of work. The more I can cram in the better, on a payday," she says.

On her screen, she sees a list of topics that are automatically generated based on how popular they are in search engines.

She reads off a bunch: "How to inflate tennis balls, history of the NBA championship ring, guide to dating mature women ..."

"How to date a Japanese girl?" I interrupt.

"These are not ones that I pick up, though!" Maggio says, laughing. "I don't create these topics, I just go into the content pool and I find them — how to buy martial arts training mats, five tae kwon do tips ..."

Break Studios, which runs a bunch of sites like MadeMan, Break and Holy Taco, is the company that pays Maggio $8 an article. But she also works for Demand Media, which owns eHow and a number of other sites. Demand Media pays on a sliding scale based on the estimated difficulty of the topic, and it usually pays her $15 an article. She also writes for Examiner.com, which pays $1 an article, plus revenue traffic.

"My best day I wrote 10 [articles] in about 75 minutes," Maggio says. "So you gotta figure, I made 80 bucks in 75 minutes — that's more than I made when I was working full time!"

Websites' Visibility Takes A Hit

Google's algorithm change -- aimed at reducing low-quality sites in its search rankings -- had a dramatic effect, according to a study by Sistrix, a German search analytics company. Below, a sampling of so-called "content farm" sites and the loss of their visibility on Google as a result of the algorithm change.

Domain Visibility index
percent loss
articlesbase.com-94%
suite101.com-94%
associatedcontent.com-93%
business.com-93%
americantowns.com-91%
essortment.com-91%
faqs.org-91%
ezinearticles.com-90%
findarticles.com-90%
freedownloadscenter.com-90%

Note

The Sistrix Visibility Index takes into account the number of keyword positions lost, specific ranking position and estimated click-through rate from those results.

To keep it straight, Maggio has a notebook open on her desk, with a different colored pen assigned to each of her employers.

Today, she starts with eHow: "So, I have sales-closing tips; tips for a passive-aggressive boss; the effects of a tsunami on oil storage tanks. Some of them you have to look up, some of them aren't too bad, but all of them require a reference. So, you gotta do some kind of research."

Because eHow requires a reference — not all of Maggio's employers do — Google might consider it a higher-quality site and rank it high in search results.

Google Changes Its Formula

"We use a lot of different factors," says Matt Cutts, one of Google's lead engineers. "In fact, we have more than 200 different signals that we use in our rankings."

Cutts is in charge of the algorithm that Google uses to generate search results. He and his team of engineers decided recently that they don't like the glut of sites that show up every time you search how to do something.

So, more than a month ago, Google made possibly the most visible change it has ever made to its search results — an operation it nicknamed "Panda" but that many others called "Farmer." Cutts says this "relatively large change" to the algorithm affected about 12 percent of queries on Google.

The change revealed what sites Google thinks you want to read — and what sites it thinks are content farms. "Does an article have spelling or stylistic or factual errors? How well is it edited? Does the article have an excessive number of ads, maybe, that might interfere with the primary content?" Cutts explains.

Though Cutts is cagey when it comes to naming names, other people have. EHow was spared — but Examiner was not, according to one study. The site that pays Maggio $1 an article is almost 80 percent less visible than it was before Google made the change.

And Google continues to tweak its algorithm, implicitly if not explicitly targeting content farms. After another update last week, eHow's visibility did drop — though by how much is in dispute.

Social Networks As Search Engine?

Fortune's Daniel Roth wonders, what if people just start searching the Web without Google? That kind of messes up the game for all of the players.

Roth says your social network might be the next search engine. And it's difficult to game a system that consists of recommendations from your friends.

"When they suggest a story, I'm way more likely to click on it, because it's already been vetted," he says. "So, I spend less time on aggregation sites, and I spend more time looking to see what my friends are aggregating for me. And how do you win in that game? I think you win in that game by writing stories that people really want to read."

If people stop using Google for search — and travel the Internet by a new path, like Facebook or Twitter — then the game starts all over again.

Comments

 

Please keep your community civil. All comments must follow the NPR.org Community rules and terms of use, and will be moderated prior to posting. NPR reserves the right to use the comments we receive, in whole or in part, and to use the commenter's name and location, in any medium. See also the Terms of Use, Privacy Policy and Community FAQ.

Support comes from: