Google Blog Search No Longer Indexes Feeds

Vanessa Fox reports that Google's blog search engine changed the way it indexes blog posts. Until now, Google Blog Search only indexed feeds, so the results weren't very good for sites that offered partial feeds. The site started to offer a more comprehensive search by indexing the entire content of the page, including comments, navigation links and blogrolls.

"We have changed the way we index blog posts to include the full content of the page. We've had occasional complaints about the use of the feed content, particularly the problem with partial feeds. The indexing change has improved the results for a lot of queries, both because we have the full content of the page and because we extract links that are missing from the feeds. The downside of this change is that we see more results that match only the blogroll and other parts of the page that are common to all of a blog's posts," explains Jeremy Hylton. He says that the algorithm will be improved to exclude "the content that isn't really part of the post" to make the results more useful.

Here's an example of a comment from a Google OS post indexed by Google Blog Search:


Tip: if you want to find recent blog posts, don't sort the results by date. Just select "last 12 hours" or "last day" from the sidebar. This way, you'll get relevant results and you'll minimize the number of splogs (spam blogs) in the list of search results.

Google News for Blogs

Google Blog Search's homepage has been updated and it now includes a list of popular stories, which are categorized and clustered similarly to Google News.

"Blog Search uses a set of algorithms to try to determine the most popular stories in the blogosphere. We consider factors such as a blog's title and content, as well as its popularity throughout the rest of the blogging community. Then we display groups of posts that are closely related," explains the FAQ.


It seems that Google Blog Search didn't select some authoritative blogs to be listed on the homepage and almost any blog post could be included in a Blog Search cluster. There are 11 categories: politics, US, world, business, technology, video games, science, entertainment, movies, television and sports, but they aren't equally represented.

Google shows a chart for the number of blog posts that discuss a story:


Unfortunately, Google is not able to detect spam posts, plagiarism, forums or blog comments. Google Blog Search doesn't provide yet feeds for the top stories and the search results aren't clustered.


The new Blog Search homepage is a decent alternative to the technology-focused Techmeme and to Technorati's front page. Hopefully, Google will filter the low-quality posts and it will integrate the service with Google News.

{ Thanks, Jonathan. }