Skip to content
Blog Banner BG Generic D
Generic SEO

Table of Contents

Everyone's favorite social bookmarking site: Del.icio.us, appears to be rendering different content to the search engines than to its users. Every page on del.icio.us appears to have a the following directive in place:

<meta name="robots" content="noarchive,nofollow,noindex"/>

This should technically remove all of their pages from Google's index.  Performing a site:del.ico.us command at google, however, returns several million pages.  I checked Google's cache and didn't see a meta noindex tag.  Examining robots.txt reveals the same thing: a standard user agent renders  "disallow /," but a GoogleBot user agent does not.

They also nofollow all the outbound links on their site, but the nofollow attributes don't appear to be cloaked (so del.icio.us won't pass any link value).

My guess is that this is a method of combatting spam.  They're probably hoping that having the meta tag will deter potential spammers from saturating their site with crap.  It might also weed out robots that are scouring the web for valuable places to inject spammy links.  It doesn't seem like a particularly effective tactic, but I suppose every little bit helps.

Thanks to Emil Stenström for pointing this out.  Apparently this was covered on SEO Speedwagon in August, but I hadn't heard menton of it until now.

The author's views are entirely their own (excluding the unlikely event of hypnosis) and may not always reflect the views of Moz.


Back to Top

With Moz Pro, you have the tools you need to get SEO right — all in one place.

Read Next

Use Google Ads AI & Machine Learning To Run Better Campaigns
Paid Search Marketing (PPC) AI and SEO Online Advertising

Use Google Ads AI & Machine Learning To Run Better Campaigns

Discover how to maximize the potential of Google Ads through AI and machine learning in this article. Learn how to prioritize your ecommerce data, leverage 1st party data, optimize product images, titles, and descriptions, and build a comprehensive shopping feed. Discover the benefits of Google Merchant Center's automatic improvements to ensure up-to-date and high-quality data.

The New Best Practices for Native Advertising on Editorial Sites
Online Advertising Marketing Industry Marketing Psychology

The New Best Practices for Native Advertising on Editorial Sites

How and when we interact with ads online drastically changed in March when COVID-19 ushered in a new era of rolling global lockdowns, not to mention lifestyle changes that none of us could predict. People started interacting with content from different devices, at different times, and reacting to different types of campaign creatives. All of this resulted in a new set of best practices for marketers to follow when it comes to running effective native ads.

Comments

Please keep your comments TAGFEE by following the community etiquette

Comments are closed. Got a burning question? Head to our Q&A section to start a new conversation.