The world is unfair, the New York Times uses hidden pages

A few days ago, BMW’s website was blocked by Google because of cheating, but in less than 24 hours, BMW’s website was re-listed. I can hardly believe that BMW did not have direct contact with Google. The obscure little website wants to contact Google, and even the door can’t touch it. How can it be re-recorded within 24 hours?

I saw a news today. Some people found that the New York Times website uses page cloaking, which means that the content of web pages crawled by search engine spiders is different from what ordinary users see.

If we search for ” fried man “, we will see this in the description in the second search result, “Addicted to Oil: Thomas L. Friedman Reporting” at the SilverDocs film festival on Friday …”


But if you click on the page and click on this link to the real page, you will not see this on the page. What you can see is: “If you want to read all the articles, please subscribe to the New York Times online version.”


Obviously, the New York Times website will detect whether it is a search engine spider or a normal user. If it is a search engine spider, the web page returns the content that would have been seen after logging in with the account name and password. If it is a normal user, you will be prompted to log in or need to subscribe.

This is a typical way of dealing with search engine spiders.

There has been a clear statement about the hidden page Matt Cutts. He said that IP delivery is no problem, that is, it returns different content according to the user’s IP address. For example, if the user is from the UK, the user is transferred to domain name. If you are from France, you will transfer the user to the.for domain.

But what Google doesn’t allow us to give Google spiders a special treatment, that is, if the visitor is a Google spider, then return a set of content that only Google can see.

So IP delivery doesn’t matter. In fact, many websites, including Google, do this, but don’t do anything special with search engine spiders.

The New York Times has just returned to the search engine spiders that only the search engine can see, no doubt using the hidden web technology, but Google, Yahoo, etc. have no opinion.

So sometimes you can’t complain about why your website is being punished or not ranked. The world is extremely unfair.

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button