Best Buy is Cloaking
Today I discovered that Best Buy cloaks their product pages. I was searching for a Serial ATA PCI controller.
The Google search (the first result should be the Best Buy link)
Notice the URL for the product page:
www.bestbuy.com/products/1093468959466.jsp
Now click the link and notice that it redirects to the dynamic URL:
http://www.bestbuy.com/site/olspage.jsp?id=1093468959466&type=product&ref=03&loc=01
How did Google Get the Static URL?
Best Buy is cloaking via user agent. To see it in action enter the short static URL into my HTTP Response Viewer and select Googlebot for the user agent.
Notice that you get back HTML with all the product information.
Now enter the same URL into my response viewer *but* select a normal browser for the user-agent.
This time you get back a very short piece of HTML that does a meta refresh to the long dynamic URL. This is what the average Joe will land on.
It seems ridiculous for Best Buy to risk getting caught for cloaking when its so easy to simply use mod_rewrite to create static URLs.