Ever wondered why a google search returned search results that lead to sites that require a registration ? How the hell did googlebot index the site without a registration ? Many sites want their site indexed in google to receive more hits and thus, make more money with advertisement on their site. Even more interesting is the following question: How do we use this to our advantage ?
It’s fairly easy, we have to disguise ourselves as the google bot and voila, many sites let us in without registration. The parameter we have to change is called the User Agent. The user agent defines the browser and version that you use. For example it would show Internet Explorer as your browser if you are using this one.
You need to alter your settings to the following:
User Agent: Googlebot/2.1
Compatible: http://www.googlebot.com/bot.html
You can do so in Opera with ease. Firefox offers an extension which is downloadable from the official website.
For Internet Explorer you need to change registry entries:
Windows Registry Editor Version 5.00 [HKEY_LOCAL_MACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User Agent] @=”Googlebot/2.1″ “Compatible”=”+http://www.googlebot.com/bot.html”
Save this as ua.reg and execute.
To revert the changes back, you need the following:
Windows Registry Editor Version 5.00 [HKEY_LOCAL_MACHINESOFTWAREMicrosoftWindowsCurrentVersionInternet Settings5.0User Agent] @=”Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)”
Save as oua.reg and execute.
The Firefox extension we are talking about is one that I have mentioned a few times before on this blog…it is called User Agent Switcher. Just use the information mentioned above to disguise yourself as googlebot.
July 19, 2007 at 2:10 pm |
What type of paid sites are your referring to?
July 19, 2007 at 5:42 pm |
You know adult sites and sites that require you to pay for just getting in and reading their forums.
July 27, 2007 at 5:23 am |
So how do you get into the pay sites? it still asks for a credit card number
July 28, 2007 at 1:42 pm |
I didn’t say it worked for all paysites….
August 1, 2007 at 7:24 pm |
you write that it’s done with ease in Opera.. please tell me how.
BTW. I found a forum post, that matched your blogpost here 100% – weird..
August 1, 2007 at 9:11 pm |
Check my source it is from a forum post……
as for opera look here it shows you how to modify the settings file:
http://www.ericgiguere.com/articles/masquerading-your-browser.html
August 4, 2007 at 5:03 pm |
He just copied it XD
August 5, 2007 at 7:06 am |
cool
August 29, 2007 at 10:30 pm |
So like anyone know what paysites it works with? cause i’ve tried 6 already and nadda
January 31, 2008 at 6:40 am |
yeah me too
April 30, 2008 at 2:29 pm |
Hello, how do I bypass Imlive.com to free video chat with any host of my choice?
April 30, 2008 at 2:32 pm |
How do i bypass prepay sites to video chat free of charge?
April 30, 2008 at 6:46 pm |
This hack only works if the site has allowed search bots into their site it will not work in any other situation. Those paysites above that you mention are probably locked down tight and there is no easy way to get at them. This post is more about taking advantage of a loophole it is not a hack in any sense