Googlebot trawls the web for information, indexing and ranking sites for your searches. How significant is its switch to Android, and its plans for a bigger, 5in screen-size standard?
Did you know Googles been scouring the web identifying itself as an iPhone running iOS 8.3? Well, as of 18 April, thats about to change, when Googlebot dumps its Apple skin and adopts the new Nexus 5X as its mobile standard.
Googlebot is part of Googles search engine technology, which crawls the web, identifying every site and service connected to the open web that will let it in so that you dont have to. It grabs as much information as it can, feeds it to the algorithm that produces the rankings and listings that you as a user access when you type or shout your search terms into the box.
To evaluate a sites performance for various devices, Googlebot identifies itself as certain types or classes of device. From desktop computers to smartphones, the crawler uses whats called a user-agent string, which includes some of the basic capabilities of a device.
For its profiling of mobile sites Googles been using a user-agent that identifies it as an iPhone running iOS 8.3 and therefore an older version of Apples mobile Safari browser on a relatively small smartphone. Starting on the 18 April, Google will start identifying its mobile crawler as one of the companys Nexus 5X smartphones running Android 6.0.1 Marshmallow. That includes the more popular Chrome, which claimed a 36% share of the market in February, leading the third-party UC Browser with 20.1% and Apples Safari with 18.2%, according to data from StatCounter.
Katsuaki Ikegami, a software engineer for Google said: Were updating the user-agent string so that our renderer can better understand pages that use newer web technologies. Our renderer evolves over time and the user-agent string indicates that it is becoming more similar to Chrome than Safari.
Google reckons that the change will have no effect on 99% of the sites out there in the immediate future and the majority of search experts agree. Google recently changed to the way it ranks sites for performance on mobile devices, which had a significant impact on those not optimised for mobile devices.
The switch to Android and Chrome by the Googlebot could see Google favouring sites adopting newer web technologies in the future.
However, many sites including the Guardian simply ignore user agent and serve a single payload to the device, dynamically resizing and formatting depending on the screen real estate available. For them the switch will likely mean very little.