Bingbot User Agent is Changing


Bing announced that it is changing the user agent string that identifies itself as Bingbot. Now there will be two user agents, one for the desktop and the other for the mobile crawler.

The new user agent provides more information, including the latest version of Edge.

user agent

A user agent is a message from software that tells a website server what type of software device it is visiting.

A user agent can tell a website whether it is a browser or a search engine bot.

Some website software and SaaS applications rely on the user agent to identify search bots and do things such as prevent them from visiting search or registration pages.

Bing user agent change is a transition

Microsoft will continue to use the older Bingbot crawler user agent until the fall of 2022, which is an unclear date.

However, the Bing Webmaster Tools URL Inspection Tool has already switched to the new bingbot user agent.

There are apps and software that may need updating, so this gives them several months to update their software so that they can accurately identify Bingbot.

But there is no need to update robots.txt as the new version can continue to be addressed as bingbot in robots.txt.

Robots.txt will not need to be updated to accommodate the new bingbot user agent string.

However, for software and services that do partial matching, such as phpBB, it will not be necessary to update the code to accommodate the new user agent.

If a publisher, app or software uses bingbot/ to identify bingbot with a partial map, that code will continue to work.

old and new user agents

This is the old Bingbot user agent:

Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

The new Bingbot user agents are an improvement because they identify between the desktop and mobile versions of the Microsoft Bing web crawler.

These are the new Bingbot user agents:

desktop

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/W.X.Y.Z Safari/537.36

Mobile

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

According to the official Microsoft Bing announcement:

“We will test websites carefully before switching them to our new user-agent Bing Webmaster Tools URL Inspection has begun using the new desktop user-agent for live URL testing to help you investigate potential issues Is.

Feel free to if you face any challenge Contact,

quote

Read the Official Microsoft Bing Announcement

Announcing user-agent changes for the Bing crawler bingbot





Source link

Leave a Comment