Microsoft enhances Bing Chat by introducing GPT-4-powered image recognition feature

2 min. read

Published on June 29, 2023

published on June 29, 2023

Readers help support Windows Report. We may get a commission if you buy through our links.

Microsoft has recently introduced a major feature to Bing Chat for desktops. The company has started testing an image recognition system powered by OpenAI’s GPT-4, aiming to enhance the image search experience within Bing.

The new Bing Image Recognition Feature utilizes OpenAI’s ChatGPT-4 vision model, which employs optical character recognition (OCR) to identify and understand objects within images. Users will receive detailed explanations accompanied by real-life examples. Although this feature is currently being rolled out to a limited group of users, it has the potential to greatly improve the functionality of Bing Chat.

Users who have got access to the Bing Chat vision feature will notice a new option besides the voice icon. This option allows them to paste web images into the chat and request explanations, or directly upload images for analysis. With the integration of image recognition capabilities, Bing Chat has become a more comprehensive tool for visual searches.

Microsoft emphasizes that the image recognition tool is currently in A/B testing mode, with a random selection of users granted access. Less than 10% of frequent Bing Chat users have been included in this testing phase, indicating that the feature is still being evaluated for wider deployment.

It is worth noting that Microsoft has already introduced similar functionality in Copilot, where users can ask the AI to describe or generate similar images by dragging and dropping them. The company plans to expand the availability of the Bing Image option in the coming weeks, providing a broader user base with this innovative feature.

As part of its ongoing efforts to enhance Bing Image Creator, Microsoft is utilizing its own AI technologies. The integration of Bing plugins is expected to further enhance Bing Chat’s capabilities. These plugins will enable users to customize and personalize their Bing Chat experience, enhancing various search aspects within the platform.

The integration of GPT-4 into Microsoft Chat marks a significant advancement in Bing Image Recognition. With GPT-4’s multi-modal artificial intelligence capabilities, users can conduct image-based searches within Bing Chat, providing a comprehensive search experience. Microsoft’s dedication to enhancing Bing through future plugin integration showcases its commitment to delivering an advanced and intelligent search platform.

Via: TechBizTips

Radu Tyrsina

Radu Tyrsina has been a Windows fan ever since he got his first PC, a Pentium III (a monster at that time). For most of the kids of his age, the Internet was an amazing way to play and communicate with others, but he was deeply impressed by the flow of information and how easily you can find anything on the web. Prior to founding Windows Report, this particular curiosity about digital content enabled him to grow a number of sites that helped hundreds of millions reach faster the answer they're looking for.