Google announces improvements through Gemini 1.5 Pro, its new version of AI

One day after the announcement of the improvement of the artificial intelligence (AI) model ChatGPT by OpenAI, the Google showed its vision for how AI will improve the products that billions of people use every day. The updates, announced at its annual developer conference, Google I/Ocome as the company tries to move beyond its advertising business with new AI-powered devices and tools.

Google CEO Sundar Pichai introduced new features powered by its latest AI model, Gemini 1.5 Pro. A new tool, called “Ask Photos,” allows users to search images for deeper information — like ask when your daughter learned to swim or remember your license plate number using saved images.

Google executives also demonstrated how the Gemini 1.5 Pro could “read” a textbook and turn it into a kind of AI lecture, presenting teachers with a natural voice who will answer your questions.

This is Search in the Gemini era. #GoogleIO pic.twitter.com/JxldNjbqyn

– Google Google) May 14, 2024

AI improvements are also coming to Gmail. Pichai showed how users can ask Gemini 1.5 Pro to summarize all of their child’s recent school emails by analyzing the attachments and summarizing the key points and pointing out what tasks are needed.

Just a day earlier, OpenAI — one of the technology industry leaders in artificial intelligence — revealed a new AI model that they say will make the ChatGPT chatbot smarter and easier to use. GPT-4o aims to transform ChatGPT into a personal digital assistant that can engage in real-time conversations and interact using text and “vision”. This means it can view screenshots, photos, documents or graphics uploaded by users and have conversations about them.

Google also showed off the latest abilities of Gemini, the company’s chatbot, to accept different types of input — it will have “multimodal” capabilities to receive text, voice or images in direct response to the ChatGPT update. One executive also demonstrated a virtual “buddy” who can help keep track of to-do lists, organize data and manage workflows.

The company highlighted improvements to search, allowing users to ask more natural or more focused questions, and providing multiple versions of answers, such as detailed or summarized results. For example, AI can suggest kid-friendly restaurants based on location, or what might be wrong with a device, like a camera, by taking a video of it via Google Lens. The objective is basically to facilitate searching on the search engine, said the company.

We were also given a brief preview of Project Astra, developed by Google’s DeepMind AI lab, which will allow AI assistants to help in users’ everyday lives by using their phones’ cameras to interpret information about the real world, such as identifying objects and even find lost items. In the presentation, it was demonstrated how this would work in augmented reality glasses.

According to analyst Jacob Bourne of market research firm Emarketer, it’s no surprise that AI was the main focus of this year’s Google developer conference. “By showcasing its latest models and how they will leverage existing products with strong consumer reach, Google is demonstrating how it can effectively differentiate itself from competitors,” he said.

He believes the reception of the new tools will be an indicator of how well the company can adapt its search product to meet the demands of the generative AI era. “To maintain its competitive advantage and satisfy investors, Google will need to focus on translating its AI innovations into profitable products and services at scale,” he said.

This content was originally created in English.

original version