Google is introducing Gemini, its latest AI model, to enhance the capabilities of its Bard chatbot, available on Pixel 8 phones and the Bard AI chatbot. Gemini, which brings a multimedia understanding to AI, enables the chatbot to comprehend video, audio, and photos. Pixel 8 phone users can experience these new AI capabilities, with Gemini set to expand to Gmail and other Google Workspace tools in early 2024.

Introduced in December, Gemini facilitates text-based chat with improved AI capabilities in complex tasks such as document summarization, reasoning, planning, and coding. The broader implementation of multimedia capabilities, such as interpreting hand gestures in videos or understanding drawings, is expected to roll out soon.

Google’s foray into generative AI, where chatbots create responses based on plain language prompts, underscores its commitment to advancing AI capabilities in widely used products. Competing with OpenAI’s ChatGPT, Gemini marks Google’s third major AI model revision, emphasizing its potential impact on billions of users through products like search, Chrome, Google Docs, and Gmail.

Beyond text-based chat, Gemini represents a shift toward a more comprehensive understanding of the world, aligning with human interaction that involves speech and imagery. This innovation aims to bring AI closer to replicating human cognition and communication in a three-dimensional, dynamic environment.

Gemini is available in three versions, each tailored to different levels of computing power:

1. Gemini Nano: Designed for mobile phones, catering to various memory levels. It powers new features on Pixel 8 phones, such as conversation summarization and suggested message replies.
2. Gemini Pro: Optimized for fast responses, it runs in Google’s data centers and powers a new version of Bard.
3. Gemini Ultra: Currently in a testing phase, this version is set to launch in early 2024 with advanced chatbot capabilities. Pricing details for Gemini Ultra have not been disclosed.

Google aims to integrate Gemini into its own services, including the Duet AI assistant in Gmail, Google Docs, Meet, and other Google Workspace components. By incorporating Gemini into Google Cloud, the company is also targeting developers who can leverage the technology through Google AI Studio and Vertex AI.

Gemini’s broader implementation, including multimedia capabilities, is anticipated to enhance user experiences across various Google services, fostering a more intuitive and interactive interaction with AI.