The competition in the field of artificial intelligence is accelerating. Less than 24 hours after Google announced Gemini 2.0, OpenAI responded by enhancing ChatGPT with real-time vision and screen sharing capabilities, features that had been promised for over seven months.
A major advancement for conversational AI
ChatGPT has reached a new milestone in its development. In addition to revolutionizing human-machine interaction, it can now analyze and interact with visual elements in real time. This update is part of OpenAI’s “12 Days of OpenAI”, a digital advent calendar designed to unveil the company’s latest innovations.
Enriched interactions through augmented vision
These new features, integrated into the Advanced Voice Mode unveiled during the Spring Update, significantly enhance the user experience. Users can:
- Point their smartphone at an object to receive instant, detailed analysis.
- Use screen sharing to enable seamless digital assistance, from navigating complex interfaces to solving technical issues.
These features are available to ChatGPT Plus, Team, and Pro subscribers (with the Pro subscription announced recently at €200). Activation is intuitive:
- Click the voice icon near the chat bar, then enable video with a single tap.
- Screen sharing can be activated through a dedicated three-dot menu, providing flexible usage options.
A secure and sophisticated technical architecture
OpenAI designed these new features with a strong focus on user security. Data is processed locally whenever possible, while any information requiring cloud processing benefits from advanced encryption and is automatically deleted at the end of each session.
During demonstrations, ChatGPT showcased its impressive ability to analyze graphic design projects. The AI demonstrates remarkable accuracy in identifying visual elements such as color palettes, compositions, and text components. This functionality is particularly valuable for creatives and professionals seeking instant feedback on their work.
A festive touch to enhance the experience
To accompany this major update, OpenAI has added a playful feature: a Santa Claus voice, temporarily available in voice mode. This fun addition reflects OpenAI’s commitment to making its AI both engaging and accessible, while maintaining its technological edge.
This new leap forward marks a significant milestone for ChatGPT, blending technological innovation with an immersive user experience, solidifying its position as a key player against the competition.
