In a significant enhancement to ChatGPT’s Advanced Voice Mode, OpenAI has unveiled new vision capabilities, allowing the AI to analyze and respond to live video inputs while also supporting screen sharing during interactions. Although this feature was introduced with GPT-4o, it was initially limited to audio. Now, users can engage with ChatGPT using their smartphone camera, enabling the chatbot to see and interpret the user’s visual environment in real time. This update empowers ChatGPT to understand and discuss visual contexts effectively through a new video icon in the mobile app and a separate menu for screen sharing.
Currently, the upgrades are accessible to ChatGPT Plus, Pro, and Team subscribers, while Enterprise and Edu users will gain access in January. Additionally, OpenAI has introduced a festive voice option that allows users to interact with Santa, a seasonal feature available until early January.
OpenAI’s Chief Product Officer Kevin Weil, alongside the team, demonstrated the new capabilities by using ChatGPT to assist in making pour-over coffee. In the demo, team members used the camera to show the coffee-making process, and the chatbot successfully interpreted and explained the brewing principles. Another demonstration showed ChatGPT’s screen sharing proficiency, highlighting its ability to understand a message on a smartphone displaying Weil in a Santa beard.
The release of this update closely follows Google’s introduction of its Gemini 2.0 model, which also processes visual and audio inputs and is capable of handling multi-step tasks through its various projects like Project Astra, Mariner, and Jules. OpenAI’s latest demo highlights ChatGPT’s ability to identify objects and interact seamlessly, underscoring the AI’s growing sophistication in vision modalities.
These developments mark a significant stride in AI technology, enhancing user experience and expanding AI applications across different domains.
Original Source: https://indianexpress.com/article/technology/artificial-intelligence/chatgpt-advanced-voice-mode-gets-vision-capabilities-openai-rolls-out-santa-mode-9724389/
Category : Artificial Intelligence,Technology
Tags:
Publish Date: 2024-12-14 11:53:00
