OpenAI Expands ChatGPT's Capabilities on macOS with Apple Notes and Third-Party App Integration

OpenAI Boosts ChatGPT For macOS With Apple Notes Integration And Third-Party App Support

OpenAI is aggressively expanding its user base by making its AI platforms widely available and extending into other domains. The company has been working on transitioning into a for-profit organization, an attempt that has gotten the company into legal trouble. Now, OpenAI is expanding the capabilities of its ChatGPT app further for macOS by extending support for Apple Notes and various other popular third-party apps. This initiative is salient as it not only broadens its user base but also allows for a seamless integration. OpenAI has been introducing several new features and working on groundbreaking capabilities with the goal of massively expanding its products. Now, the company is focused on extending its functionality further and enhancing utility for users by adding compatibility with Apple Notes and other widely used third-party applications to its ChatGPT app for macOS. Last month, an update was rolled out by OpenAI that was centered on giving ChatGPT the access to interact and interpret on-screen content from certain applications of Mac, and now it seems that this new update is a follow-up of the previous one and builds up on the existing functionalities. MacOS users are very excited about this development because of the utility it will bring them. It is not just users that can benefit from the expanded capabilities but the developers as well. Users can use the AI platform when working on content in Apple Notes, Quip, or even Notion and meanwhile developers can use several development tools such as Android Studio or JetBrains IDEs. With the help of the enhanced functionality, the ChatGPT app can be used to draw analysis of codes from multiple apps simultaneously. This would help streamline workflow by giving more relevant suggestions and removing the need to constantly copy-paste information. While the app integration feature is currently available to only those who have paid subscriptions, little has been shared on whether it will be more widely available later on. OpenAI gives users the assurance of taking necessary privacy measures by having complete control of the apps ChatGPT gets access to and dealing with the data the same way it does for its regular conversation history. To get this enhanced ChatGPT working with apps, simply: OpenAI's new update is meant to bring great utility for users and developers on macOS.

The ChatGPT app is updated on Mac and PC: these are its new abilities - Softonic

With the latest update of the ChatGPT app for Mac and PC, OpenAI has surprised us with a series of improvements that continue to evolve how we use this tool on our computers. From new integrations with applications to the possibility of using the Advanced Voice Mode in them, we are seeing how ChatGPT is becoming much more than an artificial intelligence assistant. If a few weeks ago we saw the beginning of the integration with third-party apps on the desktop, now the list is expanding. And this includes not only more code editors but also text applications, terminals, and productivity platforms. Among the new integrations are BBEdit, MatLab, TextMate, and the JetBrains ecosystem, with options like IntelliJ IDEA or PyCharm, among others. Additionally, support has been added for applications like Apple Notes, Notion, and Quip, allowing us to enjoy the power of ChatGPT within the environments we already work in daily. This means we can draft notes in Notion, edit projects in BBEdit, or create workflows in Quip while ChatGPT offers contextual suggestions, resolves our doubts, or even helps us with the creation of the content itself. OpenAI has clarified that these new features are only activated with our consent so that we can, at all times, maintain privacy and control over our data. In the words of Kevin Weil, product director at OpenAI: "We are moving towards a more agentive experience, where ChatGPT will not only answer questions but also do things for us." Another really interesting change that comes with this update is the integration of the Advanced Voice Mode with the new applications. This mode, which had already shown its potential in previous updates, now allows ChatGPT to interact more naturally and quickly with compatible applications, such as Notes or TextEdit. The Voice Mode can interpret the context of the application we are working in. If we are writing a note, for example, we can ask ChatGPT to summarize our ideas or even suggest ways to improve them. In the case of platforms like VS Code, we can dictate code snippets that the system will adjust according to our instructions. All of this, without pressing a single key. The ChatGPT app is beginning to take the first steps towards more autonomous computer use. Although OpenAI has been cautious in this regard, Weil hinted in his comments that, with our permission, ChatGPT could read what appears on the screen or even perform certain tasks automatically, such as writing text, organizing documents, or modifying settings. An approach that is similar to the model Anthropic has developed with Claude and which, according to OpenAI, will be gradually rolled out, with more features planned for 2025. While we wait for these updates, it is clear that the latest update of ChatGPT for Mac and PC marks a before and after in how we interact with this tool on the desktop. Thanks to its new integrations, the Advanced Voice Mode now available in these integrations, and its growing ability to manage tasks, ChatGPT is becoming an indispensable companion for our daily activities.

ChatGPT on macOS now floats, talks and works across your favorite apps

OpenAI has significantly upgraded its ChatGPT macOS app, enhancing functionality with new features aimed at improving user interaction and productivity. The latest update introduces Advanced Voice Mode and the "Working with Apps" feature, allowing users to engage with ChatGPT through voice commands while using various applications. With the launch timed for Day 11 of OpenAI's "12 Days of OpenAI" event, the updated macOS app now floats on users' screens, functioning as a digital sidekick. Users no longer need to type their requests; they can simply speak aloud to prompt ChatGPT to assist with tasks like drafting emails, brainstorming ideas, or debugging code. This hands-free capability positions the app as a valuable tool for multitasking. The "Working with Apps" feature greatly enhances the app's utility, enabling it to interface with numerous applications, particularly coding environments. Users can grant ChatGPT access to apps on their Mac, allowing the AI to read and analyze on-screen content. For instance, if a user is working in a complex code editor like Warp, they can ask ChatGPT for insights or code suggestions without needing to switch tabs or copy and paste content manually. OpenAI demonstrated this capability by having ChatGPT write directly into Xcode, showcasing its potential for app development tasks. Everyone can use the ChatGPT Mac app now Beyond coding tools, ChatGPT's app compatibility also extends to productivity applications. It can now generate content in apps like Apple Notes and Notion, aiding users in organizing thoughts and ideas, including sourcing information from the internet. This collaboration spans a variety of third-party applications, enhancing workflow for users across different domains. As part of this expanded functionality, OpenAI has added support for several Integrated Development Environments (IDEs) and tools. Newly included apps are BBEdit, Android Studio, and many more under various categories such as IDEs, Terminal apps, and productivity tools. This all-encompassing integration emphasizes the commitment to creating a seamless experience for macOS users working with diverse applications. Privacy remains a priority; users can control when and which apps ChatGPT is allowed to access. OpenAI ensures that user data is handled with care, granting users the ability to oversee their conversation histories within the app. This transparency is essential for maintaining trust while leveraging AI assistance in various workflows. The features introduced in the ChatGPT for macOS app are accessible to Plus, Pro, Team, Enterprise, and Edu subscribers. However, there is currently no indication of when or if these capabilities will be available to free users. The app itself can be downloaded for free from OpenAI's website, giving macOS users direct access to its features while offering enhanced functionalities to subscribers.

ChatGPT for macOS Now Supports Apple Notes And Other Third-Party Apps

OpenAI added support for several note-taking and coding apps within the ChatGPT app for macOS on Thursday. The AI firm described this feature as agentic and highlighted that the chatbot will be able to read on-screen information in the supported apps and help users with queries. This feature is currently available to only the paid subscribers of the AI platform and users can use the Advanced Voice Mode while working with these apps. OpenAI stated that Windows users and those on the free tier of the app will get this feature next year. The new feature was announced on day 11 of OpenAI's 12-day shipping schedule. This new agentic capability, which allows the chatbot to read information in several note-taking and coding apps is being added to the macOS app of ChatGPT, the company highlighted in an X (formerly known as Twitter) post. Kevin Weil, the Chief Product Officer at OpenAI further revealed that ChatGPT can work with roughly 30 macOS apps. The full list includes Apple Notes, BBEdit, MatLab, Nova, Script Editor, TextMate, VSCode Insiders, VSCodium, Cursor, WindSurf, Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover, WebStorm, Prompts, Warp, Notion, and Quip. With this feature, users can open a supported app and go to any screen or content. They can then use the shortcut Option + Space to open a small text-field view of the app. The chatbot can see what the user sees in the app, once activated. Then, the user can either use text prompts or the Advanced Voice Mode to ask queries, and ChatGPT can respond to them. Users can also highlight a specific part of text or code and then use natural commands such as "how to make this better" and the AI will understand the context. While the company calls it an agentic feature, it is technically more of a vision-based feature. The agentic function is required only when gaining permission to access these apps. However, ChatGPT will not be able to interact with these apps and cannot perform tasks such as writing text or code or changing existing information. For privacy, users will be able to control when and which apps can be accessed by ChatGPT. Additionally, OpenAI stated that users will have the same level of control over this data as they would over anything else in their conversation history. This feature is currently available to ChatGPT Plus, Pro, Teams, Enterprise, and Edu subscribers. Free users and those using the Windows app will have to wait till the next year to get this feature.

ChatGPT for Mac Can Now Read Your Apple Notes - Here's How

OpenAI has expanded the capabilities of its ChatGPT app for macOS, adding support for Apple Notes and a range of popular third-party apps. The update builds on last month's release that introduced the ability to read on-screen content from select Mac apps. This expansion should broaden ChatGPT's utility for both casual users and developers using macOS, as the AI assistant can now interact with content in Apple Notes, Notion, and Quip, alongside numerous development environments including BBEdit, Android Studio, and various JetBrains IDEs. For developers, the update also adds support for additional IDEs including VSCode forks (VSCodium, Cursor, WindSurf) and terminal apps like Prompt and Warp. The AI can analyze code from multiple apps simultaneously, offering suggestions for improvements without manual copy-pasting. OpenAI says that users maintain full control over which apps ChatGPT can access, and all data handling follows the same OpenAI privacy protocols as the app's regular conversation history. The expanded app integration feature remains exclusive to paid subscribers, including ChatGPT Plus, Pro, Team, Enterprise, and Edu users. The advanced voice mode is especially useful in this context, since it allows you to speak handsfree to ChatGPT and get suggestions or modifications to your on-screen content. OpenAI recently demonstrated the feature using a holiday party planning scenario, where ChatGPT provided song recommendations and party ideas using a Santa voice persona. The ChatGPT app for macOS is available for download from OpenAI's website.

ChatGPT adds more PC and Mac app integrations, getting closer to piloting your computer

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More OpenAI has expanded the number of applications its desktop apps can work with, including allowing Advanced Voice Mode to work with other apps, and is moving closer to ChatGPT using computers. The desktop app introduced integrations in November with an initial four applications. During Day 11 of its "12 Days of OpenAI" event, OpenAI announced several new integrated development environments (IDEs), terminals and text apps it will support. ChatGPT now supports BBEdit, MatLab, Nova, Script Editor, TextMate as IDEs, VS Code for VSCode Insiders, VSCodium, Cursor, WindSurf, the JetBrains family of IDEs of Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover and WebStorm. It also added the Warp and Prompt terminal apps as integration. These applications join VS Code, Xcode, Terminal, iTerm 2 and TextEdit as integrated apps. But coding applications won't be the only applications that ChatGPT desktop apps can access. OpenAI also added Apple Notes, Notion and Quip to its integrations. Advanced Voice Mode can work with these applications, considering the context of projects in the integrations. OpenAI emphasized that users must give ChatGPT permission to access these applications. Letting ChatGPT use your computer for you App integrations with AI chatbots are, of course, nothing new. In October, GitHub Copilot added coding platform integrations. Connecting applications to ChatGPT or Copilot brings context from those platforms into the chat experience. Developers can prompt ChatGPT for some coding help for a project they have on VS Code, and the chatbot understands what they've been working on. Kevin Weil, chief product officer at OpenAI, said during a live stream that improving the desktop app will help the company get closer to a more agentic user experience for ChatGPT. "We've been putting a lot of effort into our desktop apps," said Weil. "As our models get increasingly powerful, ChatGPT will more and more become agentic. That means we'll go beyond just questions and answers; ChatGPT will begin doing things for you." He added that the desktop apps "are a big part" of that transformation. "Being a desktop app you can do much more than you can than just a browser tab," he said. "That includes things like, with your permission, being able to see what's on your screen and being able to automate a lot of the work you're doing on your desktop. We'll have a lot more to say on that as we go into 2025." If OpenAI lets ChatGPT see more of your computer, ChatGPT will get closer to Anthropic's Claude Computer Use feature, which allows Claude to click around a person's computer, navigate screens and even type text. OpenAI already announced a fairly similar feature for the mobile version of ChatGPT, although the chatbot cannot yet access computers or phones the same way. Users can share their screens with the chatbot so it can "see" what they're reading or looking at. Microsoft and Google also developed comparable features with Copilot Vision and Project Astra. How to access On MacOS, users who want to open ChatGPT while using other applications can use "option + space" to pull up ChatGPT and choose the application they need through a button on the chat screen. Another shortcut, "option + shift + 1," brings up the topmost application used. From that window, users can also access Advanced Voice Mode in the same way. Voice mode automatically detects context from the application. Integrations are available to ChatGPT Plus, Pro, Team, Enterprise and Edu users. However, Enterprise and Edu subscribers must ask their IT administrators to turn on the feature.

OpenAI now integrates with Notes, Quip, and Notion -- here's what's new

Today marked the eleventh day of the "12 Days of OpenAI" event and OpenAI unveiled significant enhancements for ChatGPT, focusing on the chatbot seamlessly integrating with popular applications. The team hopes that the advanced functionalities will elevate user experience with the AI. The day's presentations were led by Kevin Weil, OpenAI's Chief Product Lead, who introduced the concept of 'Agentic' functionality. This approach enables ChatGPT to perform tasks autonomously on behalf of the user, marking a significant shift towards more proactive AI assistance. Other tech giants have been working towards this type of advancement including Anthropic. In a live demonstration, the OpenAI team showcased ChatGPT's capabilities within Notion by creating a guide for a walking tour. The AI seamlessly assisted in expanding selected text, effectively filling out talking points. Utilizing ChatGPT's search functionality, the team generated detailed information on historical figures, such as Emperor Norton, complete with citations, thereby ensuring accuracy and transparency. This feature exemplifies ChatGPT's ability to "show its work," providing users with verifiable sources for the information generated. The ChatGPT desktop app for Mac was highlighted, featuring a floating window that provides easy access and allows the AI to view and understand the context of other active applications. This integration facilitates seamless assistance across various tasks, reinforcing ChatGPT's role as a versatile tool in users' daily workflows. OpenAI announced that ChatGPT now supports direct integration with widely used Apple productivity tools, including Apple Notes, Quip, and Notion. This development enables users to interact with ChatGPT within these applications, streamlining workflows and enhancing productivity. The functionality is set to roll out today, providing immediate benefits to users. The team stated that Windows integrations will be forthcoming. Support for Advanced Voice Mode within ChatGPT was also highlighted. This feature allows users to interact with the AI using voice commands, enhancing accessibility and user engagement. In the demonstration, the team utilized this mode within Apple Notes to create a "Holiday Party Set List." By engaging in a voice conversation with ChatGPT, they received feedback on the proposed songs. Notably, ChatGPT identified and corrected errors, such as recognizing the incorrect title "Freezy the Snowman" and suggesting the correct "Frosty the Snowman." This interaction highlights ChatGPT's proficiency in understanding context and providing real-time corrections via conversation to improve the quality of user's content. OpenAI emphasized ChatGPT's enhanced ability to interact with various applications beyond simple text manipulation. In a demonstration involving Warp, a modern terminal application, ChatGPT accessed and analyzed on-screen content without requiring manual scrolling through extensive code lists. This capability underscores ChatGPT's potential to streamline complex workflows, particularly for developers and professionals handling large datasets or codebases. Further demonstrations showcased ChatGPT's integration with Xcode, Apple's integrated development environment. The AI assisted in generating and debugging code, directly inserting the created code into Xcode, thereby enhancing efficiency in the development process. Although initial attempts encountered errors, the team successfully executed the code on the third try, illustrating the iterative nature of AI-assisted development and the potential for continuous improvement. OpenAI's latest tools reflect a concerted effort to integrate ChatGPT more deeply into users' daily activities, offering advanced functionalities that promote efficiency and accuracy. By enabling seamless interaction with many of Apple's apps and introducing features like Advanced Voice Mode, OpenAI continues to position ChatGPT as a pivotal assistant in both professional and personal contexts. Although Windows users will have to wait for similar features on their PC, OpenAI assured us that those integrations will be coming soon. We look forward to that as well as Day 12, tomorrow, the final day in their product launch event.

OpenAI Launches ChatGPT Support for More Apple Desktop Apps | PYMNTS.com

The new additions include ChatGPT support for several coding and note-taking apps on macOS devices, the company said in a Thursday post on LinkedIn. OpenAI now offers expanded support for coding apps like Warp, IntelliJ IDEA and PyCharm, according to another post on X. It also now supports note-taking apps like Apple Notes, Notion and Quip, per another post on X. The beta is available to Plus, Pro, Team, Enterprise and Edu users, according to a third X post. "As our models get increasingly powerful, ChatGPT will more and more become agentic," OpenAI Chief Product Officer Kevin Weil said in an OpenAI video summarizing news from Day 11 of the company's 12 Days of OpenAI event. "That means we will go beyond just questions and answers; ChatGPT will begin doing things for you ... ChatGPT will do more and more on your behalf." "The desktop apps are a big part of that, too, because being a desktop app, you can do so much more than you can just in a browser tab," Weil said. "That includes things like -- with your permission, of course -- being able to see what's on your screen and being able to automate a lot of the work that you're doing on your desktop." The company launched its Mac desktop app about six months ago, followed by its Windows app about two months ago, Weil said in the video. Apple announced its partnership with OpenAI in June, saying the AI company's ChatGPT4o would be integrated into iOS, macOS and iPadOS and will be ready to tag in when Siri taps out (with the user's permission). It was reported Dec. 1 that OpenAI expects that its partnership with Apple will contribute to the AI company's efforts to reach 1 billion users over the next year. OpenAI anticipates a new phase of growth driven by new products, new data centers and its partnership with Apple -- with ChatGPT's integration with Apple products helping it expand its number of weekly active users.

ChatGPT's Mac app gets a glowup with new coding and notetaking features

ChatGPT's "Working with Apps" feature allows it to interact directly with coding and notetaking apps. For Day 11 of the 12 Days of OpenAI, the company moved from the landline phone to your computer, specifically macOS. OpenAI CPO Kevin Weil demonstrated how Mac owners using the ChatGPT desktop app will see it floating on their screen like a friendly digital sidekick. There's no need to even type requests to it, thanks to the inclusion of Advanced Voice Mode on the desktop app now. You can just speak aloud, and ChatGPT will fulfill your requests even when you're doing other things. Instead of switching between tabs or opening a browser, you can call ChatGPT whenever needed to draft an email, brainstorm ideas, or fix some code. Speaking of coding, the new "Working with Apps" feature has ChatGPT running around many apps on your computer, especially for coding. You can give it access to apps on your Mac, and it'll peek inside, understand what's going on, and lend a helping hand. Say you're using a code editor like Warp and staring at a long, confusing list of code. Instead of scrolling endlessly, you can ask ChatGPT to analyze what's on the screen and it will offer suggestions, explanations, or even write new code snippets. OpenAI showcased how by asking ChatGPT to write some code directly into Xcode, Apple's app development tool. The apps ChatGPT works with aren't limited to coding services either. The AI assistant will write in English and programming languages right into apps like Apple Notes, Quip, and Notion. If you're planning a trip and using Notion to jot down ideas, you can ask ChatGPT to help flesh them out, including citing sources from the internet. If you're a Mac user, the new features are all available. For Windows users, an update to the existing app is coming soon, though OpenAI hasn't given a specific timeframe. These aren't the dramatic announcements of some of the previous days, but it's showcasing OpenAI's vision of ChatGPT spreading beyond the chat window. The AI could become a much more active collaborator, capable of blending multiple apps' powers into one convenient package. This is what OpenAI calls the "agentic" approach to AI, where ChatGPT performs tasks on your behalf, taking some of the workload off your shoulders. One day to go, let's see if OpenAI can close out with as much excitement as they began. It has to be better than the last verse of the song. Nobody wants to take 12 drummer drumming home, but a brand new AI model might be a nice stocking stuffer.