Apple Intelligence brings AI features across iPhone, iPad, and Mac with smarter apps and workflows

Apple just taught your iPhone to finish your sentences, your photos, and your workflows

Apple today announced a slate of new Apple Intelligence updates across its apps, including tab management for Safari, one-tap password updating, cross-app context awareness, and AI-powered shortcut creation via natural language. Safari is getting AI-powered tab management that groups tabs by topic automatically. It can also suggest and add related tabs to an existing group. The company is also adding a page monitor to Safari that notifies you when it detects changes -- useful for tracking prices, news stories, or anything time-sensitive. Apple said Safari can also create a custom extension using text prompts to modify a web page, a capability that until now required a developer. The company is adding a way to update compromised passwords with one tap, with Apple handling the process on your behalf through AI and Safari -- no manual login required. Messages is getting AI-powered reply suggestions and a new ability to surface photos based on a text description, so you can find what you're looking for without scrolling. In Calendar, users can now type in natural language to create an event -- just mention the people and the time, and Apple Intelligence handles the rest. Perhaps the most consequential update for power users: Apple said the Phone app can now pull context from other apps like Mail and Messages mid-call. If you're on the phone with an airline, for instance, it can surface your flight details from your email in real time. It's Apple's answer to Google's similar "Magic Cue" feature, and suggests that the AI assistant wars are increasingly being fought at the operating system level -- with your personal data as the differentiator. The company is also overhauling Shortcuts with AI-powered creation. Rather than manually stitching together a workflow step by step, users can now describe what they want in plain language and the app builds the shortcut automatically -- effectively bringing vibe-coding to the mainstream iPhone user. Image Playground is also getting a significant update, with easier natural-language editing and a new model capable of generating more photorealistic images. Users can tap, circle, or brush to select and edit individual objects, and can now adjust the dimensions of any generated image to fit different formats -- a feature developers will likely use immediately once Apple opens image generation to third parties via a new API. The app is also gaining the ability to generate wallpapers and contact posters. Finally, Apple is updating its Photos cleanup tool with improved infill and higher-quality object removal, and adding an AI-powered expansion tool that can extend the edges of a photo. A new feature called Spatial Reframing lets you reposition the subject or objects within a frame -- using on-device spatial models combined with an image generation model to fill in the new perspective convincingly. Apple says it works on older photos too, which means your existing library is now a potential target for this kind of retroactive editing.

Apple Introduces Next Generation of Apple Intelligence with Advanced Ai Features Across Devices

Apple introduced the next generation of Apple Intelligence, powered by a bold new architecture that integrates the latest Apple Foundation Models deep into Apple?s platforms and is uniquely designed to protect users? privacy. This makes the apps and experiences users rely on every day across iPhone, iPad, Mac, Apple Watch, AirPods, and Apple Vision Pro more personal and helpful than ever. Apps become smarter and more useful with powerful editing capabilities in Photos, intelligent tools to tailor browsing in Safari, the ability to upgrade security protections with Passwords, an all-new Image Playground that creates photorealistic imagery, and more. These features are available for developer testing starting today, and will be available to users this fall. The next generation of Apple Intelligence powers helpful features across the system, simplifying the things users do every day. The next generation of Apple Intelligence also helps power Siri AI, an entirely new version of Siri. Siri AI is a profoundly more personal, capable, and conversational assistant that also offers a new dedicated app, along with integrated tools for writing and Visual Intelligence across platforms. Siri can help users search for information across their messages, emails, photos, and more; answer questions about virtually any topic; and take action in apps. New Siri AI features are available for developer testing starting today, and will be available as a beta to users later this year. The Photos app taps into more powerful image models so users can make incredible edits, while respecting the original moment as it was captured. Photos adjusted with Apple Intelligence will automatically include a hidden SynthID watermark to identify those that have been edited with AI. With Spatial Reframing, users can improve the composition of a photo after it?s been taken. Spatial Reframing builds on Apple?s deep understanding of spatial models thanks to Apple Vision Pro, so users can touch and drag a photo and preview in real time how the perspective shifts ? as if they?d repositioned the camera in the original scene. Using powerful image models, Spatial Reframing will only generate new content where the perspective has been shifted, ensuring the reframed photo stays consistent with the original scene. Users can also expand images with the Extend tool to give their subjects more breathing room. For example, they can straighten a crooked horizon without cropping out anything important, or adjust the aspect ratio, and Extend will fill in the missing pieces. Additionally, the popular Clean Up tool gets a major upgrade, so users can remove distractions with better quality and more realistic infill, even when the scene is complex. With the power of Apple Intelligence, new tools transform how users can browse the web in Safari. Safari can now simplify multi-tab browsing by automatically organizing a user?s tabs into relevant topics. For example, if a user is planning a weekend trip, Safari can bring together all of their travel-planning tabs into one topic. As users browse, Safari will continue to organize new tabs into existing topics or create new ones. With Notify Me, users can ask Safari to monitor a web page for changes, like product restocks or price drops, so they can stay on top of updates they care about. Users can tell Safari what they?re looking for, and when Safari detects a change on that web page, they?ll get a notification so they can take action. Building on its ability to alert users about weak and compromised passwords, Passwords can now automatically fix these for users with just a tap. Using Apple Intelligence and Safari to agentically take action on a user?s behalf, Passwords securely navigates through websites to sign in and upgrade their accounts to strong passwords. With Describe an Extension, users can create custom Safari extensions simply by describing what they want. Safari will then generate the custom extension right in the toolbar ? like adding a button to save and rate recipes a user has tried. Image Playground offers new powerful ways for users to bring their imagination to life. They can create high-quality images in virtually any style, now including photorealistic, thanks to a new generative model that runs on Private Cloud Compute. This is a major transformation for image generation across platforms. And generated images will automatically include a hidden SynthID watermark to identify them as AI-generated. Image Playground makes it easy and intuitive to modify images. Users can describe the changes they want to make ? or simply tap, circle, or brush to highlight an object to move or resize it. Users also have new ways to utilize the images they create. In addition to places like Messages, Image Playground can now be used to generate Lock Screen wallpapers and Contact Posters. Users are also able to choose the aspect ratio for what they?re working on, such as a landscape image for a website or a portrait image for a flyer. New Apple Intelligence features help users manage their communication, surfacing relevant information when they need it. Now Messages offers one-tap suggestions based on the context of users? conversations, making it easier than ever to get things done, such as creating a reminder or a note. For example, if someone asks for photos, Messages can also help users find the right ones, recognizing keywords, locations, and people in their library to find the best options. Additionally, suggestions in Mail become even more capable with the ability to take action with third-party apps. And Smart Reply in Mail and Messages can now draw on a user?s personalized writing style. When users call a business, Call Context proactively surfaces relevant information ? like a confirmation code or reservation number ? directly in the Phone app. For example, if a user calls an airline to change a flight, the Phone app can automatically find their confirmation code in Mail. Call Context looks at who the user is calling, not what they?re saying, to surface helpful information; it runs entirely on device, so nothing is shared with Apple or anyone else. Apple Intelligence also makes it possible to add or modify events in Calendar just by describing the event. As users type, Calendar will identify contacts and locations, and create a title for the event. Shortcuts help users get things done faster by automating a wide range of tasks, and now with Describe a Shortcut, it?s more approachable than ever. Leveraging the power of Apple Intelligence, Shortcuts can now take a user?s description and assemble the required steps on their behalf. If a user sees something they need to tweak or add, they can simply describe their change, and the Shortcuts app makes adjustments. Apple Intelligence makes it easier to stay on top of things at home, with updates to accessory notifications and new capabilities for HomeKit Secure Video cameras.