Apple AI unveils SHARP model that generates 3D scenes from single photos in under a second

The Star Trek Holodeck just got closer - Apple's new AI tool generates 3D scenes from your photos in under a second for VR memories

Remember when Apple introduced spatial Lock Screen photos in iOS 26? This feature added a stereoscopic effect to flat images on your Lock Screen, and it's neat, if a little gimmicky. Now, though, Apple has revealed a new trick that takes the effect to an entirely new level - and it could be a brilliant addition to your Apple device if it gets a wider roll-out. That new tool is called SHARP, and it's just been unveiled in a research paper published by Apple. Titled "Sharp Monocular View Synthesis in Less Than a Second," the paper outlines a new tool that can turn 2D images into 3D spatial scenes in under one second. SHARP uses a neural network - artificial intelligence (AI), in other words - to quickly generate a 3D map of your image. That's the part that is performed in less than a second. Once that's complete, the image can be rendered in real time. Apple says it trained the model on around eight million synthetic images created in-house and 2.65 million licensed photographs, with the result that SHARP could learn to discern depth and scale and apply that knowledge to input images. It does this while maintaining consistency when it comes to aspects like scale and distance, meaning you shouldn't see the sorts of stretching and warping that can come about when performing a 2D-to-3D conversion. That's key to maintaining immersion and producing a 3D image that users actually want to keep. Right now, SHARP is more a proof-of-concept than a prime-time feature, and there's no indication of when - or if - it will come to Apple's devices. While it's available to download on GitHub, it's not yet baked into the likes of iOS 26 or macOS Tahoe. That said, it seems like a natural evolution of the spatial photos feature that Apple has already released. If the Photos app on your iPhone will let you explore your images in this way, it could be an attractive selling point for a lot of people. Add it to the Vision Pro headset and it'll be even more immersive. All that said, SHARP does have some drawbacks. For one thing, it's focused on rendering nearby scenes, meaning you can't stray too far from the original viewpoint before fidelity starts to suffer. But as a starting point, it's certainly promising, especially when you consider how quickly it can operate. Don't be surprised to see it roll out in Apple's operating systems at some point in the future.

You Can Now Try Apple's New AI Model That Creates A 3D Scene From A Single Image In Under A Second

Apple is continuing to increase its AI capabilities at a fairly rapid pace. As a case in point, consider the Cupertino giant's latest AI model that is able to create an entire 3D scene from a single 2D image, and that too in under a second. Apple has now published a study, titled "Sharp Monocular View Synthesis in Less Than a Second." The study details how Apple's engineers were able to train an AI model, called SHARP, to generate a "photorealistic" 3D view from a single 2D image. Critically, Apple claims that the view generation takes "less than a second on a standard GPU via a single feedforward pass through a neural network." Basically, SHARP predicts what a 3D scene, distilled from a 2D image, would look like by taking into account the image's "nearby viewpoints." The study notes: "The 3D Gaussian representation produced by SHARP can then be rendered in real time, yielding high-resolution photorealistic images for nearby views. The representation is metric, with absolute scale, supporting metric camera movements." For the benefit of those who might not be aware, 3D Gaussian Splatting is a technique that is used to create photorealistic 3D scenes by representing such scenes as millions of "splats," which are basically tiny colored blobs. To create a full scene, however, often requires numerous 2D images from various angles. Apple's SHARP differs in that it is able to recreate an entire photorealistic scene from a single 2D image by predicting depth and colors, and too in under a second. What's more, you can now try Apple's SHARP AI model for free by heading over to the dedicated GitHub page.